Data Engineer (Mid-Senior)

EMPLOYMENT TYPE

Contract - 12 months with extension possibilities

COMPANY

Vito Solutions

LOCATION

Belville, Cape Town

WORKING MODEL

Hybrid (2 days remote, 3 days in office)

JOB OVERVIEW

We are looking for an experienced and driven Cloud Data Engineer to become part of a vibrant data engineering unit. The successful candidate's responsibility will involve utilising their technical expertise to integrate software, systems, and data, deriving valuable insights from unprocessed data. They'll work closely with data scientists, analysts, and various stakeholders to guarantee data accessibility, accuracy, and peak efficiency.

DESCRIPTION OF POSITION

Requirement Analysis

• Comprehend and assess client demands and operational necessities.
• Recognise, scrutinise, visualise, and grasp underlying data to suggest robust resolutions.

Design and Development

• Create and construct data tiers to drive Big Data analysis.
• Plan and build data integration frameworks and guarantee effective data retrieval, transformation, and loading from diverse origins.
• Create and maintain technical documentation.
• Support existing solutions.
• Examine requirements and data, crafting data repository, and product strata.
• Develop, test, and ensure the quality of data pipelines and layers.
• Conduct peer evaluations and adhere to the Software Development Life Cycle (SDLC) procedures and documentation guidelines.

Team Collaboration and Support

• Engage proactively with the product team and offer cross-training and mentorship.
• Provide timely status updates to the team.
• Log change requests and accurately log time.
• Participate in standby rotation.
• Be a cooperative team member; consistently work together, interact socially, and stay involved with your product team and the broader team.

Quality and Efficiency

• Responsible for the delivery of value and quality solutions.
• Drive ticket progress and ensure timely resolution.

Operational Management

• Manage GCP costs.
• Guarantee the effective development of infrastructure necessary for the optimal extraction, transformation, and loading of data from diverse sources.

KNOWLEDGE AND SKILLS

• Strong understanding of data engineering principles and modern data platforms.
• Proficiency in Python and SQL for large-scale data processing.

-Ability to build and troubleshoot real-time and batch data pipelines.

• Knowledge of cloud-native data services like Azure, AWS or Google Cloud.
• Understanding of data integrity, quality, lineage and performance monitoring.
• Ability to work in environments with security and compliance requirements.
• Strong problem-solving, debugging and optimisation skills.
• Ability to collaborate with cross-functional teams in a fast-paced environment.

QUALIFICATIONS REQUIRED

• Relevant tertiary qualification in Computer Science, Information Systems, Data Engineering or related field.
• Cloud platform or data engineering certifications advantageous.

EXPERIENCE REQUIRED

• Minimum 5+ years' experience in Data Engineering.
• Hands-on experience building high-volume data pipelines.
• Strong experience using Python and SQL.
• Experience with modern data platforms across Azure, AWS or Google Cloud.
• Understanding of data security and governance

ADVANTAGEOUS SKILLS

• Experience with event streaming platforms or real-time analytics.
• Knowledge of data observability, monitoring and automated data quality frameworks.
• Familiarity with DevOps, CI/CD and infrastructure-as-code concepts.
• Retail experience
• Exposure to GCP tools preferred

**Please note: If you have not heard from us within 2 weeks, please consider your application unsuccessful.