Data Engineer

REQUIRED MINIMUM EDUCATION/TRAINING

• BCom or Bachelors degree in Information Technology / Computer Science / Engineering (IT) or similar
• Data Engineering tools (Azure Data Engineer) certification will be an added advantage
• ITIL or COBIT certification will be an added advantage

REQUIRED MINIMUM WORK EXPERIENCE

• 2 - 4 years of working experience in an IT environment
• Experience in working on IT enterprise Azure-based data solutions
• Experience with Python and SQL
• Experience in gathering requirements and transitioning them to designs and outcomes
• Experience working in the Agri sector will be an advantage

KEY PERFORMANCE AREAS

• Ensure scalability of solutions
• Continuously improve business data environment design and efficiencies
• Deliver business benefits from advanced analytics
• Ensure the managed data (business intelligence) is fit for purpose relative to customer needs
• Design and develop end-to-end data solutions on the Data platform, ensuring optimal performance, scalability, and reliability.
• Collaborate with data architects, data analysts, and business stakeholders to understand data requirements, define data models, and implement data integration solutions.
• Implement data pipelines, data lakes, and data warehouses using.
• Develop and maintain ETL/ELT processes to extract, transform, and load data from various sources into Azure data platforms.
• Design and optimize data schemas, tables, and indexes for efficient data storage and retrieval.
• Perform data profiling, data cleansing, and data quality assessments to ensure data accuracy and consistency.
• Develop and implement data security and privacy measures, ensuring compliance with relevant regulations (e.g., POPIA).
• Monitor and troubleshoot data pipelines, identifying and resolving performance bottlenecks, data inconsistencies, and system issues.
• Collaborate with DevOps teams to implement CI/CD pipelines and ensure smooth deployment and release management of data solutions.
• Stay up to date with the latest data technologies, trends, and best practices, and provide recommendations for continuous improvement.

TECHNICAL KNOWLEDGE / COMPETENCIES

• Microsoft Azure Data suite
• Data and Business intelligence enablement knowledge
• Business intelligence rendering tools
• Working knowledge of Project Management Tools
• Excellent verbal and written communication skills
• IT Security would be an added advantage

BEHAVIOURAL COMPETENCIES

• Analytical ability
• Attention to detail
• Ability to tie together technologies and architectures to address requirements
• Planning and organizing
• Strong communication skills
• Teamwork
• Change Agent
• Work under pressure
• Assertiveness
• Interpersonal skills