Senior Data Engineer

About the role : We are seeking a skilled and experienced Data Engineer to join our team. As a Data Engineer, you will play a crucial role in designing, developing, and maintaining our data infrastructure and pipelines. You will collaborate with cross-functional teams to gather requirements, build scalable solutions, and ensure the availability and reliability of our data systems.

Responsibilities: ●Design, develop, and implement scalable and efficient data pipelines in the cloud using Python, SQL, and relevant technologies.

● Build and maintain data infrastructure on platforms such as AWS, leveraging services like EMR, Redshift, and others.

● Collaborate with data scientists, analysts, and other stakeholders to understand their requirements and provide the necessary data solutions.

● Develop and optimize ETL (Extract, Transform, Load) processes to ensure the accuracy, completeness, and timeliness of data.

● Create and maintain data models, schemas, and database structures using PostgreSQL and other relevant database technologies.

● Experience reporting tools such as Superset, (good to have : Domo, or Tableau, Quicksight) to develop visually appealing and insightful data visualizations and dashboards.

● Monitor and optimize the performance and scalability of data systems, ensuring high availability and reliability.

● Implement and maintain data security and privacy measures to protect sensitive information.

● Collaborate with the engineering team to integrate data solutions into existing applications or build new applications as required.

● Stay up-to-date with industry trends, emerging technologies, and best practices in data engineering

Qualifications : ● Bachelor's or master's degree in Computer Science, Engineering, or a related field.

● Strong proficiency in Python and SQL for data manipulation, analysis, and scripting.

● Extensive experience with cloud platforms, particularly AWS, and working knowledge of services like EMR, Redshift, and S3.

● Solid understanding of data warehousing concepts and experience with relational databases like PostgreSQL.

● Familiarity with data visualization and reporting tools such as Superset, Domo, or Tableau.

● Experience with building and maintaining data pipelines using tools like Airflow.

● Knowledge of Python web frameworks like Flask or Django for building data-driven applications.

● Strong problem-solving and analytical skills, with a keen attention to detail.

● Excellent communication and collaboration skills, with the ability to work effectively in a team environment.

● Proven ability to work in a fast-paced environment, prioritize tasks, and meet deadlines.

● If you are a talented Data Engineer with a passion for leveraging data to drive insights and impact, we would love to hear from you.