Data Engineer

Nielsen, a renowned global company specializing in audience measurement and analytics, is looking for a Data Engineer to join their team in Bangalore, Gurgaon. The primary responsibility will be to construct an advanced data platform that examines audience consumption patterns across various channels such as OTT, TV, Radio, and Social Media on a global scale. The successful candidate will oversee all technical aspects of the data platform, including architecture, engineering, operational excellence, and ensuring availability. The candidate will also be responsible for promoting a culture of innovation and experimentation, as well as nurturing the development of engineers within the team.

Key Tasks and Responsibilities

● Consult with stakeholders to determine the scope of software development projects.

● Design, develop, test, and document new software features as per business requirements.

● Contribute to the process of migration of the current solutions to the AWS cloud.

● Investigate application incidents for missing or incorrect functionality.

● Perform code reviews.

● Supervise the software development team.

● Demonstrate patience and use effective explanations when mentoring junior software developers. Required competencies

● Strong knowledge of Python.

● Experience with Pandas and Spark.

● Basic Linux administration skills.

● At least intermediate level of English, both written and verbal.

● Five years of working experience in a field related to a similar position.

● Good communication skills.

● Working knowledge of any Cloud. Nice to have competencies

● Experience in AWS cloud application development.

● Scrum Agile development experience.

● Experience in writing Airflow DAGs.

● Experience in writing GitLab CI/CD pipelines.

Technology stack Airflow, AWS, Bash, CI/CD, Confluence, Docker, GitLab, Jira, Kubernetes, Linux, Pandas, Python, Spark.