Senior Member Technical Staff - Data engineer

Nielsen is seeking a solid and experienced Big Data Engineer. This position requires at least 7 years of experience in the web domain. This position will be responsible for development tasks, including frontend, and database development. The successful candidate will be required to engage with all areas within Nielsen including collection, processing systems, testing, operations, with partners worldwide.

• Strong programming skills using at least one of the languages like Spark, Scala, Python, 5-8 years experience.
• Working knowledge of AWS Cloud Servers and related services.
• Good knowledge of RDBMS (MySQL), database designing, and query optimization techniques.
• Experience in NoSQL (MongoDB / DynamoDB / DocumentDB) databases will be an added advantage.
• Experience with Data ETL (Extract Transform and Load) using Legacy and Cloud based services.
• Working knowledge of version controlling systems like GitLab, clear understanding of Gitflow workflow, repository management tools like BitBucket, and understanding of the overall CI/CD process.
• Knowledge with real time streaming data processing using technologies like Kafka & Spark is a plus.
• Knowledge of big data processing and query technologies like Hadoop, Hive and Pig is a plus.
• Knowledge of User Interface design and Data Visualization and Reports is a plus.
• Knowledge of container technologies like Docker and Kubernetes.
• Knowledge of infrastructure as code using Terraform, Cloudformation and Ansible.
• Desire to leverage DevOps techniques including fully automated testing and deployment, Agile methodology and continuous integration/continuous delivery.
• Experience with instrumenting logging and monitoring into applications.
• Experience with setting up test environments, designing test plans, developing test cases/scenarios/usage cases, and executing these cases.
• Experience with Linux OS and Shell scripting.
• Experience with all aspects of product/system development life cycle.
• Desire to invent the next generation of measurement techniques.
• Passionate about technology and the desire to grow professionally.
• Creative thinkers who can propose solutions to tough problems and collaborate well with other