Senior Consultant

Job description for Data Engineer:

• Strong understanding of data engineering and dimensional design fundamentals, good at SQL, integration (ETL), front-end analysis / data visualization, learns new technologies quickly.
• Good understanding of data warehouse schema design and granularity of the data.
• Good understanding of data federation techniques and aggregation of data at scale from multiple source systems.
• Designing and developing ETL pipelines across multiple platforms and tools including Spark, Hadoop and AWS Data Services.
• Gathering functional requirements, developing technical specifications, and project & test planning.
• ake it available for analysis.
• Support large data volumes and accommodate flexible provisioning of new sources.
• As a key member of the team drive adoption of new technologies, tools, and process improvements to build world class analytical capabilities for web analytics, optimization, experimentation and personalization.
• Experience in developing DB schemas, creating ETLs pipelines with Spark and familiar with MPP/Hadoop systems.
• Must have mastery of data warehousing technologies including data modeling, ETL and reporting. Ideal candidate to have 6+ years of experience in end-to-end data warehouse implementations and at least 2 projects with 4TB+ data volume.
• Demonstrated understanding of the Software design and architecture process.
• Experience with unit testing and data quality automation checks
• Should be results oriented, self-motivated, accountable and work under minimal supervision.
• Excellent written, oral communication and presentation Skills.
• Education: Bachelor's or Master's degree in Computer Science or equivalent work experience.

Good to have:

• Knowledge of Big Data eco system like Hadoop M/R, Pig and Hive is a strong plus.
• Conceptual understanding of Machine Learning / LLM / GenAI Usage is a plus.
• Good understanding of any reporting tools such as Tableau, QlikSense
• Experience in design, development and deployment of one or more tools - ETL (Informatica, OWB, ODI)