Data Engineer with DWH

Project Description

The goal of the project is to implement and standardize Data Contracts across the organization to improve data quality, consistency, and predictability within the data ecosystem (Data Warehouse / Big Data) in a GCP environment.

The project includes the design, implementation, and automation of data contracts between data producers and consumers, covering:

• Definition of data schemas
• Data quality requirements
• Validation and monitoring mechanisms
• Technical documentation supporting analytical, business, and technical teams

The solution will support a Data Governance by Design approach, increasing data transparency, integration stability, and reducing response time to changes from both data sources and consumers.

 

Main Responsibilities

You will be responsible for delivering tasks within Data Engineering and Data Analytics, with a strong focus on Data Contracts, including:

• Designing and defining Data Contracts (data schemas, quality rules, and SLAs) in collaboration with business, analytics, and technical teams.
• Implementing data contracts using standards such as OpenAPI / JSON Schema.
• Automating contract validation in CI/CD pipelines, including data quality (QA) testing.
• Analyzing, processing, and modeling data in a Data Warehouse / Big Data environment on GCP.
• Developing and optimizing advanced SQL queries (aggregations, performance optimization, index management).
• Designing logical and physical data models and data layers.
• Ensuring data quality through testing, monitoring, and alerting mechanisms.
• Creating and maintaining technical documentation and participating in code reviews.
• Collaborating with Data Governance and Data Quality teams.

Must-have Requirements

• 3 years of experience as a Data Engineer,
• Practical knowledge of Data Contracts, preferably in ODCS (Open Data Contract Standard), including defining contracts and quality requirements,
• Experience with tools supporting contract automation (e.g. OpenAPI, JSON Schema, CI/CD tools, data QA tools),
• Hands-on experience in data analysis, processing, and modeling,
• Strong understanding of Data Warehouse and Big Data architectures,
• Advanced SQL skills with proven experience (query optimization, aggregations, index management),
• Experience in data modeling and building data layers,
• Experience ensuring data quality (testing, monitoring, alerting),
• Experience in technical documentation and code review processes,
• Strong collaboration and communication skills with business, technical, and analytics teams,
• Proactive mindset, ownership, and focus on data quality.

Nice-to-have Requirements

• Experience with data management tools, such as:
  • dbt, Dataform (data transformation and documentation)
  • Dataplex, Data Catalog (data governance tools)
• Experience with data migrations from on-premise systems
• Knowledge of Data Governance and Data Quality concepts
• Familiarity with the GCP ecosystem

Hybrid work: 1 day per week working from the office, Warsaw