ETL Data Architect

Dice is the leading career destination for tech experts at every stage of their careers. Our client, DCM Infotech Limited, is seeking the following. Apply via Dice today!

Job Description: ETL Data Architect

Location: West Chester, PA ONSITE

Duration: 12+ months with possible extension

Experience: 10+ years (preferred) Technology Focus: PySpark, Spark Cluster, Python, ETL Data Pipelines, Data bricks, Run deck Domain Expertise: Telecom (Buyflow, Billing, Provisioning, Customer Journeys, Order processing etc.)

Role Overview

We are looking for an experienced Telecom ETL Data Architect who can design, architect, and optimize large-scale data pipelines within the telecom ecosystem. This role requires deep hands-on skills in PySpark, Spark clusters, Data bricks, and ETL orchestration, along with strong communication, articulation, and storytelling abilities.

The ideal candidate will be someone who can translate complex technical workflows into clear business narratives, influence stakeholders through structured communication, and derive different use-cases from different domain data insights.

Key Responsibilities

Data Architecture & Engineering

Design and architect scalable, high-performance ETL/ELT data pipelines using PySpark, Python, and Spark clusters.

Develop data models and frameworks aligned with telecom processes such as buyflow, billing, usage, customer management, and order processing.

Build, optimize, and monitor pipelines on Databricks (Delta Lake, Workflows, Cluster configuration).

Define and enforce ETL standards, data quality rules, and engineering best practices.

Domain & Business Integration

Work closely with business and product teams across telecom functions:

• Customer / Account onboarding
• Buyflow journeys
• Billing & payments
• Network provisioning
• Customer service & troubleshooting

Translate domain processes into logical and physical data flows.

Communication & Storytelling

Clearly articulate technical solutions to non-technical stakeholders.

Create data Stories and high-impact presentations connecting data insights to business outcomes.

Communicate architectural decisions, trade-offs, and roadmap recommendations.

Present complex architecture in simplified, visual storytelling formats.

Orchestration & Operations

Implement and maintain job scheduling/orchestration using Rundeck or similar tools.

Build monitoring, logging, and automated recovery mechanisms for pipelines.

Ensure end-to-end performance tuning, cost optimization, and SLA adherence.

Collaboration & Leadership

Work with cross-functional engineering teams, product owners, and solution architects.

Mentor junior data engineers and set coding and architecture standards.

Drive design sessions, code reviews, and architecture assessments.

________________________________________

Required Skills

Technical Skills Strong expertise in PySpark, Spark SQL, Spark Streaming. Proven experience building pipelines in Data bricks (Delta Lake, Jobs, Clusters). Solid Python programming and modular ETL development experience. Experience with telecom systems, data domains, and operational workflows. Knowledge of CI/CD, version control (Git), and cloud platforms (Azure/AWS/Google Cloud Platform). Experience with orchestration tools such as Run deck, Airflow, or Control-M.

Soft Skills

Excellent articulation and structured communication.

Ability to simplify complex data concepts into business-friendly narratives.

Strong problem-solving, analytical, and decision-making skills.

Ability to lead conversations with senior stakeholders.

A natural storyteller with the ability to craft architecture and data stories.

________________________________________

Preferred Qualifications

Background working with large telecom providers (e.g., Comcast/Xfinity, AT&T, Verizon, etc.).

Experience with event-driven architecture, Kafka, or real-time streaming.

Understanding of telecom KPIs, customer journeys, and operational systems.

Experience in performance tuning of Spark workloads.