Data Engineer, Software Development

At LPL’s Global Capability Center, you'll find a collaborative culture where your voice matters, integrity guides every decision, and technology fuels progress. Your skills, talents, and ideas will redefine what's possible. LPL's success reflects its exceptional employees, who together pursue one noble purpose: empowering financial advisors to deliver personalized advice for all who need it. We’re proud to be expanding and reaching new heights in Hyderabad.

Join us as we create something extraordinary together.

We are seeking a highly skilled Senior Data Engineer to join our Direct Business and LPL Data Experience (LDX) team. This role is critical to designing and implementing modern, cloud‑based data and application capabilities that will transform how Direct business data is ingested, managed and leveraged for various business functionalities within the firm for advisors, investors cross the enterprise.

The ideal candidate will bring strong experience in Python, AWS data pipeline services (Glue, Lambda, EventBridge, Open Search, RDS, S3), and distributed workflow design. While UI or .NET experience can be beneficial, those are not mandatory requirements for this role.

You will work closely with architects, product teams, SMEs, and engineering partners to deliver scalable, resilient, and future‑ready systems that modernize the compensation platform end‑to‑end.

Responsibilities

Core – Data Engineering & Cloud Architecture

• Design and implement end‑to‑end data pipelines to support compensation calculations, ingestion, validation, and downstream processing

• Build and maintain ETL/ELT workflows using Python, AWS Glue, Lambda, and Step Functions

• Develop event-driven workflows leveraging AWS EventBridge, SQS, SNS, and other serverless components

• Implement data quality, reconciliation, auditing, and monitoring layers to ensure high data integrity for compensation processes

• Work with relational databases (RDS/Postgres/SQL Server) for modeling, transformations, and performance tuning

• Integrate cloud data services with compensation rules engines, distribution systems, and downstream consumers

Application & Platform Engineering (Optional / Nice-to-Have)

• Contribute to application components and microservices supporting compensation workflows

• Assist with API design or UI enhancements as needed (Angular, JavaScript, .NET — optional)

Engineering Excellence

• Partner with product, architecture, QA, and DevOps teams in an Agile environment

• Apply CI/CD practices for automation and deployment of cloud-based data components

• Troubleshoot data and workflow issues quickly and effectively

• Analyze existing processes and propose improvements to increase transparency, scalability, and automation in compensation processing

• Communicate clearly with business stakeholders, compensation SMEs, and technology partners

What We’re Looking For

We need collaborators who excel in dynamic, fast‑paced environments and are passionate about transforming legacy systems into scalable, automated, cloud-native platforms. Ideal candidates act with integrity, embrace innovation, and demonstrate ownership in delivering high‑quality solutions.

Requirements

Data Engineering & Cloud (Primary Requirements)

• 8+ years of experience designing and implementing complex systems

• 5+ years hands-on data engineering experience, ideally in transformation‑heavy or rules‑driven domains

• Strong Python development skills for ETL/ELT and pipeline orchestration

• Hands-on experience with AWS cloud services

    • AWS Glue (ETL jobs, crawlers, transformations)

    • AWS Lambda

    • EventBridge (event-driven patterns)

    • Amazon RDS

    • S3 and data lake patterns

• Strong SQL expertise (stored procedures, indexing, optimization)

• DevOps experience with GitHub, CI/CD, build & deploy pipelines

• Strong understanding of enterprise integration patterns, SOA concepts, and system design principles

Optional / Nice-to-Have (Not Hard Requirements)

• Experience with .NET, C#, JavaScript, Angular, or Web API development

• Experience with Snowflake or other modern cloud data warehouses

• Experience with Jira, TeamCity, Octopus

• Experience developing systems related to compensation, payroll, financial calculations, or rules‑driven engines

Soft Skills & Competencies

• Excellent communication, stakeholder management, and cross-team collaboration

• Strong analytical, problem‑solving, and debugging skills

• Ability to troubleshoot production issues under tight timelines

• Self-driven, innovative, and quick learner

• Bachelor’s degree in Computer Science or related field

Preferences

• Experience writing unit tests using NUnit, JUnit, Jasmine/Karma, etc.

• Experience with estimation techniques and engineering best practices

• Understanding of cloud‑based application

LPL Global Business Services, LLP - PRIVACY POLICY