Python Developer - with Data engineering Skills

Location: Richmond - hybrid.

Introduction

The project is centered on a data management (TDM) function responsible for securely moving sensitive data across non-production environments using internally built frameworks. The work is heavily backend-focused, combining data engineering and software engineering, with pipelines primarily built in Scala on Spark and supported by AWS services (including EMR, IAM, KMS, S3) and Python-based serverless components like Lambda. The contractor will help maintain and enhance this patented in-house framework, automate data pipelines, ensure compliance with strict cybersecurity and auditing requirements, and contribute to ongoing feature development and self-service capabilities. The team operates entirely in production, even though the data movement is between non-production environments.

Required Skills & Qualifications

• Strong expertise in Spark, Scala, AWS, Python, and shell scripting
• Experience in building data pipelines
• Software engineering skills slightly preferred
• Must have previous client experience working for this customer in the past 5 years Preferred Skills & Qualifications • Experience with Ab Initio Day-to-Day Responsibilities • Maintain and enhance the in-house framework, Data Shield, which is built in Scala and runs on Spark
• Automate data pipelines and ensure compliance with cybersecurity standards
• Contribute to ongoing feature development and self-service capabilities
• Integrate into a small, highly collaborative backend team operating in a fast-paced environment Company Benefits & Culture • Work in a fast-paced, dynamic environment
• Opportunity to contribute to patented technology
• Collaborative team atmosphere

For immediate consideration please click APPLY to begin the screening process with Alex.