AWS Databricks - Senior Associate

The Opportunity

Join our Acceleration Center India and help shape the future of business for our diverse client portfolio across geographies and jurisdictions. You’ll work at the heart of global teams across Advisory, Assurance, Tax and Business Services—solving real client challenges through connected collaboration. We’ll help you grow your skills so you can go further. With hands-on learning, cutting-edge tools and an inclusive culture, this is your opportunity to do inspiring work that makes a difference—every day.

As an AWS Databricks - Senior Associate, you will engage directly with clients to deliver innovative software solutions within our Technology Consulting practice. You will leverage your skills in software engineering to design, develop, and implement cutting-edge solutions that address complex business challenges. As a Senior Associate, you will focus on building meaningful client connections and navigating complex situations to deliver quality work. You will guide and mentor junior team members, fostering a collaborative environment that encourages growth and development.

In this role at PwC Acceleration Center India, you will be part of a dynamic team that emphasizes relationship building and managing others. You will anticipate the needs of your clients and teams, using critical thinking to break down complex concepts and deliver impactful solutions. Embracing ambiguity, you will use these moments as opportunities to grow your personal brand and deepen your technical skills. Your contributions will be integral to the success of our Platform Engineering & Architecture competency network, where you will help shape the future of technology consulting.

What You Must Have

• At least a Bachelor's degree
• At least 2 years of experience
• Oral and written proficiency in English requiredResponsibilities
• o Architect and implement AWS Lambda functions for event-driven data processing and microservice integrations.

o Build integrations using AWS Glue, AWS Step Functions, and Amazon EventBridge for orchestration.

o Work with Amazon S3, AWS Lake Formation, and AWS Glue Catalog as the data lake foundation.

o Design real-time and batch ingestion pipelines using Amazon Kinesis, MSK (Kafka), and SQS/SNS.

o Implement AWS API Gateway integrations with Lambda for serverless data APIs.

• Experience with real-time analytics using Apache Flink or Kafka Streams.
• Exposure to ML pipeline development and MLflow model registry in Databricks.
• Familiarity with data governance frameworks and data quality tools
• Experience with SQL and NoSQL databases (Redshift, DynamoDB, RDS, PostgreSQL).
• Managing application lifecycle processes including development, testing, and deployment
• Utilizing microservices architecture to enhance system scalability and performance
• Conducting code reviews to maintain coding standards and improve software quality
• Collaborating with cross-functional teams to gather and analyze business requirements
• Applying continuous integration and continuous delivery (CI/CD) practices to streamline software development
• Debugging and troubleshooting software issues to optimize application functionality
• Designing and maintaining enterprise application architecture for seamless integration
• Leading efforts in business process improvement through innovative software solutions
• Engaging in client management to understand and address client needs effectively

What Sets You Apart

• Preference for at least one of the following fields of study: Artificial Intelligence, Business Analytics, Computer and Data Engineering, Computer Science, Human Computer Interaction, Industrial Engineering, Information Systems/Technology, Machine Learning, Management Information Systems, Software Engineering
• Responsibilities
• o Architect and implement AWS Lambda functions for event-driven data processing and microservice integrations.

o Build integrations using AWS Glue, AWS Step Functions, and Amazon EventBridge for orchestration.

o Work with Amazon S3, AWS Lake Formation, and AWS Glue Catalog as the data lake foundation.

o Design real-time and batch ingestion pipelines using Amazon Kinesis, MSK (Kafka), and SQS/SNS.

o Implement AWS API Gateway integrations with Lambda for serverless data APIs.

• Experience with real-time analytics using Apache Flink or Kafka Streams.
• Exposure to ML pipeline development and MLflow model registry in Databricks.
• Familiarity with data governance frameworks and data quality tools
• Experience with SQL and NoSQL databases (Redshift, DynamoDB, RDS, PostgreSQL).
• Managing application lifecycle processes including development, testing, and deployment
• Utilizing microservices architecture to enhance system scalability and performance
• Conducting code reviews to maintain coding standards and improve software quality
• Collaborating with cross-functional teams to gather and analyze business requirements
• Applying continuous integration and continuous delivery (CI/CD) practices to streamline software development
• Debugging and troubleshooting software issues to optimize application functionality
• Designing and maintaining enterprise application architecture for seamless integration
• Leading efforts in business process improvement through innovative software solutions
• Engaging in client management to understand and address client needs effectively