Technical Program Manager, LLM data

Situated in the heart of Singapore's Central Business District, Rakuten Asia Pte. Ltd. is Rakuten's Asia Regional headquarters. Established in August 2012 as part of Rakuten's global expansion strategy, Rakuten Asia comprises various businesses that provide essential value-added services to Rakuten's global ecosystem. Through advertisement product development, product strategy, and data management, among others, Rakuten Asia is strengthening Rakuten Group's core competencies to take the lead in an increasingly digitalized world. 

 
Rakuten Group, Inc. is a global leader in internet services that empower individuals, communities, businesses, and society. Founded in Tokyo in 1997 as an online marketplace, Rakuten has expanded to offer services in e-commerce, fintech, digital content, and communications to approximately 1.7 billion members around the world. The Rakuten Group has nearly 32,000 employees and operations in 30 countries and regions. For more information visit https://global.rakuten.com/corp/. 

The AI & Data Division (AIDD), creates powerful, customer-focused search, recommendation, data science, advertising, marketing, price, and inventory optimization solutions to a variety of businesses in Rakuten group.  As part of AIDD, AILab builds new solutions that have the potential to transform how users interact with Rakuten service. Our goal is to drive innovation by developing new products and capabilities that deliver significant impact over longer timeframes using AI. The Frontier Research Department is responsible for advancing Rakuten’s core AI capabilities, including large language models and related technologies. The team works across model development, post-training, evaluation, deployment, and data strategy to improve model quality, alignment, scalability, and practical effectiveness.  As LLM data program manager, you will partner with research and engineering to design and implement pragmatic solutions for collecting high-quality data for training and evaluation. You will be a key interface between our business team, research and engineering, and data annotation team.  

Core responsibilities 

• Data Lifecycle Management: Driving initiatives for data acquisition, cleaning, labeling, and augmentation for training LLMs and evaluating agent  

• Human Feedback Operations (RLHF/SFT): Designing and managing programs that turn human feedback into reliable signals for model evaluation and fine-tuning.  

• Technical Roadmap Collaboration: Working with engineering to improve data annotation tools, automate workflows, and enhance data platform function  

• Metric and Performance Tracking: Tracking key performance indicators (KPIs) related to data quality, quantity, and model performance to optimize production 

Required qualifications 

• 5 years of experience in AI, LLM operations, or data-intensive program management. 

• Degree in engineering or science   

• Solid understanding of model training techniques, including Supervised Fine-Tuning (SFT) and Reinforcement Learning from Human Feedback (RLHF). 

• Strong analytical skills to analyze metric trends and data quality. 

• Ability to manage high-uncertainty projects from end-to-end, align cross-functional teams, and manage vendors. 

• Familiarity with Python or other coding language.  

Nice to have 

• Ability to converse in Japanese will be advantageous

• Familiarity with various of ai coding tools