Litellm

Litellm

Solutions Architect

Company

Litellm

Role

Solutions Architect

Job type

Full-time

Posted

2 days ago

Share this job

Salary

Not disclosed by employer

Job description

LiteLLM is the world’s most popular AI Gateway used by the largest companies (Adobe, Netflix, NASA, etc.) in the world to give their developers access to LLMs and adjacent services (MCP’s, Vector Stores, etc.).

ABOUT THE ROLE

We're looking for a Solutions Architect to collaborate with our key customers, helping them successfully deploy and scale LiteLLM in production. You'll work directly with customers both pre and post-sales, troubleshooting complex issues, and ensuring they extract maximum value from the platform.

This role is ideal for someone who thrives in dynamic, customer-facing environments, enjoys solving customer challenges in real-time, and can translate customer needs into actionable product improvements.

RESPONSIBILITIES

  • Design, implement, and optimize solutions for our customers in both pre-sales and post-sales capacities.
  • Collaborate with customers to identify business needs and tailor product integrations.
  • Partner closely with engineering and product teams to drive roadmap and deliver mission-critical features.
  • Serve as a technical and domain expert, bridging the gap between AI innovation and client requirements.
  • Build and document best practices and solution templates for rapid deployment.

REQUIREMENTS

  • 1+ years of experience in solution engineering, technical consulting, or related roles in high-growth startups or tech companies.
  • Strong technical background; experience with Python and AI/ML products highly preferred.
  • Excellent communication, relationship-building, and problem-solving skills.
  • Proven ability to operate with autonomy in fast-paced, high-ownership environments.

WHY WORK AT LITELLM?

  • You thrive working directly with customers at a fast-growing startup—scoping complex technical challenges, leading implementation discussions, and driving them to production success
  • You love working closely with developers (30K+ Github stars) and being at the intersection of product and customer
  • You want to work hard and move fast in a high-impact role
  • You want to see firsthand how AI is transforming businesses—our customers run ALL their LLM calls through LiteLLM
  • You enjoy the autonomy and variety of working across multiple customer environments and technical stacks

ABOUT LITELLM

LiteLLM (https://github.com/BerriAI/litellm) is a Python SDK, Proxy Server (LLM Gateway) to call 100+ LLM APIs in OpenAI format - [Bedrock, Azure, OpenAI, VertexAI, Cohere] and is used by companies like Rocket Money, Adobe, Twilio, and Siemens.

Resume ExampleCover Letter Example

Explore more