Technical Support Engineer at LiteLLM

LiteLLM is an open-source LLM Gateway with 28K+ stars on GitHub and trusted by companies like NASA, Rocket Money, Samsara, Lemonade, and Adobe. We’re rapidly expanding and seeking a performance engineer to help scale the platform to handle 5K RPS (Requests per second). We’re based in San Francisco. LiteLLM provides an open source Python SDK and Python FastAPI Server that allows calling 100+ LLM APIs (Bedrock, Azure, OpenAI, VertexAI, Cohere, Anthropic) in the OpenAI format We just hit $2.5M ARR and have raised a $1.6M seed round from Y Combinator, Gravity Fund and Pioneer Fund. You can find more information on our website , Github and Technical Documentation. We’re looking for a Technical Support Engineer to help our customers troubleshoot issues, optimize their setup, and get the most value out of our product. You’ll be the first line of defense for incoming technical questions, ensuring timely resolution and a great customer experience. This role is ideal for someone who enjoys solving complex technical problems, communicating clearly with both technical and non-technical users, and continuously improving internal processes and documentation. Diagnose and troubleshoot technical p