LiteLLM
TLDR
LiteLLM is an
open-source LLM Gateway with 28K+ stars on GitHub
and trusted by companies like
NASA, Rocket Money, Samsara, Lemonade, and Adobe.
Were rapidly expanding and seeking a founding full-stack engineer to help scale the platform. Were based in San Francisco. What is LiteLLM
LiteLLM provides an
open source Python SDK and Python FastAPI Server that allows calling 100+ LLM APIs (Bedrock, Azure, OpenAI, VertexAI, Cohere, Anthropic) in the OpenAI format We just hit
$2.5M ARR
and have raised a
$1.6M seed round from Y Combinator, Gravity Fund and Pioneer Fund.
You can find more information on our website, Github and Technical Documentation. Why do companies use LiteLLM enterprise Companies use LiteLLM Enterprise once they put LiteLLM into production and need enterprise features like Prometheus metrics (production monitoring) and need to give LLM access to a large number of people with SSO (secure sign on) or JWT (JSON Web Tokens) What you will be working on
Skills:
Next.js, Python, TypeScript, User discovery LiteLLM exposes a developer portal, used by admins to grant access to 1k+ developers within their organizations. You will be responsible for: Making sure the UI is stable, and responsive Adding or improving existing management endpoints to support UI functionality (e.g. writing performant endpoints for viewing daily usage) Simplifying UI/UX flows (requires talking to users, understanding whats confusing and working to simplify it) to support new user onboarding This is a high impact role. You will be working closely with our CEO and CTO. What is our tech stack
Backend built on Python, FastAPI. Frontend on Next.js + Typescript + TailwindCSS Who we are looking for
You have 1-2 years of experience in frontend or full-stack development and have worked on production grade critical systems You are excited about open source software. You want to talk to our users to understand why they use us and what they require. Experience integrating with / writing backend APIs in Python Knowledge of automated UI testing frameworks Past experience or strong interest in generative AI You have played a key role in maintaining and scaling reliable web apps. You are a hard worker and thrive working in a small and accountable team You are eager to take responsibility for shaping the infrastructure of a rapidly growing development tool.
#J-18808-Ljbffr
LiteLLM is an
open-source LLM Gateway with 28K+ stars on GitHub
and trusted by companies like
NASA, Rocket Money, Samsara, Lemonade, and Adobe.
Were rapidly expanding and seeking a founding full-stack engineer to help scale the platform. Were based in San Francisco. What is LiteLLM
LiteLLM provides an
open source Python SDK and Python FastAPI Server that allows calling 100+ LLM APIs (Bedrock, Azure, OpenAI, VertexAI, Cohere, Anthropic) in the OpenAI format We just hit
$2.5M ARR
and have raised a
$1.6M seed round from Y Combinator, Gravity Fund and Pioneer Fund.
You can find more information on our website, Github and Technical Documentation. Why do companies use LiteLLM enterprise Companies use LiteLLM Enterprise once they put LiteLLM into production and need enterprise features like Prometheus metrics (production monitoring) and need to give LLM access to a large number of people with SSO (secure sign on) or JWT (JSON Web Tokens) What you will be working on
Skills:
Next.js, Python, TypeScript, User discovery LiteLLM exposes a developer portal, used by admins to grant access to 1k+ developers within their organizations. You will be responsible for: Making sure the UI is stable, and responsive Adding or improving existing management endpoints to support UI functionality (e.g. writing performant endpoints for viewing daily usage) Simplifying UI/UX flows (requires talking to users, understanding whats confusing and working to simplify it) to support new user onboarding This is a high impact role. You will be working closely with our CEO and CTO. What is our tech stack
Backend built on Python, FastAPI. Frontend on Next.js + Typescript + TailwindCSS Who we are looking for
You have 1-2 years of experience in frontend or full-stack development and have worked on production grade critical systems You are excited about open source software. You want to talk to our users to understand why they use us and what they require. Experience integrating with / writing backend APIs in Python Knowledge of automated UI testing frameworks Past experience or strong interest in generative AI You have played a key role in maintaining and scaling reliable web apps. You are a hard worker and thrive working in a small and accountable team You are eager to take responsibility for shaping the infrastructure of a rapidly growing development tool.
#J-18808-Ljbffr