Jobright.ai
Senior Software Engineer - Inference Backend
Jobright.ai, San Francisco, California, United States, 94199
Join to apply for the
Senior Software Engineer - Inference Backend
role at
Jobright.ai 3 days ago Be among the first 25 applicants Join to apply for the
Senior Software Engineer - Inference Backend
role at
Jobright.ai Lambda is the #1 GPU Cloud for ML/AI teams, enabling engineers to build, test, and deploy AI products at scale. The Senior Software Engineer - Inference Backend will work on developing a large-scale platform for running AI models and building a high-throughput API system, collaborating with internal ML researchers to enhance inference engines across various mediums. Responsibilities: • Work on our Inference service, helping us to develop our large-scale platform for running new, cutting-edge models across tens of thousands of GPUs • Help build a high-throughput, low-latency API and routing system running at geographically-distributed scale • Work with the team and our internal ML researchers to adopt and improve new inference engines, models and architectures across a variety of different mediums (such as text, image, video and audio) • Shape a highly reliable distributed system with a focus on reducing operational overhead and deep observability and capacity management • Help push Lambda forward into the state of the art, and be part of a team that is operating right at the edge of new developments in the industry. Qualifications: Required: • 5 or more years of experience as a software engineer working on large-scale production services • 1 year or more of experience working with machine learning (inference experience preferred, but other areas are acceptable) • Highly skilled at writing Go or Python • Product-focused engineer, always considering the user and operational costs as you are exploring new • Proven track record of working in an environment with rapid deployment and the ability to stay on top of shifting priorities as the industry rapidly develops • Willingness to take ownership of projects and help drive them forwards through design, implementation, launch, and maintenance. • Some experience running and operating production services handling real-time web/internet traffic Preferred: • Have built ML inference systems at scale • Experience developing large-scale, geographically distributed systems • Intermediate or better skill at writing Rust • Experience developing Kubernetes operators and components Company: Lambda provides infrastructure, cloud services, and software for the training and inferencing of AI models. Founded in 2012, the company is headquartered in San Jose, California, USA, with a team of 201-500 employees. The company is currently Late Stage. Lambda has a track record of offering H1B sponsorships. Seniority level
Seniority level Mid-Senior level Employment type
Employment type Full-time Job function
Industries Software Development Referrals increase your chances of interviewing at Jobright.ai by 2x Inferred from the description for this job
Medical insurance Vision insurance 401(k) Get notified about new Software Engineer jobs in
San Francisco, CA . San Francisco, CA $160,000.00-$180,000.00 2 weeks ago San Francisco, CA $130,000.00-$238,000.00 2 weeks ago San Francisco, CA $150,000.00-$250,000.00 2 weeks ago Full-Stack Software Engineer (Jr/Mid level)
San Francisco, CA $120,000.00-$180,000.00 1 month ago San Francisco, CA $150,000.00-$230,000.00 3 months ago Software Development Engineer I - Frontend & Mobile
San Francisco, CA $150,000.00-$176,000.00 3 months ago San Francisco, CA $120,000.00-$190,000.00 9 months ago San Francisco, CA $57.00-$61.00 2 days ago San Francisco, CA $57.00-$61.00 2 days ago San Francisco, CA $125,000.00-$175,000.00 2 months ago San Francisco, CA $163,200.00-$223,200.00 2 weeks ago Software Engineer, Frontend (All Levels)
San Francisco, CA $150,000.00-$180,000.00 5 days ago Software Engineer, AI Intern (Winter 2026)
San Francisco, CA $57.00-$61.00 2 days ago Software Engineer, AI Intern (Summer 2026)
San Francisco, CA $57.00-$61.00 2 days ago San Francisco, CA $165,000.00-$165,000.00 2 years ago San Francisco, CA $120,000.00-$200,000.00 2 years ago Alameda, CA $130,000.00-$160,000.00 2 months ago San Francisco, CA $140,000.00-$280,000.00 8 months ago We’re unlocking community knowledge in a new way. Experts add insights directly into each article, started with the help of AI.
#J-18808-Ljbffr
Senior Software Engineer - Inference Backend
role at
Jobright.ai 3 days ago Be among the first 25 applicants Join to apply for the
Senior Software Engineer - Inference Backend
role at
Jobright.ai Lambda is the #1 GPU Cloud for ML/AI teams, enabling engineers to build, test, and deploy AI products at scale. The Senior Software Engineer - Inference Backend will work on developing a large-scale platform for running AI models and building a high-throughput API system, collaborating with internal ML researchers to enhance inference engines across various mediums. Responsibilities: • Work on our Inference service, helping us to develop our large-scale platform for running new, cutting-edge models across tens of thousands of GPUs • Help build a high-throughput, low-latency API and routing system running at geographically-distributed scale • Work with the team and our internal ML researchers to adopt and improve new inference engines, models and architectures across a variety of different mediums (such as text, image, video and audio) • Shape a highly reliable distributed system with a focus on reducing operational overhead and deep observability and capacity management • Help push Lambda forward into the state of the art, and be part of a team that is operating right at the edge of new developments in the industry. Qualifications: Required: • 5 or more years of experience as a software engineer working on large-scale production services • 1 year or more of experience working with machine learning (inference experience preferred, but other areas are acceptable) • Highly skilled at writing Go or Python • Product-focused engineer, always considering the user and operational costs as you are exploring new • Proven track record of working in an environment with rapid deployment and the ability to stay on top of shifting priorities as the industry rapidly develops • Willingness to take ownership of projects and help drive them forwards through design, implementation, launch, and maintenance. • Some experience running and operating production services handling real-time web/internet traffic Preferred: • Have built ML inference systems at scale • Experience developing large-scale, geographically distributed systems • Intermediate or better skill at writing Rust • Experience developing Kubernetes operators and components Company: Lambda provides infrastructure, cloud services, and software for the training and inferencing of AI models. Founded in 2012, the company is headquartered in San Jose, California, USA, with a team of 201-500 employees. The company is currently Late Stage. Lambda has a track record of offering H1B sponsorships. Seniority level
Seniority level Mid-Senior level Employment type
Employment type Full-time Job function
Industries Software Development Referrals increase your chances of interviewing at Jobright.ai by 2x Inferred from the description for this job
Medical insurance Vision insurance 401(k) Get notified about new Software Engineer jobs in
San Francisco, CA . San Francisco, CA $160,000.00-$180,000.00 2 weeks ago San Francisco, CA $130,000.00-$238,000.00 2 weeks ago San Francisco, CA $150,000.00-$250,000.00 2 weeks ago Full-Stack Software Engineer (Jr/Mid level)
San Francisco, CA $120,000.00-$180,000.00 1 month ago San Francisco, CA $150,000.00-$230,000.00 3 months ago Software Development Engineer I - Frontend & Mobile
San Francisco, CA $150,000.00-$176,000.00 3 months ago San Francisco, CA $120,000.00-$190,000.00 9 months ago San Francisco, CA $57.00-$61.00 2 days ago San Francisco, CA $57.00-$61.00 2 days ago San Francisco, CA $125,000.00-$175,000.00 2 months ago San Francisco, CA $163,200.00-$223,200.00 2 weeks ago Software Engineer, Frontend (All Levels)
San Francisco, CA $150,000.00-$180,000.00 5 days ago Software Engineer, AI Intern (Winter 2026)
San Francisco, CA $57.00-$61.00 2 days ago Software Engineer, AI Intern (Summer 2026)
San Francisco, CA $57.00-$61.00 2 days ago San Francisco, CA $165,000.00-$165,000.00 2 years ago San Francisco, CA $120,000.00-$200,000.00 2 years ago Alameda, CA $130,000.00-$160,000.00 2 months ago San Francisco, CA $140,000.00-$280,000.00 8 months ago We’re unlocking community knowledge in a new way. Experts add insights directly into each article, started with the help of AI.
#J-18808-Ljbffr