Get new jobs for this search by email

Join to apply for the ML Model Serving Engineer role at Sesame Join to apply for the ML Model Serving Engineer role at Sesame This range is provided by Sesame. Your actual pay will be based on your skills and experience — talk with your recruiter to learn more. Base pay range $175,000.00/yr - $280,000.00/yr About Sesame Sesame believes in a future where computers are lifelike - with the ability to see, hear, and collaborate with us in ways that feel natural and human. With this vision, we're designing a new kind of computer, focused on making voice companions part of our daily lives. Our team brings together founders from Oculus and Ubiquity6, alongside proven leaders from Meta, Google, and Apple, with deep expertise spanning hardware and software. Join us in shaping a future where computers truly come alive. Responsibilities Turbocharge our serving layer, consisting of a variety of LLM, speech, and vision models. Partner with ML infrastructure and training engineers to build a fast, cost-effective, accurate, and reliable serving layer to power a new consumer product category. Modify and extend LLM serving frameworks like VLLM and SGLang to take advantage of the latest techniques in high-performance model serving. Experiment with new compilers to support running models on a variety of hardware compute platforms. Work with the training team to identify opportunities to produce faster models without sacrificing quality. Use techniques like in-flight batching, caching, and custom kernels to speed up inference. Find ways to reduce model initialization times without sacrificing quality. Required Qualifications Expert in some differentiable array computing framework, preferably PyTorch. Expert in optimizing machine learning models for serving reliably at high throughput, with low latency. Significant systems programming experience; ex. Experience working on high-performance server systems—you’d be just as comfortable with the internals of VLLM as you would with a complex PyTorch codebase. Significant performance engineering experience; ex. Bottleneck analysis in high-scale server systems or profiling low-level systems code. Always up to date on the latest techniques for model serving optimization. Preferred Qualifications Familiarity with high-performance LLM serving; ex. experience with VLLM, SGlang deployment, and internals. Experience with a public cloud platform such as GCP, AWS, or Azure. Experience deploying and scaling inference workloads in the cloud using Kubernetes, Ray, etc. You like to ship and have a track record of leading complex multi-month projects without assistance. You’re excited to learn new things and work in a multitude of roles. Sesame is committed to a workplace where everyone feels valued, respected, and empowered. We welcome all qualified applicants, embracing diversity in race, gender, identity, orientation, ability, and more. We provide reasonable accommodations for applicants with disabilities—contact for assistance. Full-time Employee Benefits 401k matching 100% employer-paid health, vision, and dental benefits Unlimited PTO and sick time Flexible spending account matching (medical FSA) Benefits do not apply to contingent/contract workers Compensation Range: $175K - $280K Seniority level Seniority level Mid-Senior level Employment type Employment type Full-time Job function Job function General Business, Management, and Business Development Industries Computers and Electronics Manufacturing Referrals increase your chances of interviewing at Sesame by 2x Get notified about new Model jobs in San Francisco, CA . San Francisco, CA $18.07-$22.00 1 month ago Entrepreneur in Residence (Future CEO / Founder) - San Francisco, CA OPEN POSITIONS AT AMMOBIA (SAN FRANCISCO, CALIFORNIA) Staff Software Engineer, AI/ML Recommendations, Rankings, Predictions, YouTube San Francisco, CA $130,000.00-$140,000.00 2 weeks ago San Francisco, CA $125,000.00-$175,000.00 3 weeks ago Don't see a role you're looking for? Please submit your resume for future consideration San Francisco, CA $68,640.00-$75,000.00 1 month ago San Francisco, CA $140,000.00-$175,000.00 5 months ago San Francisco, CA $245,000.00-$310,000.00 2 weeks ago San Francisco, CA $157,600.00-$276,100.00 2 weeks ago Cook - Camp Mather 2025 (Outside of San Francisco) - Rec & Parks (2654) San Francisco, CA $36.95-$36.95 6 days ago AI Tutor, Mathematics Specialist (contract), Handshake AI San Francisco, CA $95,000.00-$150,000.00 5 days ago Senior Staff Software Engineer, Gemini Code Assist San Francisco, CA $248,000.00-$349,000.00 2 days ago San Francisco, CA $150,000.00-$180,000.00 3 days ago San Francisco, CA $146,000.00-$173,000.00 2 weeks ago AI Tutor, Mechanical Engineering Specialist (contract), Handshake AI San Francisco, CA $130,000.00-$140,000.00 2 days ago AI Tutor, Finance Specialist (contract), Handshake AI Research Associate - AI (Eastern Standard Time) San Francisco, CA $24.00-$27.00 1 month ago We’re unlocking community knowledge in a new way. Experts add insights directly into each article, started with the help of AI. #J-18808-Ljbffr