AI Fund
Senior Software Engineer - Model Training
AI Fund, San Francisco, California, United States, 94199
Senior Software Engineer - Model Training
Join to apply for the
Senior Software Engineer - Model Training
role at
AI Fund Senior Software Engineer - Model Training
1 day ago Be among the first 25 applicants Join to apply for the
Senior Software Engineer - Model Training
role at
AI Fund About Baseten
Baseten provides the infrastructure, tooling, and expertise needed to bring great AI products to market - fast. Backed by top investors including About Baseten
Baseten provides the infrastructure, tooling, and expertise needed to bring great AI products to market - fast. Backed by top investors including
THE ROLE
As a Senior Software Engineer – Model Training at Baseten, you’ll be at the forefront of building the infrastructure that powers large-scale training and fine-tuning of foundation models. You’ll design and implement distributed training systems, optimize GPU utilization, and create scalable pipelines that enable Baseten and our customers to adapt models efficiently and reliably. This role is highly technical and hands-on: you’ll own key components of our training stack, collaborate with product and infra teams to surface customer needs, and push forward the state of the art in scalable training infrastructure.
Responsibilities
Design, build, and maintain distributed training infrastructure for large-scale foundation models Implement scalable pipelines for fine-tuning and training across heterogeneous GPU/accelerator clusters Optimize training performance through techniques like FSDP, DDP, ZeRO, and mixed precision training Contribute to frameworks and tooling that make training workflows efficient, reproducible, and developer-friendly Collaborate with cross-functional teams (Product, Forward Deployed Engineering, Inference Infra) to ensure training systems meet real-world requirements Research and apply emerging techniques in training efficiency and model adaptation, and productionize them in the Baseten platform Participate in code reviews, system design discussions, and technical deep dives to maintain a high engineering bar
Requirements
Bachelor’s degree in Computer Science, Engineering, or related field, or equivalent experience 4+ years of experience in software engineering with a focus on ML infrastructure, distributed systems, or ML platform engineering Hands-on expertise in distributed training frameworks (FSDP, DDP, ZeRO, or similar) and ML frameworks (PyTorch, Transformers, Lightning, TRL) Strong understanding of GPU/accelerator performance optimization and scaling techniques Experience designing and operating large-scale systems in production (cloud-native preferred) Excellent problem-solving and communication skills, with the ability to work across infrastructure and ML boundaries
NICE TO HAVE
Experience building APIs, SDKs, or developer tools for ML workflows Familiarity with cluster management and scheduling (Kubernetes, Ray, Slurm, etc.) Knowledge of parameter-efficient fine-tuning methods (LoRA, QLoRA) and evaluation pipelines Contributions to open-source distributed training or ML infra projects Experience with cloud environments (AWS, GCP, Azure) and container orchestration
Benefits
Competitive compensation package. This is a unique opportunity to be part of a rapidly growing startup in one of the most exciting engineering fields of our era. An inclusive and supportive work culture that fosters learning and growth. Exposure to a variety of ML startups, offering unparalleled learning and networking opportunities.
Apply now
to embark on a rewarding journey in shaping the future of AI! If you are a motivated individual with a passion for machine learning and a desire to be part of a collaborative and forward-thinking team, we would love to hear from you.
At Baseten, we are committed to fostering a diverse and inclusive workplace. We provide equal employment opportunities to all employees and applicants without regard to race, color, religion, gender, sexual orientation, gender identity or expression, national origin, age, genetic information, disability, or veteran status. Seniority level
Seniority level Mid-Senior level Employment type
Employment type Full-time Job function
Job function Engineering and Information Technology Industries Venture Capital and Private Equity Principals Referrals increase your chances of interviewing at AI Fund by 2x Get notified about new Senior Software Engineer jobs in
San Francisco, CA . San Mateo, CA $90,000.00-$150,000.00 1 year ago Director of Engineering, Product Engineering
Oakland, CA $241,000.00-$305,000.00 2 weeks ago San Francisco, CA $200,000.00-$230,000.00 1 month ago San Francisco, CA $159,000.00-$278,250.00 2 weeks ago Senior Software Engineer: Product Growth
San Francisco, CA $138,900.00-$203,900.00 1 month ago San Francisco, CA $156,000.00-$211,000.00 2 weeks ago Senior Software Engineer, Benefits - Employer Experience
Senior Software Engineer, Workspaces - Weights & Biases
San Francisco, CA $165,000.00-$220,000.00 3 days ago Senior Engineer - Warehouse Management System
Brisbane, CA $140,000.00-$180,000.00 2 months ago Senior Robotics Software Engineer, Planning and Control
San Francisco, CA $150,000.00-$260,000.00 2 months ago Principal Software Engineer - Video - Design Experience - (Role based in Australia, relocation provided)
San Francisco, CA $135,000.00-$175,000.00 14 hours ago Senior/Staff Motor Control Software Engineer
Senior UX Researcher, Developer User Experience
San Francisco, CA $151,000.00-$222,000.00 2 weeks ago Intermediate or Senior Civil Engineer – Land Development (Commercial) - Houston, TX
San Francisco, CA $75,000.00-$150,000.00 2 months ago Senior Technical Writer, Developer Experience
San Francisco, CA $140,000.00-$210,000.00 2 weeks ago SENIOR CIVIL ENGINEER - TEAM LEAD - LAND DEVELOPMENT - HOUSTON TX
San Francisco, CA $122,478.00-$208,212.00 2 days ago Delivery Consultant - Cloud Infrastructure, Cloud Platform and Migrations, AWS Professional Services
San Francisco, CA $118,200.00-$204,300.00 2 weeks ago Delivery Consultant - Cloud Infrastructure, Cloud Platform and Migrations, AWS Professional Services
San Francisco, CA $118,200.00-$204,300.00 2 weeks ago Delivery Consultant - Cloud Infrastructure, Cloud Platform and Migrations, AWS Professional Services
San Francisco, CA $118,200.00-$204,300.00 2 weeks ago Senior Product Manager - AI Developer Tools & SDK
Oakland, CA $211,200.00-$264,000.00 3 days ago Delivery Consultant - Connect, Amazon Connect Center of Excellence
San Francisco, CA $118,200.00-$204,300.00 2 days ago San Francisco, CA $122,400.00-$195,500.00 3 days ago San Francisco, CA $125,700.00-$334,600.00 2 weeks ago San Francisco, CA $130,000.00-$200,000.00 10 months ago San Francisco, CA $175,000.00-$230,000.00 6 months ago Senior Software Engineer, Infrastructure
San Francisco, CA $171,000.00-$258,000.00 2 weeks ago San Francisco, CA $165,000.00-$220,000.00 4 months ago San Francisco, CA $180,000.00-$270,000.00 2 weeks ago We’re unlocking community knowledge in a new way. Experts add insights directly into each article, started with the help of AI.
#J-18808-Ljbffr
Join to apply for the
Senior Software Engineer - Model Training
role at
AI Fund Senior Software Engineer - Model Training
1 day ago Be among the first 25 applicants Join to apply for the
Senior Software Engineer - Model Training
role at
AI Fund About Baseten
Baseten provides the infrastructure, tooling, and expertise needed to bring great AI products to market - fast. Backed by top investors including About Baseten
Baseten provides the infrastructure, tooling, and expertise needed to bring great AI products to market - fast. Backed by top investors including
THE ROLE
As a Senior Software Engineer – Model Training at Baseten, you’ll be at the forefront of building the infrastructure that powers large-scale training and fine-tuning of foundation models. You’ll design and implement distributed training systems, optimize GPU utilization, and create scalable pipelines that enable Baseten and our customers to adapt models efficiently and reliably. This role is highly technical and hands-on: you’ll own key components of our training stack, collaborate with product and infra teams to surface customer needs, and push forward the state of the art in scalable training infrastructure.
Responsibilities
Design, build, and maintain distributed training infrastructure for large-scale foundation models Implement scalable pipelines for fine-tuning and training across heterogeneous GPU/accelerator clusters Optimize training performance through techniques like FSDP, DDP, ZeRO, and mixed precision training Contribute to frameworks and tooling that make training workflows efficient, reproducible, and developer-friendly Collaborate with cross-functional teams (Product, Forward Deployed Engineering, Inference Infra) to ensure training systems meet real-world requirements Research and apply emerging techniques in training efficiency and model adaptation, and productionize them in the Baseten platform Participate in code reviews, system design discussions, and technical deep dives to maintain a high engineering bar
Requirements
Bachelor’s degree in Computer Science, Engineering, or related field, or equivalent experience 4+ years of experience in software engineering with a focus on ML infrastructure, distributed systems, or ML platform engineering Hands-on expertise in distributed training frameworks (FSDP, DDP, ZeRO, or similar) and ML frameworks (PyTorch, Transformers, Lightning, TRL) Strong understanding of GPU/accelerator performance optimization and scaling techniques Experience designing and operating large-scale systems in production (cloud-native preferred) Excellent problem-solving and communication skills, with the ability to work across infrastructure and ML boundaries
NICE TO HAVE
Experience building APIs, SDKs, or developer tools for ML workflows Familiarity with cluster management and scheduling (Kubernetes, Ray, Slurm, etc.) Knowledge of parameter-efficient fine-tuning methods (LoRA, QLoRA) and evaluation pipelines Contributions to open-source distributed training or ML infra projects Experience with cloud environments (AWS, GCP, Azure) and container orchestration
Benefits
Competitive compensation package. This is a unique opportunity to be part of a rapidly growing startup in one of the most exciting engineering fields of our era. An inclusive and supportive work culture that fosters learning and growth. Exposure to a variety of ML startups, offering unparalleled learning and networking opportunities.
Apply now
to embark on a rewarding journey in shaping the future of AI! If you are a motivated individual with a passion for machine learning and a desire to be part of a collaborative and forward-thinking team, we would love to hear from you.
At Baseten, we are committed to fostering a diverse and inclusive workplace. We provide equal employment opportunities to all employees and applicants without regard to race, color, religion, gender, sexual orientation, gender identity or expression, national origin, age, genetic information, disability, or veteran status. Seniority level
Seniority level Mid-Senior level Employment type
Employment type Full-time Job function
Job function Engineering and Information Technology Industries Venture Capital and Private Equity Principals Referrals increase your chances of interviewing at AI Fund by 2x Get notified about new Senior Software Engineer jobs in
San Francisco, CA . San Mateo, CA $90,000.00-$150,000.00 1 year ago Director of Engineering, Product Engineering
Oakland, CA $241,000.00-$305,000.00 2 weeks ago San Francisco, CA $200,000.00-$230,000.00 1 month ago San Francisco, CA $159,000.00-$278,250.00 2 weeks ago Senior Software Engineer: Product Growth
San Francisco, CA $138,900.00-$203,900.00 1 month ago San Francisco, CA $156,000.00-$211,000.00 2 weeks ago Senior Software Engineer, Benefits - Employer Experience
Senior Software Engineer, Workspaces - Weights & Biases
San Francisco, CA $165,000.00-$220,000.00 3 days ago Senior Engineer - Warehouse Management System
Brisbane, CA $140,000.00-$180,000.00 2 months ago Senior Robotics Software Engineer, Planning and Control
San Francisco, CA $150,000.00-$260,000.00 2 months ago Principal Software Engineer - Video - Design Experience - (Role based in Australia, relocation provided)
San Francisco, CA $135,000.00-$175,000.00 14 hours ago Senior/Staff Motor Control Software Engineer
Senior UX Researcher, Developer User Experience
San Francisco, CA $151,000.00-$222,000.00 2 weeks ago Intermediate or Senior Civil Engineer – Land Development (Commercial) - Houston, TX
San Francisco, CA $75,000.00-$150,000.00 2 months ago Senior Technical Writer, Developer Experience
San Francisco, CA $140,000.00-$210,000.00 2 weeks ago SENIOR CIVIL ENGINEER - TEAM LEAD - LAND DEVELOPMENT - HOUSTON TX
San Francisco, CA $122,478.00-$208,212.00 2 days ago Delivery Consultant - Cloud Infrastructure, Cloud Platform and Migrations, AWS Professional Services
San Francisco, CA $118,200.00-$204,300.00 2 weeks ago Delivery Consultant - Cloud Infrastructure, Cloud Platform and Migrations, AWS Professional Services
San Francisco, CA $118,200.00-$204,300.00 2 weeks ago Delivery Consultant - Cloud Infrastructure, Cloud Platform and Migrations, AWS Professional Services
San Francisco, CA $118,200.00-$204,300.00 2 weeks ago Senior Product Manager - AI Developer Tools & SDK
Oakland, CA $211,200.00-$264,000.00 3 days ago Delivery Consultant - Connect, Amazon Connect Center of Excellence
San Francisco, CA $118,200.00-$204,300.00 2 days ago San Francisco, CA $122,400.00-$195,500.00 3 days ago San Francisco, CA $125,700.00-$334,600.00 2 weeks ago San Francisco, CA $130,000.00-$200,000.00 10 months ago San Francisco, CA $175,000.00-$230,000.00 6 months ago Senior Software Engineer, Infrastructure
San Francisco, CA $171,000.00-$258,000.00 2 weeks ago San Francisco, CA $165,000.00-$220,000.00 4 months ago San Francisco, CA $180,000.00-$270,000.00 2 weeks ago We’re unlocking community knowledge in a new way. Experts add insights directly into each article, started with the help of AI.
#J-18808-Ljbffr