Join to apply for the Software Engineer - LLM Training role at CentML
Join to apply for the Software Engineer - LLM Training role at CentML
About Us
We believe AI will fundamentally transform how people live and work. CentML's mission is to massively reduce the cost of developing and deploying ML models so we can enable anyone to harness the power of AI and everyone to benefit from its potential.
About Us
We believe AI will fundamentally transform how people live and work. CentML's mission is to massively reduce the cost of developing and deploying ML models so we can enable anyone to harness the power of AI and everyone to benefit from its potential.
Our founding team is made up of experts in AI, compilers, and ML hardware and has led efforts at companies like Amazon, Google, Microsoft Research, Nvidia, Intel, Qualcomm, and IBM. Our co-founder and CEO, Gennady Pekhimenko, is a world-renowned expert in ML systems who holds multiple academic and industry research awards from Google, Amazon, Facebook, and VMware.
About The Position
We are seeking highly crafted and motivated software engineers to join our team to empower AI practitioners to develop AI models on CentML Platform, productively and affordably. If you have launched multi-node distributed training jobs before and experienced firsthand how painful and cumbersome to get it functional, let alone high-performing, and you wanna be part of the team that derives solutions to address this challenge so that other AI practitioners wouldn’t feel the same pain that you had, please come and join us!
What You’ll Do
- Design and implement highly efficient distributed training systems for large-scale deep learning models
- Optimize parallelism strategies to improve performance and scalability across hundreds or thousands of GPUs
- Develop low-level systems components and algorithms to maximize throughput and minimize memory and compute bottlenecks
- Productionize the training systems onto CentML Platform
- Collaborate with researchers and engineers to productionize cutting-edge model architectures and training techniques
- Contribute to the design of APIs, abstractions and UX that make it easier to scale models while maintaining usability and flexibility
- Profile, debug, and tune performance at the system, model, and hardware levels
- Participate in design discussions, code reviews, and technical planning to ensure the product aligns with business goals
- Stay up to date with the latest advancements in large-scale model training and help translate research into practical, robust systems
- Bachelor’s, Master’s, or PhD’s degree in Computer Science/Engineering, Software Engineering, related field or equivalent working experience
- 3+ years of experience in software development, preferably with Python and C++
- Deep understanding of machine learning pipelines and workflows, distributed systems, parallel computing, and high-performance computing principles
- Hands-on experience with large-scale training of deep learning models using frameworks like PyTorch, Megatron Core, DeepSpeed
- Experience optimizing compute, memory, and communication performance in large model training workflows
- Familiarity with GPU programming, CUDA, NCCL, and performance profiling tools
- Solid grasp of deep learning fundamentals, especially as they relate to transformer-based architectures and training dynamics
- Experience working with cloud platforms (AWS, GCP, or Azure) and containerization tools (Docker, Kubernetes)
- Ability to work closely with both research and engineering teams, translating evolving needs into robust infrastructure
- Excellent problem-solving skills, with the ability to debug complex systems
- A passion for building high-impact tools that push the boundaries of what’s possible with large-scale AI
- Experience building tools or platforms for ML model training or fine-tuning
- Experience building backends (e.g., using FastAPI) and frontend (e.g., using React)
- Experience building and optimizing LLM inference engines (e.g., vLLM, SGLang)
- Exposure to DevOps practices, CI/CD pipelines, and infrastructure as code
- Familiarity with MLOps concepts, including model versioning and serving
- An open and inclusive work environment
- Employee stock options
- Best-in-class medical and dental benefits
- Parental Leave top-up
- Professional development budget
- Flexible vacation time to promote a healthy work-life blend
CentML strives to respect the dignity and independence of people with disabilities and is committed to giving them the same opportunity to succeed as all other employees.
Inclusiveness is core to our culture at CentML, and we strive to ensure you get the most from your interview experience. CentML makes reasonable accommodations for applicants with disabilities. If a reasonable accommodation is needed to participate in the job application or interview process, please reach out to the Talent team.
Seniority level
Seniority level
Not Applicable
Employment type
Employment type
Full-time
Job function
Job function
Engineering and Information TechnologyIndustries
Software Development
Referrals increase your chances of interviewing at CentML by 2x
Sign in to set job alerts for “Software Engineer” roles.
San Francisco, CA $160,000.00-$180,000.00 2 days ago
San Francisco, CA $130,000.00-$238,000.00 2 weeks ago
San Francisco, CA $40,000.00-$70,000.00 2 weeks ago
San Francisco, CA $145,000.00-$230,000.00 2 weeks ago
San Francisco, CA $220,000.00-$350,000.00 2 weeks ago
San Francisco, CA $150,000.00-$230,000.00 2 months ago
San Francisco, CA $150,000.00-$176,000.00 2 months ago
San Francisco, CA $130,000.00-$140,000.00 2 weeks ago
San Francisco, CA $120,000.00-$190,000.00 8 months ago
San Francisco, CA $125,000.00-$175,000.00 3 weeks ago
San Francisco, CA $130,000.00-$240,000.00 2 days ago
Alameda, CA $130,000.00-$160,000.00 3 weeks ago
San Francisco, CA $150,000.00-$283,000.00 2 weeks ago
Software Engineer, Frontend (All Levels)
San Francisco, CA $150,000.00-$220,000.00 2 weeks ago
San Francisco, CA $105,600.00-$198,000.00 4 days ago
San Francisco, CA $130,000.00-$220,000.00 3 days ago
San Francisco, CA $140,000.00-$180,000.00 1 month ago
San Francisco, CA $165,000.00-$165,000.00 2 years ago
San Francisco, CA $140,000.00-$280,000.00 7 months ago
San Francisco, CA $130,000.00-$185,000.00 1 month ago
San Francisco, CA $100,000.00-$200,000.00 1 year ago
San Francisco, CA $120,000.00-$140,000.00 3 days ago
San Francisco, CA $120,000.00-$200,000.00 2 years ago
San Francisco, CA $150,000.00-$250,000.00 9 months ago
San Francisco, CA $130,000.00-$250,000.00 6 days ago
San Francisco, CA $40.00-$40.00 2 days ago
San Francisco, CA $140,000.00-$195,000.00 4 days ago
We’re unlocking community knowledge in a new way. Experts add insights directly into each article, started with the help of AI.
#J-18808-Ljbffr