Tesla
AI Engineer, Multimodal Pre-training, Autonomy & Robotics
Tesla, Palo Alto, California, United States, 94306
Join to apply for the
AI Engineer, Multimodal Pretraining, Autonomy & Robotics
role at
Tesla Join to apply for the
AI Engineer, Multimodal Pretraining, Autonomy & Robotics
role at
Tesla What To Expect
Please read the following job description thoroughly to ensure you are the right fit for this role before applying. Scaling transformers, as well as more recent advances in Reinforcement Learning with Verifiable Rewards (RLVR), has created models with Ph-D level intelligence in a wide variety of subject areas – from Math to Social Sciences. Yet these models continue to struggle in real-world physical reasoning, often struggling to tell left from right.
At Tesla AI, we want to develop Olympiad-level physical intelligence that will enable highly capable robots, both wheeled and legged. These models should be able to anticipate and reason about future movements of any object or scene at the level of a race car driver or professional athlete. To accomplish this, you will have access to petabytes of multimodal (video, audio, action etc.) real-world data from our global fleet of cars and robots, as well as Tesla’s state-of-the-art compute resources.
In this role, you will have the opportunity to work on the datasets, infra, model architecture, eval and scaling laws necessary to pretrain a large multimodal model with an emphasis on real-world physical intelligence.
What You'll Do
Create multimodal pretraining datasets that utilize Tesla’s fleet of robotsDevelop training infra necessary to train large multimodal modelsInvent new architectures for encoding and decoding multimodal inputs and outputsDevelop downstream evaluations that can guide the tuning of these large modelsRun scaling laws for model size, dataset composition etc
What You'll Bring
Proven experience in scaling and optimizing large AI models, with a strong understanding of infrastructure challenges and solutionsProficiency in Python and a deep understanding of software engineering best practicesIn-depth knowledge of deep learning fundamentals, including optimization techniques, loss functions, and neural network architecturesExperience with deep learning frameworks such as PyTorch, TensorFlow, or JAXStrong expertise in distributed computing and parallel processing techniquesDemonstrated ability to work collaboratively in a cross-functional team environmentStrong problem-solving skills and the ability to troubleshoot complex system-level issues
Benefits Compensation and Benefits Along with competitive pay, as a full-time Tesla employee, you are eligible for the following benefits at day 1 of hire: Aetna PPO and HSA plans > 2 medical plan options with $0 payroll deductionFamily-building, fertility, adoption and surrogacy benefitsDental (including orthodontic coverage) and vision plans, both have options with a $0 paycheck contributionCompany Paid (Health Savings Account) HSA Contribution when enrolled in the High Deductible Aetna medical plan with HSAHealthcare and Dependent Care Flexible Spending Accounts (FSA)401(k) with employer match, Employee Stock Purchase Plans, and other financial benefitsCompany paid Basic Life, AD&D, short-term and long-term disability insuranceEmployee Assistance ProgramSick and Vacation time (Flex time for salary positions), and Paid HolidaysBack-up childcare and parenting support resourcesVoluntary benefits to include: critical illness, hospital indemnity, accident insurance, theft & legal services, and pet insuranceWeight Loss and Tobacco Cessation ProgramsTesla Babies programCommuter benefitsEmployee discounts and perks program
Expected Compensation
$140,000 - $420,000/annual salary + cash and stock awards + benefits
Pay offered may vary depending on multiple individualized factors, including market location, job-related knowledge, skills, and experience. The total compensation package for this position may also include other elements dependent on the position offered. Details of participation in these benefit plans will be provided if an employee receives an offer of employment.
, TeslaSeniority level
Seniority levelMid-Senior level Employment type
Employment typeFull-time Job function
Job functionEngineering and Information Technology IndustriesMotor Vehicle Manufacturing, Renewable Energy Semiconductor Manufacturing, and Utilities Referrals increase your chances of interviewing at Tesla by 2x Sign in to set job alerts for “Artificial Intelligence Engineer” roles.Software Engineer, AI Platform - New Grad Mountain View, CA $145,000.00-$170,000.00 1 week ago AI/ML Engineer (Multiple roles and seniority levels) San Jose, CA $137,500.00-$236,500.00 1 week ago San Jose, CA $120,700.00-$228,600.00 1 week ago San Jose, CA $120,700.00-$228,600.00 1 week ago Sunnyvale, CA $167,000.00-$185,500.00 4 weeks ago Software Engineer, Artificial Intelligence Sunnyvale, CA $141,000.00-$202,000.00 1 week ago San Francisco Bay Area $155,000.00-$265,500.00 2 weeks ago Sunnyvale, CA $167,000.00-$185,500.00 1 month ago Sunnyvale, CA $167,000.00-$185,500.00 3 weeks ago San Jose, CA $130,000.00-$200,000.00 4 days ago San Jose, CA $120,700.00-$228,600.00 1 week ago AI Engineer & Researcher - Post-training San Jose, CA $120,000.00-$240,000.00 5 months ago San Jose, CA $137,500.00-$236,500.00 1 month ago Mountain View, CA $152,000.00-$228,000.00 1 week ago San Jose, CA $169,500.00-$291,500.00 1 week ago Machine Learning Engineer, Monetization Engineering San Jose, CA $137,500.00-$236,500.00 3 weeks ago Machine Learning Engineer (I, II, or Sr.) We’re unlocking community knowledge in a new way. Experts add insights directly into each article, started with the help of AI.
#J-18808-Ljbffr
AI Engineer, Multimodal Pretraining, Autonomy & Robotics
role at
Tesla Join to apply for the
AI Engineer, Multimodal Pretraining, Autonomy & Robotics
role at
Tesla What To Expect
Please read the following job description thoroughly to ensure you are the right fit for this role before applying. Scaling transformers, as well as more recent advances in Reinforcement Learning with Verifiable Rewards (RLVR), has created models with Ph-D level intelligence in a wide variety of subject areas – from Math to Social Sciences. Yet these models continue to struggle in real-world physical reasoning, often struggling to tell left from right.
At Tesla AI, we want to develop Olympiad-level physical intelligence that will enable highly capable robots, both wheeled and legged. These models should be able to anticipate and reason about future movements of any object or scene at the level of a race car driver or professional athlete. To accomplish this, you will have access to petabytes of multimodal (video, audio, action etc.) real-world data from our global fleet of cars and robots, as well as Tesla’s state-of-the-art compute resources.
In this role, you will have the opportunity to work on the datasets, infra, model architecture, eval and scaling laws necessary to pretrain a large multimodal model with an emphasis on real-world physical intelligence.
What You'll Do
Create multimodal pretraining datasets that utilize Tesla’s fleet of robotsDevelop training infra necessary to train large multimodal modelsInvent new architectures for encoding and decoding multimodal inputs and outputsDevelop downstream evaluations that can guide the tuning of these large modelsRun scaling laws for model size, dataset composition etc
What You'll Bring
Proven experience in scaling and optimizing large AI models, with a strong understanding of infrastructure challenges and solutionsProficiency in Python and a deep understanding of software engineering best practicesIn-depth knowledge of deep learning fundamentals, including optimization techniques, loss functions, and neural network architecturesExperience with deep learning frameworks such as PyTorch, TensorFlow, or JAXStrong expertise in distributed computing and parallel processing techniquesDemonstrated ability to work collaboratively in a cross-functional team environmentStrong problem-solving skills and the ability to troubleshoot complex system-level issues
Benefits Compensation and Benefits Along with competitive pay, as a full-time Tesla employee, you are eligible for the following benefits at day 1 of hire: Aetna PPO and HSA plans > 2 medical plan options with $0 payroll deductionFamily-building, fertility, adoption and surrogacy benefitsDental (including orthodontic coverage) and vision plans, both have options with a $0 paycheck contributionCompany Paid (Health Savings Account) HSA Contribution when enrolled in the High Deductible Aetna medical plan with HSAHealthcare and Dependent Care Flexible Spending Accounts (FSA)401(k) with employer match, Employee Stock Purchase Plans, and other financial benefitsCompany paid Basic Life, AD&D, short-term and long-term disability insuranceEmployee Assistance ProgramSick and Vacation time (Flex time for salary positions), and Paid HolidaysBack-up childcare and parenting support resourcesVoluntary benefits to include: critical illness, hospital indemnity, accident insurance, theft & legal services, and pet insuranceWeight Loss and Tobacco Cessation ProgramsTesla Babies programCommuter benefitsEmployee discounts and perks program
Expected Compensation
$140,000 - $420,000/annual salary + cash and stock awards + benefits
Pay offered may vary depending on multiple individualized factors, including market location, job-related knowledge, skills, and experience. The total compensation package for this position may also include other elements dependent on the position offered. Details of participation in these benefit plans will be provided if an employee receives an offer of employment.
, TeslaSeniority level
Seniority levelMid-Senior level Employment type
Employment typeFull-time Job function
Job functionEngineering and Information Technology IndustriesMotor Vehicle Manufacturing, Renewable Energy Semiconductor Manufacturing, and Utilities Referrals increase your chances of interviewing at Tesla by 2x Sign in to set job alerts for “Artificial Intelligence Engineer” roles.Software Engineer, AI Platform - New Grad Mountain View, CA $145,000.00-$170,000.00 1 week ago AI/ML Engineer (Multiple roles and seniority levels) San Jose, CA $137,500.00-$236,500.00 1 week ago San Jose, CA $120,700.00-$228,600.00 1 week ago San Jose, CA $120,700.00-$228,600.00 1 week ago Sunnyvale, CA $167,000.00-$185,500.00 4 weeks ago Software Engineer, Artificial Intelligence Sunnyvale, CA $141,000.00-$202,000.00 1 week ago San Francisco Bay Area $155,000.00-$265,500.00 2 weeks ago Sunnyvale, CA $167,000.00-$185,500.00 1 month ago Sunnyvale, CA $167,000.00-$185,500.00 3 weeks ago San Jose, CA $130,000.00-$200,000.00 4 days ago San Jose, CA $120,700.00-$228,600.00 1 week ago AI Engineer & Researcher - Post-training San Jose, CA $120,000.00-$240,000.00 5 months ago San Jose, CA $137,500.00-$236,500.00 1 month ago Mountain View, CA $152,000.00-$228,000.00 1 week ago San Jose, CA $169,500.00-$291,500.00 1 week ago Machine Learning Engineer, Monetization Engineering San Jose, CA $137,500.00-$236,500.00 3 weeks ago Machine Learning Engineer (I, II, or Sr.) We’re unlocking community knowledge in a new way. Experts add insights directly into each article, started with the help of AI.
#J-18808-Ljbffr