1X
Join to apply for the
Research Engineer, Reinforcement Learning
role at
1X Join to apply for the
Research Engineer, Reinforcement Learning
role at
1X Target start date: Immediately. Relocation provided.
Since its founding in 2015, 1X has been at the forefront of developing advanced humanoid robots designed for household use. Our mission is to create an abundant supply of labor via safe, intelligent humanoids. At 1X, you’ll own critical projects, tackle unsolved research problems, deliver great products to customers, and be rewarded based on merit and achievement.
We are looking for a Research Engineer in Reinforcement Learning (RL). In this role, you will teach NEO to learn new capabilities via RL algorithms. This enables our robots to be safe and robust in a variety of conditions.
Responsibilities
Full-stack engineering, from data engineering to model architecture design to shipping polished products Train NEO to do a diverse set of manipulation and locomotion tasks. Close the sim2real gap between policies trained in simulation and real. Work with controls, QA, and data collection teams to ship RL policies to the production fleet. Deploy skills trained with RL into home environments Getting general-purpose robots to work in the home is just about the hardest problem one can work on. We are looking for people with the courage to tackle unsolved technical challenges with an intense work ethic. 4+ years of Python programming experience. Strong empirical research abilities and a keen eye for spotting performance bottlenecks in RL training. Experience with tuning reward functions, hyperparameters and exploration strategies to solve complex tasks with deep RL. Experience with authoring environments and benchmarks in simulators like Mujoco, Pybullet, or Isaac Sim.
Nice to have
Advanced degree (MS or PhD) in Computer Science or related field Published RL research in top ML conferences (NeurIPS, CoRL, RSS, ICML, etc.) Have trained real-world quadruped or biped locomotion with RL Robotics and control theory knowledge
Sample Projects
We encourage you to apply even if you do not meet every single qualification. If you have direct experience in solving one of the “sample projects” listed below, please let us know in your cover letter.
Fuse separate RL policies (walking, running, standing up) into a single hybrid policy that smoothly transitions between modes. Speed up the simulator to enable faster training and evaluation. Design and implement infra for re-training models deployed in the real world using offline RL methods. Reduce the amount of “reward engineering” needed to solve long-horizon tasks by formulating general objectives like energy minimization, self-play, and data-driven reward functions.
Compensation
At 1X your work and results will be rewarded with a total rewards package consisting of a base salary, stock options and benefits. Base salary range is $130,000 to $250,000. Your actual salary will be based on your knowledge, skills and experience.
Location Policy
We believe the best work is done when collaborating and therefore require in-person presence in our office locations.
We're excited to get to know you and the prospects of having you on board! Seniority level
Seniority level Not Applicable Employment type
Employment type Full-time Job function
Referrals increase your chances of interviewing at 1X by 2x Sign in to set job alerts for “Research Engineer” roles.
Fremont, CA $147,372.00-$196,497.00 1 day ago R&D Engineer, Detector Design, Model, and Analysis
Palo Alto, CA $120,000.00-$160,000.00 2 weeks ago Mountain View, CA $166,000.00-$244,000.00 2 weeks ago Research Scientist, World Models for Autonomous Vehicles
Research Scientist/Engineer, Mobile Manipulation - Behaviors
Research Scientist, Latent State Inference for World Models
San Francisco Bay Area $99,461.00-$128,329.00 2 weeks ago San Jose, CA $177,400.00-$236,500.00 1 day ago San Jose, CA $190,000.00-$320,000.00 3 weeks ago Redwood City, CA $127,000.00-$142,000.00 14 hours ago Sunnyvale, CA $139,000.00-$229,000.00 1 day ago Fremont, CA $70,000.00-$110,000.00 2 weeks ago San Jose, CA $142,700.00-$257,600.00 2 weeks ago Fremont, CA $110,000.00-$115,000.00 2 weeks ago Mechanical Engineer (New Grad / Entry Level)
Research Scientist (L5) - Globalization - Multimodal LLM
Redwood City, CA $142,000.00-$176,000.00 14 hours ago Sunnyvale, CA $213,000.00-$293,000.00 1 week ago Research Scientist (AI) – Biomedical Imaging
Research Scientist, World Models – Policy Training and Evaluation
Palo Alto, CA $100,000.00-$200,000.00 15 hours ago Hayward, CA $125,000.00-$150,000.00 1 week ago Mountain View, CA $138,225.00-$207,575.00 1 week ago Sunnyvale, CA $165,000.00-$180,000.00 5 days ago We’re unlocking community knowledge in a new way. Experts add insights directly into each article, started with the help of AI.
#J-18808-Ljbffr
Research Engineer, Reinforcement Learning
role at
1X Join to apply for the
Research Engineer, Reinforcement Learning
role at
1X Target start date: Immediately. Relocation provided.
Since its founding in 2015, 1X has been at the forefront of developing advanced humanoid robots designed for household use. Our mission is to create an abundant supply of labor via safe, intelligent humanoids. At 1X, you’ll own critical projects, tackle unsolved research problems, deliver great products to customers, and be rewarded based on merit and achievement.
We are looking for a Research Engineer in Reinforcement Learning (RL). In this role, you will teach NEO to learn new capabilities via RL algorithms. This enables our robots to be safe and robust in a variety of conditions.
Responsibilities
Full-stack engineering, from data engineering to model architecture design to shipping polished products Train NEO to do a diverse set of manipulation and locomotion tasks. Close the sim2real gap between policies trained in simulation and real. Work with controls, QA, and data collection teams to ship RL policies to the production fleet. Deploy skills trained with RL into home environments Getting general-purpose robots to work in the home is just about the hardest problem one can work on. We are looking for people with the courage to tackle unsolved technical challenges with an intense work ethic. 4+ years of Python programming experience. Strong empirical research abilities and a keen eye for spotting performance bottlenecks in RL training. Experience with tuning reward functions, hyperparameters and exploration strategies to solve complex tasks with deep RL. Experience with authoring environments and benchmarks in simulators like Mujoco, Pybullet, or Isaac Sim.
Nice to have
Advanced degree (MS or PhD) in Computer Science or related field Published RL research in top ML conferences (NeurIPS, CoRL, RSS, ICML, etc.) Have trained real-world quadruped or biped locomotion with RL Robotics and control theory knowledge
Sample Projects
We encourage you to apply even if you do not meet every single qualification. If you have direct experience in solving one of the “sample projects” listed below, please let us know in your cover letter.
Fuse separate RL policies (walking, running, standing up) into a single hybrid policy that smoothly transitions between modes. Speed up the simulator to enable faster training and evaluation. Design and implement infra for re-training models deployed in the real world using offline RL methods. Reduce the amount of “reward engineering” needed to solve long-horizon tasks by formulating general objectives like energy minimization, self-play, and data-driven reward functions.
Compensation
At 1X your work and results will be rewarded with a total rewards package consisting of a base salary, stock options and benefits. Base salary range is $130,000 to $250,000. Your actual salary will be based on your knowledge, skills and experience.
Location Policy
We believe the best work is done when collaborating and therefore require in-person presence in our office locations.
We're excited to get to know you and the prospects of having you on board! Seniority level
Seniority level Not Applicable Employment type
Employment type Full-time Job function
Referrals increase your chances of interviewing at 1X by 2x Sign in to set job alerts for “Research Engineer” roles.
Fremont, CA $147,372.00-$196,497.00 1 day ago R&D Engineer, Detector Design, Model, and Analysis
Palo Alto, CA $120,000.00-$160,000.00 2 weeks ago Mountain View, CA $166,000.00-$244,000.00 2 weeks ago Research Scientist, World Models for Autonomous Vehicles
Research Scientist/Engineer, Mobile Manipulation - Behaviors
Research Scientist, Latent State Inference for World Models
San Francisco Bay Area $99,461.00-$128,329.00 2 weeks ago San Jose, CA $177,400.00-$236,500.00 1 day ago San Jose, CA $190,000.00-$320,000.00 3 weeks ago Redwood City, CA $127,000.00-$142,000.00 14 hours ago Sunnyvale, CA $139,000.00-$229,000.00 1 day ago Fremont, CA $70,000.00-$110,000.00 2 weeks ago San Jose, CA $142,700.00-$257,600.00 2 weeks ago Fremont, CA $110,000.00-$115,000.00 2 weeks ago Mechanical Engineer (New Grad / Entry Level)
Research Scientist (L5) - Globalization - Multimodal LLM
Redwood City, CA $142,000.00-$176,000.00 14 hours ago Sunnyvale, CA $213,000.00-$293,000.00 1 week ago Research Scientist (AI) – Biomedical Imaging
Research Scientist, World Models – Policy Training and Evaluation
Palo Alto, CA $100,000.00-$200,000.00 15 hours ago Hayward, CA $125,000.00-$150,000.00 1 week ago Mountain View, CA $138,225.00-$207,575.00 1 week ago Sunnyvale, CA $165,000.00-$180,000.00 5 days ago We’re unlocking community knowledge in a new way. Experts add insights directly into each article, started with the help of AI.
#J-18808-Ljbffr