xAI
Member of Technical Staff, Pre-training Scaling
xAI, Palo Alto, California, United States, 94306
Member of Technical Staff, Pre-training Scaling
xAI’s mission is to create AI systems that can accurately understand the universe and aid humanity in its pursuit of knowledge. Our team is small, highly motivated, and focused on engineering excellence. The organization values challenge, curiosity, and a flat structure where all employees are hands‑on and contribute directly to the mission. Leadership is earned through initiative and consistent delivery. Strong prioritization, work ethic, communication, and the ability to share knowledge succinctly are required.
Tech Stack
Python
JAX and XLA
Rust / C++
Spark
Focus
Training trillion‑parameter neural networks at scale, as well as a variety of smaller specialized models.
Rapidly implementing the latest state‑of‑the‑art methods from the deep learning literature.
Innovating new ideas for pre‑training and new scaling paradigms.
Ideal Experience
Strong engineering skills with a passion for model‑hardware co‑design.
Expertise in ML and large‑model scaling, familiar with all kinds of scaling laws.
Experience with distributed training, multi‑GPU neural network training, and optimizing ML training efficiency.
Location The role is based in the Bay Area (San Francisco and Palo Alto). Candidates are expected to be located near the Bay Area or be open to relocation.
Annual Salary Range $180,000 - $440,000 USD
Benefits Base salary is just one part of our total rewards package at xAI, which also includes equity, comprehensive medical, vision, and dental coverage, access to a 401(k) retirement plan, short‑ and long‑term disability insurance, life insurance, and various other discounts and perks.
Equal Employment Opportunity xAI is an equal opportunity employer.
California Consumer Privacy Act (CCPA) Notice
#J-18808-Ljbffr
Tech Stack
Python
JAX and XLA
Rust / C++
Spark
Focus
Training trillion‑parameter neural networks at scale, as well as a variety of smaller specialized models.
Rapidly implementing the latest state‑of‑the‑art methods from the deep learning literature.
Innovating new ideas for pre‑training and new scaling paradigms.
Ideal Experience
Strong engineering skills with a passion for model‑hardware co‑design.
Expertise in ML and large‑model scaling, familiar with all kinds of scaling laws.
Experience with distributed training, multi‑GPU neural network training, and optimizing ML training efficiency.
Location The role is based in the Bay Area (San Francisco and Palo Alto). Candidates are expected to be located near the Bay Area or be open to relocation.
Annual Salary Range $180,000 - $440,000 USD
Benefits Base salary is just one part of our total rewards package at xAI, which also includes equity, comprehensive medical, vision, and dental coverage, access to a 401(k) retirement plan, short‑ and long‑term disability insurance, life insurance, and various other discounts and perks.
Equal Employment Opportunity xAI is an equal opportunity employer.
California Consumer Privacy Act (CCPA) Notice
#J-18808-Ljbffr