Job Title: Senior Software Engineer - Data Infrastructure
Position Type: Full-time
Location: Palo Alto, CA, USA
Salary Range: $160,000 - $250,000 (USD)
Job ID#: 154238
Job Description:
We are seeking experienced Backend Data Engineers to develop efficient, resilient systems and pipelines for large-scale data processing. Join Luma’s applied research team to work on mission-critical projects utilizing thousands of GPUs.
Responsibilities:
- Design, build, and automate data processing infrastructure across multiple GPU clusters.
- Collaborate with researchers to define and implement technical data requirements, optimizing distributed data loading for model training.
- Coordinate with cross-functional teams to meet diverse backend engineering needs.
- Develop high-performance infrastructure to manage and utilize large datasets for training models.
Requirements:
- Proficient in Python programming.
- Minimum of 5 years of engineering experience, including at least 2 years working with petabyte-scale data processing.
- Experience designing large-scale systems that process and serve petabytes of data.
- Deep knowledge of Kubernetes, SLURM, Ray, and other cluster orchestration tools.
- Experience working with visual data.
- Experience collaborating closely with machine learning teams is a strong plus.
About Us:
Founded in 2009, IntelliPro is a global leader in talent acquisition and HR solutions, operating in over 160 countries. We are committed to diversity, inclusivity, and providing rewarding employment opportunities. Learn more at .
Compensation:
The offered salary will depend on various factors, including education, experience, location, and certifications. We also provide a comprehensive benefits package, subject to eligibility.
#J-18808-Ljbffr