Avride
Technical Lead - Data Processing Infrastructure / Data Platform
Avride, Austin, Texas, us, 78716
Technical Lead - Data Processing Infrastructure / Data Platform
Join to apply for the
Technical Lead - Data Processing Infrastructure / Data Platform
role at
Avride Technical Lead - Data Processing Infrastructure / Data Platform
3 days ago Be among the first 25 applicants Join to apply for the
Technical Lead - Data Processing Infrastructure / Data Platform
role at
Avride Get AI-powered advice on this job and more exclusive features. About The Team
Our team handles the collection, storage, and processing of large datasets from autonomous vehicles and delivery robots. This includes sensor data from cameras, lidars, radars, and other sensors. Scaling reliable storage and providing efficient compute tools is essential for teams working with this data, including ML, simulation, and algorithm development teams. Our data processing involves specialized algorithms similar to those running directly on autonomous vehicles. About The Team
Our team handles the collection, storage, and processing of large datasets from autonomous vehicles and delivery robots. This includes sensor data from cameras, lidars, radars, and other sensors. Scaling reliable storage and providing efficient compute tools is essential for teams working with this data, including ML, simulation, and algorithm development teams. Our data processing involves specialized algorithms similar to those running directly on autonomous vehicles.
About The Role
We are looking for a Technical Lead to define and build a scalable, user-friendly compute platform for Simulation and ML teams (Perception, Prediction, Planner). You will set the strategic vision for data processing infrastructure, ensuring its scalability, robustness, and alignment with team requirements. You'll make key decisions, prototype solutions, write code, improve frameworks, and provide clear documentation and examples to support adoption.
What You'll Do
Closely collaborate with internal teams (Simulation and ML, including Perception, Prediction, and Planner) to deeply understand their requirements and use cases. Evaluate, integrate, and enhance open-source (Apache Spark, Ray, Apache Beam, Argo) and internal tools. Prototype, develop, and refine scalable compute solutions by writing code and validating them in practical scenarios. Lead and coordinate infrastructure engineering teams. Define and communicate the technical vision clearly, providing mentorship and creating documentation to support platform adoption.
What You'll Need
Strong proficiency in Python (required); C++ experience is highly desirable. Hands-on experience with distributed computing frameworks (Apache Spark, Ray, Apache Beam, Apache Airflow, Argo Workflows, Kubernetes). Proven leadership in architecture design and development of data processing infrastructures. Excellent communication and collaboration skills.
Nice to Have
Understanding of ML/AI and experience building ML pipelines. Experience with sensor data (camera, lidar, radar) from autonomous vehicles or robotics. Experience optimizing costs and performance of distributed computing systems.
Candidates are required to be authorized to work in the U.S. The employer is not offering relocation sponsorship, and remote work options are not available.
Seniority level
Seniority level
Not Applicable Employment type
Employment type
Full-time Job function
Industries
Software Development Referrals increase your chances of interviewing at Avride by 2x Sign in to set job alerts for Data Processing Technician roles.
Austin, TX $130,000.00-$140,000.00 1 week ago Software and Documentation Engineer (Remote)
Austin, TX $83,200.00-$156,000.00 1 month ago Don't See the Right Engineering Role? Let's Stay in Touch.
Austin, Texas Metropolitan Area 1 month ago Austin, TX $155,250.00-$174,273.00 1 month ago Austin, TX $92,000.00-$122,000.00 1 month ago Technical Application Specialist | Kinetic
Austin, TX $50,000.00-$130,000.00 1 week ago ETL & Data Quality Engineer (Informatica + Matillion)
ETL & Data Quality Engineer (Informatica + Matillion)
Austin, TX $120,000.00-$150,000.00 6 days ago Entry Level Software Engineer, application via RippleMatch
Austin, TX $116,480.00-$158,080.00 2 weeks ago Austin, TX $115,000.00-$141,000.00 2 weeks ago Austin, TX $150,000.00-$220,000.00 2 weeks ago ETL & Data Quality Engineer (Informatica + Matillion)
ETL & Data Quality Engineer (Informatica + Matillion)
ETL & Data Quality Engineer (Informatica + Matillion)
Were unlocking community knowledge in a new way. Experts add insights directly into each article, started with the help of AI. #J-18808-Ljbffr
Join to apply for the
Technical Lead - Data Processing Infrastructure / Data Platform
role at
Avride Technical Lead - Data Processing Infrastructure / Data Platform
3 days ago Be among the first 25 applicants Join to apply for the
Technical Lead - Data Processing Infrastructure / Data Platform
role at
Avride Get AI-powered advice on this job and more exclusive features. About The Team
Our team handles the collection, storage, and processing of large datasets from autonomous vehicles and delivery robots. This includes sensor data from cameras, lidars, radars, and other sensors. Scaling reliable storage and providing efficient compute tools is essential for teams working with this data, including ML, simulation, and algorithm development teams. Our data processing involves specialized algorithms similar to those running directly on autonomous vehicles. About The Team
Our team handles the collection, storage, and processing of large datasets from autonomous vehicles and delivery robots. This includes sensor data from cameras, lidars, radars, and other sensors. Scaling reliable storage and providing efficient compute tools is essential for teams working with this data, including ML, simulation, and algorithm development teams. Our data processing involves specialized algorithms similar to those running directly on autonomous vehicles.
About The Role
We are looking for a Technical Lead to define and build a scalable, user-friendly compute platform for Simulation and ML teams (Perception, Prediction, Planner). You will set the strategic vision for data processing infrastructure, ensuring its scalability, robustness, and alignment with team requirements. You'll make key decisions, prototype solutions, write code, improve frameworks, and provide clear documentation and examples to support adoption.
What You'll Do
Closely collaborate with internal teams (Simulation and ML, including Perception, Prediction, and Planner) to deeply understand their requirements and use cases. Evaluate, integrate, and enhance open-source (Apache Spark, Ray, Apache Beam, Argo) and internal tools. Prototype, develop, and refine scalable compute solutions by writing code and validating them in practical scenarios. Lead and coordinate infrastructure engineering teams. Define and communicate the technical vision clearly, providing mentorship and creating documentation to support platform adoption.
What You'll Need
Strong proficiency in Python (required); C++ experience is highly desirable. Hands-on experience with distributed computing frameworks (Apache Spark, Ray, Apache Beam, Apache Airflow, Argo Workflows, Kubernetes). Proven leadership in architecture design and development of data processing infrastructures. Excellent communication and collaboration skills.
Nice to Have
Understanding of ML/AI and experience building ML pipelines. Experience with sensor data (camera, lidar, radar) from autonomous vehicles or robotics. Experience optimizing costs and performance of distributed computing systems.
Candidates are required to be authorized to work in the U.S. The employer is not offering relocation sponsorship, and remote work options are not available.
Seniority level
Seniority level
Not Applicable Employment type
Employment type
Full-time Job function
Industries
Software Development Referrals increase your chances of interviewing at Avride by 2x Sign in to set job alerts for Data Processing Technician roles.
Austin, TX $130,000.00-$140,000.00 1 week ago Software and Documentation Engineer (Remote)
Austin, TX $83,200.00-$156,000.00 1 month ago Don't See the Right Engineering Role? Let's Stay in Touch.
Austin, Texas Metropolitan Area 1 month ago Austin, TX $155,250.00-$174,273.00 1 month ago Austin, TX $92,000.00-$122,000.00 1 month ago Technical Application Specialist | Kinetic
Austin, TX $50,000.00-$130,000.00 1 week ago ETL & Data Quality Engineer (Informatica + Matillion)
ETL & Data Quality Engineer (Informatica + Matillion)
Austin, TX $120,000.00-$150,000.00 6 days ago Entry Level Software Engineer, application via RippleMatch
Austin, TX $116,480.00-$158,080.00 2 weeks ago Austin, TX $115,000.00-$141,000.00 2 weeks ago Austin, TX $150,000.00-$220,000.00 2 weeks ago ETL & Data Quality Engineer (Informatica + Matillion)
ETL & Data Quality Engineer (Informatica + Matillion)
ETL & Data Quality Engineer (Informatica + Matillion)
Were unlocking community knowledge in a new way. Experts add insights directly into each article, started with the help of AI. #J-18808-Ljbffr