William and William Recruiting
Backend Engineer - Distributed Systems (Austin)
William and William Recruiting, Austin, Texas, us, 78716
My client is building large-scale simulation infrastructure for autonomous systems. Their platform runs thousands of distributed simulation jobs daily, enabling ML and autonomy teams to validate system behavior at a scale impossible to achieve on the road alone.
What Makes This Interesting You'll solve problems like orchestrating 10,000 parallel simulations without data access bottlenecks, designing storage systems that support efficient querying of billions of simulation events, and building infrastructure that scales elastically while managing costs.
Tight feedback loopsyour work directly impacts development velocity across autonomy, ML, and safety teams who depend on this infrastructure daily.
The Role Architect backend services that orchestrate simulation workloads across cloud compute clusters. Design data pipelines, build event-driven microservices, and create infrastructure that enables engineers to run massive experiments with high reliability and throughput.
Technical Stack Python (primary), Java, or Go AWS (S3, EKS), Kafka, Redis, Postgres Terraform, Docker, Kubernetes Handling thousands of concurrent jobs, petabytes of scenario data
Core Responsibilities Build backend services for job orchestration and resource management at scale Design storage and retrieval systems for simulation data Implement event-driven pipelines using distributed messaging Define infrastructure as code for automated deployment and scaling Collaborate with simulation and ML engineers on integration and performance
Requirements 3+ years building backend services in production Strong proficiency in Python, Java, or Go Deep experience with distributed systems and cloud-native architecture Hands-on expertise with AWS, Kubernetes, Kafka, and IaC tools Ability to make engineering trade-offs in fast-moving environments
What Makes This Interesting You'll solve problems like orchestrating 10,000 parallel simulations without data access bottlenecks, designing storage systems that support efficient querying of billions of simulation events, and building infrastructure that scales elastically while managing costs.
Tight feedback loopsyour work directly impacts development velocity across autonomy, ML, and safety teams who depend on this infrastructure daily.
The Role Architect backend services that orchestrate simulation workloads across cloud compute clusters. Design data pipelines, build event-driven microservices, and create infrastructure that enables engineers to run massive experiments with high reliability and throughput.
Technical Stack Python (primary), Java, or Go AWS (S3, EKS), Kafka, Redis, Postgres Terraform, Docker, Kubernetes Handling thousands of concurrent jobs, petabytes of scenario data
Core Responsibilities Build backend services for job orchestration and resource management at scale Design storage and retrieval systems for simulation data Implement event-driven pipelines using distributed messaging Define infrastructure as code for automated deployment and scaling Collaborate with simulation and ML engineers on integration and performance
Requirements 3+ years building backend services in production Strong proficiency in Python, Java, or Go Deep experience with distributed systems and cloud-native architecture Hands-on expertise with AWS, Kubernetes, Kafka, and IaC tools Ability to make engineering trade-offs in fast-moving environments