Join to apply for the Lead Cloud Infrastructure Engineer role at Together AI
Join to apply for the Lead Cloud Infrastructure Engineer role at Together AI
Get AI-powered advice on this job and more exclusive features.
About The Role
Together AI is hiring a Lead Cloud Infrastructure Engineer to own and operate the cloud foundation that powers our rapidly scaling data platforms. In this role, you will be the primary engineer responsible for defining, building, and maintaining the AWS infrastructure that underpins data engineering systems across the company — from internal analytics pipelines to customer-facing metering and billing systems.
About The Role
Together AI is hiring a Lead Cloud Infrastructure Engineer to own and operate the cloud foundation that powers our rapidly scaling data platforms. In this role, you will be the primary engineer responsible for defining, building, and maintaining the AWS infrastructure that underpins data engineering systems across the company — from internal analytics pipelines to customer-facing metering and billing systems.
You will work closely with multiple data engineering teams, enabling them to move faster by building reliable, secure-by-default infrastructure they can depend on. You’ll partner with our dedicated security engineering team to ensure best practices around IAM, network design, and data lake access — while focusing on platform reliability, scalability, and developer experience.
This is a high-ownership, hands-on engineering role. You’ll manage everything from Terraform modules and CI/CD pipelines to Lake Formation permissions and observability tools — with a mandate to build infrastructure that just works, and keeps working.
Responsibilities
- Own the design, implementation, and operation of all AWS-based infrastructure supporting data systems
- Build and maintain reproducible, well-documented Terraform infrastructure modules
- Collaborate with multiple data engineering teams to understand and support their infrastructure needs
- Implement and maintain IAM policies and Lake Formation permissions in partnership with the security engineering team
- Build internal tooling and automation to support self-service infra provisioning
- Monitor infrastructure health and cost, and drive continuous improvements in reliability and efficiency
- Serve as the point person for infrastructure questions, issues, and requests across the company’s data platforms
- 5+ years of experience in infrastructure, SRE, or DevOps roles
- Deep experience with Terraform and AWS infrastructure design, including VPCs, IAM, S3, EC2, etc.
- Experience with access control and permissions in AWS, including Lake Formation or similar
- Experience supporting data infrastructure or working alongside data engineering teams (Kafka/Kinesis/ClickHouse a plus)
- Familiarity with CI/CD for infrastructure (GitHub Actions, TeamCity, ArgoCD, etc.)
- Proficiency in scripting or programming (Python, Go, or Bash preferred)
- Comfortable working autonomously and supporting multiple stakeholders
- Bonus: experience with Kubernetes, hybrid cloud/on-prem infrastructure, or cost optimization at scale
Together AI is a research-driven artificial intelligence company. We believe open and transparent AI systems will drive innovation and create the best outcomes for society, and together we are on a mission to significantly lower the cost of modern AI systems by co-designing software, hardware, algorithms, and models. We have contributed to leading open-source research, models, and datasets to advance the frontier of AI, and our team has been behind technological advancement such as FlashAttention, Hyena, FlexGen, and RedPajama. We invite you to join a passionate group of researchers and engineers in our journey in building the next generation AI infrastructure.
Compensation
We offer competitive compensation, startup equity, health insurance and other competitive benefits. The US base salary range for this full-time position is: $160,000 - $240,000 + equity + benefits. Our salary ranges are determined by location, level and role. Individual compensation will be determined by experience, skills, and job-related knowledge.
Equal Opportunity
Together AI is an Equal Opportunity Employer and is proud to offer equal employment opportunity to everyone regardless of race, color, ancestry, religion, sex, national origin, sexual orientation, age, citizenship, marital status, disability, gender identity, veteran status, and more.
Please see our privacy policy at
Seniority level
Seniority level
Mid-Senior level
Employment type
Employment type
Full-time
Job function
Job function
Information TechnologyIndustries
Software Development
Referrals increase your chances of interviewing at Together AI by 2x
Sign in to set job alerts for “Lead Infrastructure Engineer” roles.
San Mateo, CA $133,000.00-$199,600.00 2 weeks ago
Senior Cloud System Administrator / Job Req 788838227
Alameda, CA $142,043.20-$213,075.20 9 hours ago
Senior System Administrator, Infrastructure
San Francisco, CA $132,000.00-$150,000.00 4 days ago
San Mateo, CA $90,000.00-$120,000.00 1 week ago
San Francisco, CA $160,000.00-$230,000.00 2 weeks ago
South San Francisco, CA $70.00-$80.00 4 months ago
San Francisco, CA $86,400.00-$162,000.00 5 days ago
Systems Administrator / Technical Lead Process Control Systems
South San Francisco, CA $70.00-$80.00 2 weeks ago
Richmond, CA $110,000.00-$135,000.00 5 days ago
San Francisco, CA $275,000.00-$325,000.00 2 weeks ago
Oakland, CA $73,100.00-$125,400.00 1 week ago
San Mateo, CA $160,000.00-$200,000.00 4 days ago
San Francisco, CA $86,400.00-$162,000.00 4 days ago
San Francisco, CA $110,000.00-$165,000.00 2 weeks ago
Oakland, CA $92,700.00-$221,500.00 5 days ago
Senior Business Systems Administrator, CRM
Production/Manufacturing Engineering Department Head
San Francisco, CA $175,000.00-$250,000.00 3 weeks ago
San Francisco, CA $150,000.00-$250,000.00 1 year ago
San Francisco, CA $150.00-$175.00 4 months ago
We’re unlocking community knowledge in a new way. Experts add insights directly into each article, started with the help of AI.
#J-18808-Ljbffr