Jobright.ai
Senior Software Engineer - Together Cloud Infrastructure
Jobright.ai, San Francisco, California, United States, 94199
Senior Software Engineer - Together Cloud Infrastructure
Join to apply for the
Senior Software Engineer - Together Cloud Infrastructure
role at
Jobright.ai Senior Software Engineer - Together Cloud Infrastructure
3 days ago Be among the first 25 applicants Join to apply for the
Senior Software Engineer - Together Cloud Infrastructure
role at
Jobright.ai Together AI is a research-driven artificial intelligence company focused on building the AI Acceleration Cloud, an end-to-end platform for the generative AI lifecycle. The Senior AI Infrastructure Engineer will be responsible for developing a highly available cloud infrastructure that supports various AI services and ensures robust performance across global data centers. Responsibilities: • Perform architecture and research work for decentralized AI workloads • Work on the core, open-source Together AI platform • Create services, tools, and developer documentation • Create testing frameworks for robustness and fault-tolerance Qualifications: Required: • 5+ years of professional software development experience and proficiency in at least one backend programming language (Golang desired) • 5+ years experience writing high-performance, well-tested, production quality code • Demonstrated experience with building and operating high-performance and/or globally distributed micro-service architectures across one or more cloud providers (AWS, Azure, GCP) • Excellent communication skills – able to write clear design docs and work effectively with both technical and non-technical team members • Strong systems knowledge across compute, networking, and storage, including concurrency, memory management, performant I/O, and scale • Experience with infrastructure automation tools (Terraform, Ansible), monitoring/observability stacks (Prometheus, Grafana), and CI/CD pipelines (GitHub Actions, ArgoCD) Preferred: • Deep experience with Kubernetes internals a big plus, such as implementing non-trivial Kubernetes operators, device/storage/network plugins, custom schedulers, or patches thereon or Kubernetes itself • Deep experience with VMs/hypervisors a big plus, such as QEMU/KVM, cloud-hypervisor, VFIO, virtio, PCIE passthrough, Kubevirt, SR-IOV • Deep experience with DC networking tech + solutions a big plus, such as VLAN, VXLAN, VPN, VPC, OVS/OVN • Experience with Cluster API or similar a big plus • Experience working on high-performance compute, networking, and/or storage a big plus • Experience virtualizing GPUs and/or Infiniband a big plus • Experience building IaaS or PaaS systems at scale a plus • Experience with DPUs/SmartNICs a plus • GPU programming, NCCL, CUDA knowledge a plus Company: Together AI is a cloud-based platform designed for constructing open-source generative AI and infrastructure for developing AI models. Founded in 2022, the company is headquartered in San Francisco, California, USA, with a team of 201-500 employees. The company is currently Growth Stage. Together AI has a track record of offering H1B sponsorships. Seniority level
Seniority level Mid-Senior level Employment type
Employment type Full-time Job function
Industries Software Development Referrals increase your chances of interviewing at Jobright.ai by 2x Inferred from the description for this job
Medical insurance Vision insurance 401(k) Get notified when a new job is posted. Sign in to set job alerts for “Software Engineer” roles.
San Francisco, CA $160,000.00-$180,000.00 2 weeks ago San Francisco, CA $130,000.00-$238,000.00 2 weeks ago San Francisco, CA $150,000.00-$250,000.00 2 weeks ago Full-Stack Software Engineer (Jr/Mid level)
San Francisco, CA $120,000.00-$180,000.00 1 month ago San Francisco, CA $150,000.00-$230,000.00 3 months ago San Francisco, CA $150,000.00-$283,000.00 2 weeks ago Software Development Engineer I - Frontend & Mobile
San Francisco, CA $150,000.00-$176,000.00 3 months ago San Francisco, CA $120,000.00-$190,000.00 9 months ago San Francisco, CA $57.00-$61.00 2 days ago San Francisco, CA $57.00-$61.00 2 days ago San Francisco, CA $125,000.00-$175,000.00 2 months ago San Francisco, CA $163,200.00-$223,200.00 2 weeks ago Software Engineer, Frontend (All Levels)
San Francisco, CA $150,000.00-$180,000.00 6 days ago Software Engineer, AI Intern (Winter 2026)
San Francisco, CA $57.00-$61.00 2 days ago Software Engineer, AI Intern (Summer 2026)
San Francisco, CA $57.00-$61.00 2 days ago San Francisco, CA $165,000.00-$165,000.00 2 years ago San Francisco, CA $120,000.00-$200,000.00 2 years ago Alameda, CA $130,000.00-$160,000.00 2 months ago San Francisco, CA $140,000.00-$280,000.00 8 months ago We’re unlocking community knowledge in a new way. Experts add insights directly into each article, started with the help of AI.
#J-18808-Ljbffr
Join to apply for the
Senior Software Engineer - Together Cloud Infrastructure
role at
Jobright.ai Senior Software Engineer - Together Cloud Infrastructure
3 days ago Be among the first 25 applicants Join to apply for the
Senior Software Engineer - Together Cloud Infrastructure
role at
Jobright.ai Together AI is a research-driven artificial intelligence company focused on building the AI Acceleration Cloud, an end-to-end platform for the generative AI lifecycle. The Senior AI Infrastructure Engineer will be responsible for developing a highly available cloud infrastructure that supports various AI services and ensures robust performance across global data centers. Responsibilities: • Perform architecture and research work for decentralized AI workloads • Work on the core, open-source Together AI platform • Create services, tools, and developer documentation • Create testing frameworks for robustness and fault-tolerance Qualifications: Required: • 5+ years of professional software development experience and proficiency in at least one backend programming language (Golang desired) • 5+ years experience writing high-performance, well-tested, production quality code • Demonstrated experience with building and operating high-performance and/or globally distributed micro-service architectures across one or more cloud providers (AWS, Azure, GCP) • Excellent communication skills – able to write clear design docs and work effectively with both technical and non-technical team members • Strong systems knowledge across compute, networking, and storage, including concurrency, memory management, performant I/O, and scale • Experience with infrastructure automation tools (Terraform, Ansible), monitoring/observability stacks (Prometheus, Grafana), and CI/CD pipelines (GitHub Actions, ArgoCD) Preferred: • Deep experience with Kubernetes internals a big plus, such as implementing non-trivial Kubernetes operators, device/storage/network plugins, custom schedulers, or patches thereon or Kubernetes itself • Deep experience with VMs/hypervisors a big plus, such as QEMU/KVM, cloud-hypervisor, VFIO, virtio, PCIE passthrough, Kubevirt, SR-IOV • Deep experience with DC networking tech + solutions a big plus, such as VLAN, VXLAN, VPN, VPC, OVS/OVN • Experience with Cluster API or similar a big plus • Experience working on high-performance compute, networking, and/or storage a big plus • Experience virtualizing GPUs and/or Infiniband a big plus • Experience building IaaS or PaaS systems at scale a plus • Experience with DPUs/SmartNICs a plus • GPU programming, NCCL, CUDA knowledge a plus Company: Together AI is a cloud-based platform designed for constructing open-source generative AI and infrastructure for developing AI models. Founded in 2022, the company is headquartered in San Francisco, California, USA, with a team of 201-500 employees. The company is currently Growth Stage. Together AI has a track record of offering H1B sponsorships. Seniority level
Seniority level Mid-Senior level Employment type
Employment type Full-time Job function
Industries Software Development Referrals increase your chances of interviewing at Jobright.ai by 2x Inferred from the description for this job
Medical insurance Vision insurance 401(k) Get notified when a new job is posted. Sign in to set job alerts for “Software Engineer” roles.
San Francisco, CA $160,000.00-$180,000.00 2 weeks ago San Francisco, CA $130,000.00-$238,000.00 2 weeks ago San Francisco, CA $150,000.00-$250,000.00 2 weeks ago Full-Stack Software Engineer (Jr/Mid level)
San Francisco, CA $120,000.00-$180,000.00 1 month ago San Francisco, CA $150,000.00-$230,000.00 3 months ago San Francisco, CA $150,000.00-$283,000.00 2 weeks ago Software Development Engineer I - Frontend & Mobile
San Francisco, CA $150,000.00-$176,000.00 3 months ago San Francisco, CA $120,000.00-$190,000.00 9 months ago San Francisco, CA $57.00-$61.00 2 days ago San Francisco, CA $57.00-$61.00 2 days ago San Francisco, CA $125,000.00-$175,000.00 2 months ago San Francisco, CA $163,200.00-$223,200.00 2 weeks ago Software Engineer, Frontend (All Levels)
San Francisco, CA $150,000.00-$180,000.00 6 days ago Software Engineer, AI Intern (Winter 2026)
San Francisco, CA $57.00-$61.00 2 days ago Software Engineer, AI Intern (Summer 2026)
San Francisco, CA $57.00-$61.00 2 days ago San Francisco, CA $165,000.00-$165,000.00 2 years ago San Francisco, CA $120,000.00-$200,000.00 2 years ago Alameda, CA $130,000.00-$160,000.00 2 months ago San Francisco, CA $140,000.00-$280,000.00 8 months ago We’re unlocking community knowledge in a new way. Experts add insights directly into each article, started with the help of AI.
#J-18808-Ljbffr