Recruiting from Scratch
3033 | Haize Labs | Staff+ Backend/Infra Software Engineer
Recruiting from Scratch, New York, New York, us, 10261
Who is Recruiting from Scratch:
Recruiting from Scratch is a premier talent firm that focuses on placing the best product managers, software, and hardware talent at innovative companies. Our team is 100% remote and we work with teams across the United States to help them hire.
Title of Role:
Senior Backend & Infrastructure Engineer
Location:
New York City (In-Person, Flatiron) Company Stage of Funding:
Series A Office Type:
Onsite 5 Days a Week Salary:
$225,000 - $480,000 + Competitive Equity
Company Description
Our client is a Series A, VC-backed AI infrastructure startup building a platform to bring AI-based applications from proof-of-concept to production. Their mission is to improve the reliability and safety of large language model (LLM) applications through advanced testing, guardrails, and evaluation frameworks.
The company is already working with top-tier customers - from leading AI labs to enterprise-scale businesses - to ensure their AI systems are robust, trustworthy, and ready for real-world deployment. With a seasoned founding team and strong technical advisory board, this is an exciting opportunity to join early and shape the future of AI reliability tooling.
What You Will Do Design and implement scalable systems that orchestrate thousands of LLM operations per second (e.g., evaluations, red-teaming, runtime guardrails) Collaborate with researchers to deploy novel AI models and build cutting-edge reliability tooling Interface with customers to refine the platform's capabilities and improve developer workflows Contribute to architectural direction and mentor a growing team of engineers Establish best practices that enable operational excellence across engineering Ideal Candidate Background
7+ years of experience as a software engineer, including at least 3 years leading large initiatives as an engineer or manager Demonstrated success in building and scaling complex distributed backend systems Previous work in early-stage or 01 product environments, ideally B2B SaaS Exposure to applied AI/ML workflows and collaboration with research/ML teams Experience with cloud-native infrastructure in production environments Preferred
Familiarity with LLMs, model evaluations, or applied AI testing Expertise in security, privacy, or compliance in cloud environments Experience building or operating GPU-based model infrastructure Contributions to open-source infrastructure or developer tooling projects Must Haves
Strong proficiency in at least one backend language (e.g., Python, Go, Rust) Deep knowledge of cloud platforms (AWS, GCP, or Azure), Kubernetes, Terraform Strong understanding of relational and NoSQL databases (e.g., Postgres, MongoDB, Redis) Practical, outcomes-oriented mindset with ability to solve ambiguous problems Strong communication and collaboration skills Compensation, Benefits & Other Details
Base Salary:
$225,000 - $480,000 Equity:
Competitive stock options package Work Location:
In-person, Flatiron (NYC HQ) Visa Sponsorship:
Available for exceptional candidates Team Size:
Tech Stack:
Python, FastAPI, Kubernetes, Terraform, Postgres, MongoDB, Redis, AWS, React, TypeScript
This is a rare opportunity to shape the infrastructure powering the next generation of safe, production-ready AI applications. If you thrive in fast-paced, mission-driven environments and want to build something foundational in AI, we'd love to hear from you.
Recruiting from Scratch is a premier talent firm that focuses on placing the best product managers, software, and hardware talent at innovative companies. Our team is 100% remote and we work with teams across the United States to help them hire.
Title of Role:
Senior Backend & Infrastructure Engineer
Location:
New York City (In-Person, Flatiron) Company Stage of Funding:
Series A Office Type:
Onsite 5 Days a Week Salary:
$225,000 - $480,000 + Competitive Equity
Company Description
Our client is a Series A, VC-backed AI infrastructure startup building a platform to bring AI-based applications from proof-of-concept to production. Their mission is to improve the reliability and safety of large language model (LLM) applications through advanced testing, guardrails, and evaluation frameworks.
The company is already working with top-tier customers - from leading AI labs to enterprise-scale businesses - to ensure their AI systems are robust, trustworthy, and ready for real-world deployment. With a seasoned founding team and strong technical advisory board, this is an exciting opportunity to join early and shape the future of AI reliability tooling.
What You Will Do Design and implement scalable systems that orchestrate thousands of LLM operations per second (e.g., evaluations, red-teaming, runtime guardrails) Collaborate with researchers to deploy novel AI models and build cutting-edge reliability tooling Interface with customers to refine the platform's capabilities and improve developer workflows Contribute to architectural direction and mentor a growing team of engineers Establish best practices that enable operational excellence across engineering Ideal Candidate Background
7+ years of experience as a software engineer, including at least 3 years leading large initiatives as an engineer or manager Demonstrated success in building and scaling complex distributed backend systems Previous work in early-stage or 01 product environments, ideally B2B SaaS Exposure to applied AI/ML workflows and collaboration with research/ML teams Experience with cloud-native infrastructure in production environments Preferred
Familiarity with LLMs, model evaluations, or applied AI testing Expertise in security, privacy, or compliance in cloud environments Experience building or operating GPU-based model infrastructure Contributions to open-source infrastructure or developer tooling projects Must Haves
Strong proficiency in at least one backend language (e.g., Python, Go, Rust) Deep knowledge of cloud platforms (AWS, GCP, or Azure), Kubernetes, Terraform Strong understanding of relational and NoSQL databases (e.g., Postgres, MongoDB, Redis) Practical, outcomes-oriented mindset with ability to solve ambiguous problems Strong communication and collaboration skills Compensation, Benefits & Other Details
Base Salary:
$225,000 - $480,000 Equity:
Competitive stock options package Work Location:
In-person, Flatiron (NYC HQ) Visa Sponsorship:
Available for exceptional candidates Team Size:
Tech Stack:
Python, FastAPI, Kubernetes, Terraform, Postgres, MongoDB, Redis, AWS, React, TypeScript
This is a rare opportunity to shape the infrastructure powering the next generation of safe, production-ready AI applications. If you thrive in fast-paced, mission-driven environments and want to build something foundational in AI, we'd love to hear from you.