3033 | Haize Labs | Staff+ Backend/Infra Software Engineer - Recruiting from Scratch : Job Details

Who is Recruiting from Scratch:Recruiting from Scratch is a premier talent firm that focuses on placing the best product managers, software, and hardware talent at innovative companies. Our team is 100% remote and we work with teams across the United States to help them hire.

Title of Role: Senior Backend & Infrastructure Engineer

Location: New York City (In-Person, Flatiron)Company Stage of Funding: Series AOffice Type: Onsite 5 Days a WeekSalary: $225,000 – $480,000 + Competitive Equity

Company Description

Our client is a Series A, VC-backed AI infrastructure startup building a platform to bring AI-based applications from proof-of-concept to production. Their mission is to improve the reliability and safety of large language model (LLM) applications through advanced testing, guardrails, and evaluation frameworks.

The company is already working with top-tier customers — from leading AI labs to enterprise-scale businesses — to ensure their AI systems are robust, trustworthy, and ready for real-world deployment. With a seasoned founding team and strong technical advisory board, this is an exciting opportunity to join early and shape the future of AI reliability tooling.

What You Will Do

• Design and implement scalable systems that orchestrate thousands of LLM operations per second (e.g., evaluations, red-teaming, runtime guardrails)

• Collaborate with researchers to deploy novel AI models and build cutting-edge reliability tooling

• Interface with customers to refine the platform's capabilities and improve developer workflows

• Contribute to architectural direction and mentor a growing team of engineers

• Establish best practices that enable operational excellence across engineering

Ideal Candidate Background

• 7+ years of experience as a software engineer, including at least 3 years leading large initiatives as an engineer or manager

• Demonstrated success in building and scaling complex distributed backend systems

• Previous work in early-stage or 0→1 product environments, ideally B2B SaaS

• Exposure to applied AI/ML workflows and collaboration with research/ML teams

• Experience with cloud-native infrastructure in production environments

Preferred

• Familiarity with LLMs, model evaluations, or applied AI testing

• Expertise in security, privacy, or compliance in cloud environments

• Experience building or operating GPU-based model infrastructure

• Contributions to open-source infrastructure or developer tooling projects

Must Haves

• Strong proficiency in at least one backend language (e.g., Python, Go, Rust)

• Deep knowledge of cloud platforms (AWS, GCP, or Azure), Kubernetes, Terraform

• Strong understanding of relational and NoSQL databases (e.g., Postgres, MongoDB, Redis)

• Practical, outcomes-oriented mindset with ability to solve ambiguous problems

• Strong communication and collaboration skills

Compensation, Benefits & Other Details

• Base Salary: $225,000 – $480,000

• Equity: Competitive stock options package

• Work Location: In-person, Flatiron (NYC HQ)

• Visa Sponsorship: Available for exceptional candidates

• Team Size: