Senior Software Engineer (Infrastructure) - Alldus : Job Details

Senior Software Engineer (Infrastructure)Senior Software Engineer (Infrastructure)

This range is provided by Alldus. Your actual pay will be based on your skills and experience — talk with your recruiter to learn more.

Base pay range

$160,000.00/yr - $225,000.00/yr

Direct message the job poster from Alldus

Machine Learning, Data Science & Engineering Recruiter | Organizer of the AI in Action Podcast

We are a Series-A startup revolutionizing software development at a massive scale. Our mission is to help every organization build, deploy, scale, and manage AI-driven software with complete control, freedom, and flexibility. We are looking for exceptional backend engineers to join our team.

You will be integral to architecting and developing foundational systems that orchestrate and supervise a vast landscape of AI-powered applications. This role is ideal for someone who is collaborative, pragmatic, and thrives on rapid iteration, ongoing learning, and direct engagement with meaningful technical challenges alongside a high-caliber team.

Key Responsibilities :

• Architect and implement the principal orchestration layer for AI agent platforms, enabling robust role-based access controls, authentication, security guardrails for AI, system auditing, and visibility tooling.
• Build infrastructure capable of supporting multi-tenant environments across both public cloud and enterprise/on-premises deployments.
• Design, roll out, and optimize frameworks for constructing, securing, and evaluating AI agents and their operational guardrails.
• Interface with clients to deliver impactful features that address practical, high-value use cases.
• Collaborate with product teams to define priorities and advance innovative AI tools from conception through release.

Technical Qualifications:

• 3+ years of experience managing cloud-based production apps with deep knowledge of containers, VMs, caches, task queues, networking, and OS.
• Strong product-oriented mindset, with an emphasis on user-centric design and strategic thinking to align with evolving customer and market dynamics.
• Deep commitment to the mission
• Prior hands-on experience operating AI systems in production and familiarity with machine learning model inference.
• Experience with language runtime optimization or integration across languages (such as Go, Python, or C), potentially involving development or customization of WASM runtimes or compilers.
• Exposure to modern machine learning practices and hands-on work with frameworks like TensorFlow and PyTorch.

Seniority level

• Seniority levelMid-Senior level

Employment type

• Employment typeFull-time

Job function

• Job functionResearch and Engineering
• IndustriesSoftware Development

Referrals increase your chances of interviewing at Alldus by 2x

Inferred from the description for this job

Medical insurance

Vision insurance

401(k)

Get notified about new Software Engineer jobs in New York City Metropolitan Area.

New York, NY $70,000.00-$150,000.00 1 week ago

New York, NY $220,000.00-$260,000.00 4 days ago

New York, NY $99,500.00-$200,000.00 1 day ago

New York, NY $130,000.00-$180,000.00 6 months ago

Brooklyn, NY $150,000.00-$200,000.00 3 months ago

New York, NY $163,200.00-$223,200.00 1 week ago

New York, NY $70,000.00-$150,000.00 2 days ago

Full Stack Software Engineer (All Levels)

New York, NY $120,000.00-$180,000.00 5 months ago

New York, NY $140,000.00-$185,000.00 1 week ago

New York, NY $120,000.00-$140,000.00 1 week ago

New York, NY $140,000.00-$200,000.00 1 week ago

New York, NY $110,000.00-$150,000.00 1 month ago

Want to work with us, but don't see the right job listed?Software Engineer (Fullstack) - Payments

New York, NY $163,200.00-$223,200.00 1 week ago

Backend Software Engineer, CloudKitchens - New York City

New York, NY $140,000.00-$170,000.00 2 months ago

Backend Engineer, Real-time supply management

New York, NY $128,000.00-$160,000.00 2 weeks ago

New York, NY $99,500.00-$200,000.00 1 day ago

New York, NY $140,000.00-$140,000.00 1 month ago

New York, NY $165,000.00-$165,000.00 1 year ago

New York, NY $125,000.00-$175,000.00 1 month ago

New York, NY $235,000.00-$255,000.00 1 week ago

Software Engineer - Frontend / Fullstack

New York, NY $140,000.00-$200,000.00 1 month ago

New York, NY $145,000.00-$260,000.00 8 months ago

New York, NY $100,000.00-$200,000.00 6 months ago

New York, NY $141,000.00-$202,000.00 2 days ago

New York, NY $120,000.00-$220,000.00 1 month ago

We're unlocking community knowledge in a new way. Experts add insights directly into each article, started with the help of AI.

#J-18808-Ljbffr