AI Engineer - Reinforcement Learning
: Job Details :

Yutori is reimagining how people interact with the web by building AI agents that can reliably do everyday digital tasks. We are building the entire stack to be agent-first, from training our own models to generative product interfaces. Towards this goal, we are looking for a member of the AI technical staff to join the founding team. Someone technically strongly, and excited about building superhuman AI agents that take actions on the web. Our founders - Devi Parikh, Abhishek Das, Dhruv Batra - have decades of experience in AI research and product spanning generative, multimodal and embodied AI at Meta. Our team combines AI experience with design-minded product thinking to build and deliver on Yutori's mission. Yutori is backed by a stellar set of visionary investors - Elad Gil, Sarah Guo, Jeff Dean, Fei-Fei Li, Amjad Masad, Guillermo Rauch, Akshay Kothari, Soleio, Oliver Cameron, Julien Chaumond, Logan Kilpatrick, Bryan McCann, Vladlen Koltun, Jamie Cuffe, Michele Catasta, etc. Responsibilities:

• Build a superhuman generalist web-agent
• Scale infra, data, algorithms for large-scale distributed async reinforcement learning with multimodal LLMs acting in web environments
• Work closely with product engineers to translate cutting-edge AI capabilities into elegant and reliable product experiences.

What we're looking for:

• Experience with large-scale RL, ideally for post-training multimodal LLMs
• Experience building distributed systems for RL (balancing trainer, environment, actor workloads)
• Experience with ML infrastructure (GPU clusters) and supporting networking (NCCL)
• High IQ, high EQ, high agency, high craftsmanship, low ego. Proactive, clear communication.

Benefits and perks:

• Competitive salary and equity
• Visa sponsorship and relocation stipend to bring you to SF
• Generous health, dental, vision insurance for you and your dependents
• 20 days of paid time off per year
• Work laptop and budget to set up your work office
• Daily team lunches
• Commuter benefits
• Small, focused team of high-potential individuals. In-person in SF.