Machine Learning Engineer - The Cypress Group : Job Details

This range is provided by The Cypress Group. Your actual pay will be based on your skills and experience — talk with your recruiter to learn more.

Base pay range

$160,000.00/yr - $220,000.00/yr

Direct message the job poster from The Cypress Group

Technical Recruiter at The Cypress Group

My Client is a fast-moving startup based in NYC building cutting-edge AI-powered solutions to solve real-world problems in the building industry. Our mission is to harness the latest advances in large language models (LLMs) to build intuitive, human-centric tools. We believe small teams can make a big impact—and we're looking for people who thrive in dynamic, high-ownership environments.

Role Overview

We're seeking a Machine Learning Engineer with a strong focus on prompt engineering to help us develop, fine-tune, and deploy LLM-driven applications. You'll work closely with our product, engineering, and design teams to iterate quickly on new features, prototypes, and research-backed implementations that bring language models to life in production.

What You'll Do

• Design, test, and optimize prompts for large language models (e.g., GPT-4, Claude, Gemini) across a range of tasks.
• Fine-tune open-source or proprietary language models using instruction tuning, RLHF, or LoRA-based approaches.
• Develop robust evaluation pipelines to assess model performance, safety, and reliability.
• Collaborate with product and UX teams to integrate LLM functionality into real-world user flows.
• Research and experiment with new prompting techniques (e.g., chain-of-thought, self-reflection, retrieval-augmented generation).
• Write reusable components and tools to streamline LLM integration and testing.
• Monitor model behavior in production and iterate on prompts/models based on user feedback and performance data.

What We're Looking For

• 2–5+ years of experience in machine learning, NLP, or applied AI.
• Experience working with large language models (OpenAI, Anthropic, Hugging Face, Cohere, etc.).
• Strong Python skills and familiarity with ML frameworks like PyTorch or TensorFlow.
• Deep understanding of prompt engineering techniques and LLM behavior.
• Experience with tools for LLMOps (e.g., LangChain, Weights & Biases, MLflow, etc.) is a plus.
• Ability to balance research exploration with practical product needs.
• Excellent communication skills and a collaborative, startup-minded attitude.

Nice to Have

• Experience with vector databases (e.g., Pinecone, Weaviate, FAISS).
• Familiarity with API-based LLM deployments and serverless infrastructure.
• Published research or blog posts in the NLP/LLM space.
• Previous startup experience or working on small, agile teams.

What We Offer

• Competitive salary and early-stage equity
• Flexible hybrid schedule with a beautiful workspace in NYC
• Opportunity to work on cutting-edge AI applications with real user impact
• A small, ambitious, and collaborative team
• Generous vacation, healthcare, and wellness benefits

Seniority level

• Seniority levelMid-Senior level

Employment type

• Employment typeFull-time

Job function

• Job functionInformation Technology
• IndustriesSoftware Development

Referrals increase your chances of interviewing at The Cypress Group by 2x

Inferred from the description for this job

Medical insurance

401(k)

Get notified about new Machine Learning Engineer jobs in New York, NY.

Brooklyn, NY $119,000.00-$155,000.00 3 days ago

New York, NY $120,700.00-$228,600.00 3 days ago

Software Engineer, Machine Learning (Multiple Levels) - Slack

New York, NY $167,300.00-$334,600.00 2 days ago

New York, NY $120,000.00-$180,000.00 1 week ago

New York, NY $100,000.00-$250,000.00 1 month ago

New York, NY $93,144.00-$133,063.00 4 days ago

New York, NY $181,875.00-$200,645.00 1 week ago

New York, NY $180,000.00-$290,000.00 3 months ago

New York, NY $150,000.00-$260,000.00 4 months ago

Machine Learning Engineer, Personalization

New York, NY $136,878.00-$195,540.00 1 week ago

New York, NY $160,000.00-$280,000.00 1 year ago

New York, NY $141,000.00-$202,000.00 4 days ago

New York, NY $150,000.00-$220,000.00 4 weeks ago

New York, NY $112,664.00-$160,948.00 1 week ago

New York, NY $220,000.00-$260,000.00 1 week ago

New York, NY $128,000.00-$240,000.00 4 days ago

New York, NY $187,000.00-$270,000.00 1 month ago

New York, NY $70,000.00-$100,000.00 1 week ago

New York, NY $138,250.00-$197,500.00 1 week ago

New York, NY $150,000.00-$200,000.00 2 months ago

New York, NY $150,000.00-$210,000.00 1 month ago

New York, NY $167,000.00-$185,500.00 5 days ago

Machine Learning Engineer, GenRecs, Personalization

New York, NY $138,250.00-$197,500.00 1 week ago

New York, NY $138,250.00-$197,500.00 4 days ago

New York, NY $180,000.00-$240,000.00 3 months ago

New York, NY $110,000.00-$250,000.00 3 months ago

New York, NY $175,000.00-$250,000.00 3 weeks ago

New York, NY $100,000.00-$300,000.00 2 weeks ago

New York, NY $164,000.00-$198,000.00 6 days ago

New York, NY $180,000.00-$280,000.00 7 months ago

New York, NY $185,000.00-$195,000.00 1 month ago

New York, NY $130,000.00-$180,000.00 6 months ago

We're unlocking community knowledge in a new way. Experts add insights directly into each article, started with the help of AI.

#J-18808-Ljbffr