AI Engineer - Rhapsody : Job Details

Join to apply for the AI Engineer role at Rhapsody

Join to apply for the AI Engineer role at Rhapsody

Get AI-powered advice on this job and more exclusive features.

Direct message the job poster from Rhapsody

We all know that our health care system is complicated. Getting data from one provider to another, or from a provider to a health insurance company, is frustrating for virtually everyone. Imagine developing solutions that help make these data transactions easier and faster. That is what we do at Rhapsody; we make interoperability platforms that allow data – such as patient encounter details, lab results, and billing information – to move seamlessly from one system to another.

While most people will not ever see our products and services during a medical encounter, our interoperability platforms are running behind the scenes. Think of them as the central nervous system helping to move data where it needs to be to improve the patient experience. To learn more about Rhapsody, visit www.rhapsody.health

If using your expertise in a way that impacts our health care system, patient care, and population health sounds like something you would find rewarding, apply today!

This is a remote position. However, preference is for someone local to Boston MA, Dallas TX or Los Angeles CA.

Position Summary:

Rhapsody is building a platform-wide AI foundation to power intelligent assistants, agentic automation systems, and embedded machine learning features across our product ecosystem. We're looking for an AI Engineer to join our growing AI team and lead the development of LLM-based workflows, retrieval-augmented generation (RAG) systems, and agentic AI behavior.

As an AI Engineer, you will focus on designing the intelligence layer—prompt strategies, embedding pipelines, retrieval logic, and multi-step reasoning—behind AI systems that serve both internal and external users. You'll work at the frontier of applied AI, experimenting with the latest models and techniques, and building smart, composable workflows that power end-user features. While you'll collaborate closely with platform engineers to deploy stable systems, your focus will be on exploring new capabilities, designing intelligent behavior, and validating AI performance.

We're looking for someone who is not only technically strong, but deeply curious and open-minded—someone who stays current with the latest models, tools, and research, and thrives in an experimental environment where rapid iteration, learning, and exploration lead to high-impact breakthroughs.

Key Responsibilities:

• Architect and implement LLM-powered systems, including RAG pipelines and agentic workflows
• Prototype, test, and refine multi-step reasoning and tool-use behavior (agentic AI)
• Design prompt strategies, chunking logic, context management, and fallback flows
• Evaluate emerging LLM models, tools, and architectures—and identify how they can improve existing systems or unlock new capabilities
• Collaborate with AI Platform Engineers to deploy LLM systems into production environments
• Partner with platform engineers to ensure AI systems are observable, debuggable, and performant in production
• Contribute to shared tools and frameworks for prompt versioning, cost control, and observability
• Collaborate on data science–driven features such as forecasting, prediction, and evaluation pipelines when needed
• Work with product teams to align assistant behaviors with real user needs and domain-specific logic

Qualifications:

Required:

• 5+ years of experience in software engineering or applied AI/ML roles, with strong proficiency in Python and a track record of building intelligent systems or AI-powered features
• Hands-on experience building and deploying LLM-based systems (e.g., OpenAI, Claude, Mistral, or open-source models)
• Understanding of prompt engineering, tokenization, context windows, and LLM evaluation
• Familiarity with RAG systems, vector databases (e.g., FAISS, Pinecone, Weaviate), and embedding generation
• Experience designing end-to-end AI pipelines or systems that incorporate retrieval, prompting, or agent logic
• Ability to build well-structured, maintainable code that enables experimentation and handoff to production teams
• Comfort working in iterative, fast-paced environments

Preferred:

• Experience with LangChain, LlamaIndex, or custom agentic frameworks
• Exposure to observability, metrics, and cost-performance tuning for LLM-based systems
• Familiarity with data science techniques or workflows (e.g., feature engineering, model evaluation, experimentation) is a plus
• Prior work in AI for healthcare or other complex domains is a plus

Education:

• Bachelor's or Master's degree in Computer Science, Engineering, AI/ML, or a related technical field (or equivalent experience)

Seniority level

• Seniority levelAssociate

Employment type

• Employment typeFull-time

Job function

• IndustriesHospitals and Health Care and Software Development

Referrals increase your chances of interviewing at Rhapsody by 2x

Inferred from the description for this job

Medical insurance

Vision insurance

401(k)

Paid maternity leave

Paid paternity leave

Disability insurance

Get notified about new Artificial Intelligence Engineer jobs in Massachusetts, United States.

Boston, MA $100,000.00-$110,000.00 2 weeks ago

Boston, MA $150,000.00-$180,000.00 2 weeks ago

Boston, MA $150,000.00-$175,000.00 3 months ago

Software Developer – Full stack/back-end

Boston, MA $190,000.00-$220,000.00 2 days ago

Boston, MA $140,000.00-$170,000.00 3 days ago

Massachusetts, United States 13 hours ago

Junior Software Engineer, Full Stack (Remote)

Bedford, MA $100,000.00-$120,000.00 1 week ago

Boston, MA $110,000.00-$140,000.00 2 months ago

Massachusetts, United States $230,800.00-$271,200.00 2 weeks ago

Boston, MA $120,000.00-$240,000.00 1 month ago

Massachusetts, United States $140,000.00-$170,000.00 1 week ago

Senior Software Engineer, Backend - Fintech

We're unlocking community knowledge in a new way. Experts add insights directly into each article, started with the help of AI.

#J-18808-Ljbffr