Senior Software Engineer, Generative AI (Remote) - Experian : Job Details

Experian is a global data and technology company, powering opportunities for people and businesses around the world. We help to redefine lending practices, uncover and prevent fraud, simplify healthcare, create digital marketing solutions, and gain deeper insights into the automotive market, all using our unique combination of data, analytics and software. We also assist millions of people to realise their financial goals and help them to save time and money.

We operate across a range of markets, from financial services to healthcare, automotive, agrifinance, insurance, and many more industry segments.

We invest in people and new advanced technologies to unlock the power of data and to innovate. A FTSE 100 Index company listed on the London Stock Exchange (EXPN), we have a team of 23,300 people across 32 countries. Our corporate headquarters are in Dublin, Ireland.

We are looking for a Senior Software Engineer specializing in Retrieval-Augmented Generation (RAG) systems, with experience in large language models (LLMs), vector databases, and cloud-based microservices. Your role will focus on building, integrating, and optimizing LLM workflows using LangChain and managing complex infrastructure with AWS services like Lambda and ECS. You'll bring expertise in containerized environments, using Docker, and work with vector databases to power data-driven applications. You will report to a Staff Software Engineer and work remote in the United States or hybrid based on proximity to an Experian office.

You'll have opportunity to:

• RAG Workflow Development: Design and deploy LLM-driven RAG workflows using LangChain and vector databases to provide high-accuracy data retrieval and enhanced content generation.
• Vector Database Management: Integrate and manage vector databases like Qdrant for optimized, high-speed vector searches and data retrieval.
• Cloud Computing: Use AWS services, including Lambda and ECS, to build serverless architectures and scalable containerized applications.
• API & Backend Development: Build APIs with FastAPI and Uvicorn to support low-latency interactions and handle high traffic volumes.
• Monitoring & Observability: Implement observability best practices using Datadog, ddtrace, and logging tools to maintain performance and troubleshoot complex workflows.

• Proficiency in LLM and RAG Workflows: experience with LangChain and vector databases, applying RAG techniques for intelligent data retrieval and generation.
• Python Proficiency (>=3.11,