Data Scientist- VLM (Vision Language Model) - Capgemini Engineering : Job Details

Data Scientist- VLM (Vision Language Model)

Join to apply for the Data Scientist- VLM (Vision Language Model) role at Capgemini Engineering.

We are seeking a highly skilled and detail-oriented Vision-Language Models (VLM) Data Scientist/ Vision Data Analyst to join our team. The ideal candidate will have a strong background in computer vision, natural language processing, data analysis, and machine learning. This role involves developing and deploying multimodal AI solutions that integrate vision and language capabilities, analyzing visual data to extract meaningful insights, and collaborating with cross-functional teams to improve our products and services.

Your responsibilities

• VLM Development & Deployment: Design, train, and deploy efficient Vision-Language Models (e.g., VILA) for multimodal applications. Explore cost-effective methods such as knowledge distillation, modal-adaptive pruning, and LoRA fine-tuning to optimize training and inference.
• Multimodal AI Solutions: Develop solutions that integrate vision and language capabilities for applications like image-text matching, visual question answering (VQA), and document data extraction. Leverage interleaved image-text datasets and advanced techniques (e.g., cross-attention layers) to enhance model performance.
• Healthcare Domain Expertise: Apply VLMs to healthcare-specific use cases such as medical imaging analysis, position detection, motion detection, and measurements. Ensure compliance with healthcare standards while handling sensitive data.
• Efficiency Optimization: Evaluate trade-offs between model size, performance, and cost using techniques like elastic visual encoders or lightweight architectures. Benchmark different VLMs (e.g., GPT-4V, Claude 3.5) for accuracy, speed, and cost-effectiveness on specific tasks.
• Data Analysis: Analyze large sets of visual data to identify patterns, trends, and anomalies.

Your skills and experience

• Education: Master's or Ph.D. in Computer Science, Data Science, Machine Learning, Electrical Engineering, or a related field.
• Experience: 3+ years of experience in machine learning or data science roles with a focus on vision-language models and computer vision. Proven expertise in deploying production-grade multimodal AI solutions.
• Technical Skills: Proficiency in Python and ML frameworks (e.g., PyTorch, TensorFlow). Hands-on experience with VLMs such as VILA, or VSS. Strong understanding of image processing techniques and tools.
• Analytical Skills: Excellent problem-solving skills and the ability to analyze complex data sets.

Additional Skills

• Communication: Strong written and verbal communication skills. Ability to present complex information clearly and concisely.
• Teamwork: Ability to work effectively in a collaborative team environment.
• Cloud Platforms: Experience with AWS or Azure.
• Data Visualization: Familiarity with tools like Tableau or Power BI. Knowledge of statistical analysis and data mining techniques.

About Capgemini

Capgemini supports all aspects of your well-being throughout your career. We offer flexible work, healthcare, financial well-being programs, paid time off, parental leave, family building benefits, social well-being benefits, mentoring, coaching, learning programs, Employee Resource Groups, and disaster relief.

About Capgemini Engineering

World leader in engineering and R&D services, supporting the convergence of physical and digital worlds across various sectors. Part of the Capgemini Group, with 65,000 engineers and scientists in over 30 countries, delivering end-to-end services leveraging AI, cloud, and digital technologies.

Additional Information

This role is full-time, associate level, within the Engineering and IT industry. We encourage diversity and are an equal opportunity employer. For more details, visit our equal opportunity policy.

#J-18808-Ljbffr