Advisor Engineer - Data, Molecule Discovery - Eli Lilly and Company : Job Details

Architect and implement scalable, fault-tolerant data pipelines for ingesting and transforming scientific data, including large datasets from EL - Ns such as Benchling and Signals. Collaborate with Tech@Lilly, data scientists, bio and cheminformaticians, and laboratory scientists to understand data needs and translate them into robust data models and workflows. Build and manage workflows using Airflow, Spark clusters, and Postgre. SQL, with performance-aware use of columnar databases. Develop APIs and microservices using Fast. API to serve processed data to downstream applications and teams. Leverage AWS services (Lambda, Batch, S 3, EC 2, etc.) to build scalable, cloud-native pipelines and data infrastructure. Design and implement data models that capture scientific concepts and experimental data for analytics and ML workflows. Collaborate with the lab automation engineers to build robust data infrastructure for the automated labs. Serve as a technical leader and data architect...Advisor, Data Engineer, Data Scientist, Data Architect, Engineer, Automation Engineer, Technology