Senior Data Engineer - Stott and May : Job Details

Senior Data Engineer

Full-Time

Hybrid (NYC)

Base Salary - $140-170k DOE

My client is a pioneering company dedicated to leveraging cutting-edge technology to revolutionize the healthcare industry. Their focus is to develop innovative solutions aimed to improve consumer health outcomes through data-driven approaches. They are one of the leaders in shaping the future of healthcare delivery and patient care - looking to add a Senior Data Engineer to their internal team.

Key Responsibilities:

• Lead data solution development for assigned projects.
• Collaborate with cross-functional teams to define business and technical requirements.
• Design and implement data pipelines using cloud technologies for ingestion, segmentation, and reporting.
• Establish infrastructure for data access and analysis.
• Document database designs and ETL processes.
• Conduct code reviews and test plans to maintain data quality.
• Contribute to team strategies and technical improvements.
• Execute proof of concepts to refine technical processes.

Qualifications:

• 3+ years of Spark experience using Scala/Python for ETL pipelines.
• 4+ years in big data.
• Proficiency in AWS services like Kinesis, S3, RedShift, DMS, Athena.
• Strong troubleshooting skills within the data ecosystem.
• Familiarity with GitHub and CI/CD processes.
• Experience with EMR, Databricks, and job orchestration tools.
• Knowledge of other data platforms like DBT, Snowflake, DeltaLake.
• Analytical, motivated, and quick learner.
• Adaptability to a dynamic business environment.
• Ability to manage multiple tasks independently.