Senior Data Engineer
Full-Time
Hybrid (NYC)
Base Salary - $140-170k DOE
My client is a pioneering company dedicated to leveraging cutting-edge technology to revolutionize the healthcare industry. Their focus is to develop innovative solutions aimed to improve consumer health outcomes through data-driven approaches. They are one of the leaders in shaping the future of healthcare delivery and patient care - looking to add a Senior Data Engineer to their internal team.
Key Responsibilities:
- Lead data solution development for assigned projects.
- Collaborate with cross-functional teams to define business and technical requirements.
- Design and implement data pipelines using cloud technologies for ingestion, segmentation, and reporting.
- Establish infrastructure for data access and analysis.
- Document database designs and ETL processes.
- Conduct code reviews and test plans to maintain data quality.
- Contribute to team strategies and technical improvements.
- Execute proof of concepts to refine technical processes.
Qualifications:
- 3+ years of Spark experience using Scala/Python for ETL pipelines.
- 4+ years in big data.
- Proficiency in AWS services like Kinesis, S3, RedShift, DMS, Athena.
- Strong troubleshooting skills within the data ecosystem.
- Familiarity with GitHub and CI/CD processes.
- Experience with EMR, Databricks, and job orchestration tools.
- Knowledge of other data platforms like DBT, Snowflake, DeltaLake.
- Analytical, motivated, and quick learner.
- Adaptability to a dynamic business environment.
- Ability to manage multiple tasks independently.