Job Summary:
Our client is seeking a Cloud Data Engineer to join their team! This position is located in Temple Terrace, Florida.
Duties:
- Lead in design, development and testing of data ingestion pipelines
- Perform end to end validation of ETL process for various datasets that are being ingested into the big data platform
- Perform data migration and conversion validation activities on different applications and platforms
- Provide the technical leadership on data profiling/analysis, discovery, analysis, suitability and coverage of data, and identify the various data types, formats, and data quality issues which exist within a given data source
- Contribute to development of transformation logic, interfaces and reports as needed to meet project requirements
- Participate in discussion for technical architecture, data modeling and ETL standards, collaborate with Product Managers, Architects and Senior Developers to establish the physical application framework
- Lead in design and develop validation framework and integrated automated test suites to validate end to end data pipeline flow, data transformation rules, and data integrity
- Develop tools to measure the data quality and visualize the anomaly pattern in source and processed data
- Assist Manager in project planning, validation strategy development
- Provide support in User acceptance testing and production validation activities
- Provide technical recommendations for identifying data validation tools, recommend new technologies to improve the validation process
- Evaluate existing methodologies and processes and recommend improvements
- Work with the stakeholders, Product Management, Data and Design, Architecture teams and executives to call out issues, guide and contribute to the resolution's discussions
Desired Skills/Experience:
- 15+ Years of Data Domain knowledge With Data Architecture Background
- 10+ years of Software development and testing experience
- Experience with developing and testing ETL, real-time data-processing and Analytics Application Systems
- Strong knowledge in Spark SQL, Scala code development in big data Hadoop environment and/or BI/DW development experiences
- Experience with development and automated framework in a CI/CD environment
- Experience with cloud environments - GCP is a plus
- A solid understanding of common software development practices and tools
- Strong analytical skills with a methodical approach to problem solving applied to the Big Data domain
- Good organizational skills and strong written and verbal communication skills
Benefits:
- Medical, Dental, & Vision Insurance Plans
- Employee-Owned Profit Sharing (ESOP)
- 401K offered
The approximate pay range for this position is between $56.00 and $80.00. Please note that the pay range provided is a good faith estimate. Final compensation may vary based on factors including but not limited to background, knowledge, skills, and location. We comply with local wage minimums.