Senior Data Engineer - HonorVet Technologies : Job Details

Job Title - Senior Data Engineer Location - New York We are hiring a Senior Data Engineer who will work with teams in a fast-paced technology organization. As a Senior Data Engineer, you will be responsible for the full development life cycle of complex data projects requiring integrations and transformations including analysis, design, development, and support of complex data pipelines in cloud environments. You will also assist in the design and configuration of data management tools that extract and manipulate data from various sources, including in-house and external databases. Required Skills 1. Experience in creating scalable and secure data pipelines that enable the ingestion, transformation, and transfer of large quantities of structured and unstructured data from various databases and sources. 2. Experience in building complex database logic and API's to automatically fetch and store data in various forms. 3. Extensive experience with programming languages (Python or related), ETL tools and their administration, as well as relational and non-relational databases. 4. Experience in architecting and developing efficient and reusable modularized components that drive complex applications. 5. Experience in implementing data quality, security, and governance standards and best practices across different cloud environments. 6. Experience in the design and build of the integration between data management tools. 7. Experience in the design, development, and maintenance of data solutions across different cloud platforms, such as AWS, Azure, or Google Cloud. 8. Extensive understanding of data structures, algorithms, and software architecture as well as the design, detailed testing, and documentation of complex systems. 9. Experience with the secure movement and storage of PHI, PII, and PCI data. 10. Experience with scaling up or increasing application resiliency and assuring that code meets required performance standards. 11. Ability to work and collaborate with data analysts, data scientists and IT operations to install and build tools transforming data to be used in building a new generation of data and artificial intelligence products. 12. Experience in providing technical leadership for development projects and providing consultation and guidance to other team members. 13. Ability to provide innovative solutions when presented with complex business or production issues. 14. Experience with modern DevSecOps practices and tools. 15. Experience with Agile methodologies and tools (i.e. Jira, Scrum, Kanban). Nice to have 1. Experience in directing a team of data engineers and analysts in the creation of complex software and data pipelines. 2. Experience with data governance processes. 3. Experience with data classification and taxonomy tools. Qualifications 1. Bachelor's degree in Computer Science, Information Systems, or related field, Masters preferred 2. 7+ years of experience as a Data Engineer