Hi There,
Role: Data Engineer
Location: Boston, MA (Weekly 4 days Onsite)
Duration: Contract
Job Description:
- At least 6+ years of relevant experience in design, development, complete end-end design of enterprise-wide big data solution.
- Experience in designing & developing a big data solution using Spark, Scala, AWS Glue, Lambda, SNS/SQS, Cloudwatch is a must.
- Strong Application development experience in Scala/Python.
- Strong Database SQL experience, preferably Redshift.
- Experience in Snowflake is an added advantage.
- Experience with ETL/ELT process and frameworks is a must.
- Create integration and application technical design documentation.
- Conduct peer-reviews of functional design documentation.
- Complete development, configuration, test cases and unit testing
- Perform code reviews and ensure standards are applied to each solution component.
- Resolve complex defects during testing phases and identify root causes.
- Support and execute performance testing.
- Familiar with Git repo and CI/CD deployment process
- Production Support: Assist in troubleshooting production environment and tuning environments.
- Ensure best practices are followed from a technical perspective during all phases of the project.