Job DescriptionJob Title: Senior Data Engineer - Big Data & CloudLocation: Chandler, AZ (Hybrid - 3 days onsite) Duration: 24-month contract Pay: $54/hr W2 ONLY, NO C2C Overview: We are seeking a proactive and highly skilled Senior Data Engineer to join our team as part of a pilot program. This role is focused on building robust, scalable data pipelines using a modern big data tech stack, ensuring efficient data modeling, transformation, and integration. The ideal candidate will be self-driven, accountable, and able to troubleshoot complex data engineering challenges without waiting for direction. Responsibilities:
- Design, model, and build data pipelines using Hadoop, Hive, PySpark, and Python.
- Integrate and manage data within Amazon AWS S3, including security and data service integration.
- Design and implement database models (MySQL or similar relational databases).
- Develop and maintain job schedules using Autosys.
- Build data visualizations and reporting dashboards using PowerBI and Dremio.
- Write and optimize Unix/Shell scripts.
- Support CI/CD pipeline development and deployment processes.
- Troubleshoot and resolve data pipeline and transformation issues.
- Collaborate cross-functionally to ensure data solutions align with business needs.
- Apply automation and optimization to data processes for improved efficiency.
Required Qualifications:
- Minimum 4 years of hands-on experience in data engineering.
- Strong expertise in big data tools (Hadoop, Hive, PySpark, Python).
- Solid understanding of AWS S3 object storage, security, and integrations.
- Proficiency in database design and data modeling.
- Proven experience with Autosys job scheduling.
- Experience with data visualization tools such as PowerBI and Dremio.
- Proficiency in Unix/Shell scripting and CI/CD pipelines.
- Strong problem-solving skills and ability to work independently with minimal supervision.
Preferred Qualifications:
- Exposure to Google Cloud Platform (GCP) data engineering.
- Financial services industry experience or domain knowledge.
What We're Looking For:
- A self-starter who proactively identifies problems and drives solutions.
- A team player who is accountable for deliverables and timelines.
- Strong communicator capable of explaining technical concepts to technical and non-technical audiences.
- Someone who thrives in a fast-paced, evolving environment.