Data Engineer - Spectraforce Technologies : Job Details

Data Engineer6 months with the possibility of an extension Work Type: REMOTE (EST hours)Note: There is an On Call Rotation to cover Production Support coverage (target rotation is every 4-6 weeks, for one full week), depending on staffing availability while working remotely, candidates should have reliable high-speed internet and end client will provide an Azure Virtual Desktop. The Client Developer Virtual Desktop Infrastructure allows entitled users to access a virtual computer asset to complete tasks and processes relative to their role and responsibilities. Candidate needs to have a Windows laptop/desktop to log into their assigned Client Virtual Desktop. This PC must have a currently supported operating system, which is regularly patched, and has updated commercial anti-malware software. To efficiently do the work, an additional monitor, camera, and a headset are required.Technical Skills and Qualifications:

• Years of Experience: 3+ years of professional experience
• Education Level: 4-Year Bachelor's Degree

Must have:

• Google Pub/Sub
• BigQuery
• Google Dataform
• Data ingestion to Big Query experience
• Google Cloud Storage
• Cloud Composer
• GitHub
• SQL

Good to have:

• Cloud Data fusion
• DBMS connectivity and interaction experience (SQL Server, DB2, Oracle)
• Experience calling RESTful API's and SOAP Webservices
• Experience integrating with other Google resources, databases, and services
• Jira
• Confluence

Position Purpose: Implements simple to complex data ingestion and pipeline processes on Google Cloud Platform using industry-standard best practices. Designs, develops, configures, tests, debugs, and documents these processes based on business requirements and technical architecture specifications. Supports and troubleshoots existing ingestion and pipeline processes and data.Responsibilities:

• Design and implement Data ingestion and pipeline workflows as per business needs and technical specifications.
• Works independently and collaboratively with team; keeping the project team and leaders in the loop.
• Prepares detailed specifications from which data ingestion and pipeline processes are developed.
• Develops and implements technical solutions by code development and tool configuration.
• Querying databases using SQL (Structured Query Language) to extract relevant data for analysis and troubleshooting of defects/bugs.
• Responsible for the development and execution of testing and implementation plans. Can perform unit, system, integration and user acceptance testing. Documents results.
• Participates in project planning and development or assumes responsibility for a project of limited scope.
• Provides options for and estimates of possible coding.
• May be responsible for the completion of a phase of a project or small projects depending on complexity.
• Estimates and tracks time required to complete work, for project budgeting and financial tracking.
• Conducts and participates in reviews of solution designs, configurations and code.
• Provides technical expertise for project and baseline support teams.
• Adheres to security standards to comply in the handling/processing/storing of sensitive data.
• Adheres to development standards and provides development standards recommendations.
• Join an On Call Rotation to cover Production Support coverage (target rotation is every 4-6 weeks, for one full week), depending on staffing availability.