Senior Software Engineer - Data Lake - Software Resources : Job Details

Software Resources has an immediate job opportunity for a Senior Software Engineer - Data Lake with a major corporation in New York City. 2 days per week on-site. Duration: 9+ month(s) Pay Rate: $90 - $97/hr DOE Must Haves: Experience with Databricks, as well as migration(s) is required. Terraform experience is required. Knowledge and experience with Scala and Python are highly preferred as well. Summary: We are looking for a Senior Software Engineer to help us grow the data platform. You will be embedded on the Orchestration Platform team that runs workflow scheduling applications and data ingestion infrastructure that helps power the analytics, operations, and data science behind our flagship streaming applications. You'll get to understand the challenges of facilitating a high-quality, flawless media streaming experience across mobile, connected devices, and web, all while using the latest technologies available from AWS and beyond. Responsibilities: We are looking for a Senior Software Engineer to help us grow the data platform. The selected will be embedded in the Compute team that runs the Data Lake platform that helps power the analytics, operations, and data science behind our flagship streaming applications. The selected will get to understand the challenges of how data is being used at our world-class streaming services while pushing the boundaries of what is possible using the latest technologies available in AWS, Databricks, and beyond. Responsibilities: Be a key player in a cross-functional team of engineers who build software for a large-scale data processing ecosystem, supporting real-time and batch data pipelines for analytics, data science, and operations. • Maintain software engineering and architecture best practices and standards within the team and wider organization, along with a culture of quality, innovation, and experimentation • Evangelize and evolve the platform, best-practices, data driven decisions; identify new use cases and features and drive adoption • Be a part of the magic (partner) for countless teams as they use the Data Lake platform, helping architect and solution for success Basic Qualifications: Experience deploying and running cloud-based applications (preferably AWS), utilizing infrastructure-as-code frameworks like Terraform • Experience with Databricks or Spark • Experience with Python and/or Scala • Ability to dive deep into any technical component as well as understand the overall systems architecture • You care deeply about craftsmanship in your software, and can work backwards from the customer experience • You have excellent written and verbal communication skills Preferred Qualifications: Knowledge of Data Engineering practices and tools, such as Spark, Snowflake, ETL concepts, etc. Required Education: STEM BA Degree + 5 years relevant experience bout Software Resources Software Resources, founded more than 3 decades ago, is a trusted staffing partner specializing in Technology (IT, Creative, & Marketing), Finance, & Accounting placements. We work with companies nationwide that need skilled professionals and connect them with candidates like you looking for the right opportunity. We are always looking for professionals at all experience levels and in various specialties to meet our clients' hiring needs. As a member of our team, you will have access to benefits including medical, dental, and vision coverage, a 401(k) with company match, short-term disability, life insurance with AD&D. If this position fits interests you, we encourage you to apply. You can view all our job openings at Software Resources Careers.