Software Engineer - Piper Companies : Job Details

Zachary Piper Solutions is seeking a Software Engineer HYBRID in Elkridge, MD Responsibilities of the Software Engineer include:

• Serve as a Databricks subject matter expert, leveraging its full suite of tools to build, deploy, and manage scalable data and AI solutions.
• Design, develop, and maintain ETL pipelines using Databricks, Spark, Delta Lake, Delta Live Tables, and Databricks Workflows.
• Transform and ingest data from external systems using protocols such as HTML and SFTP.
• Collaborate with developers and external teams to validate data ingestion and integration processes.
• Enhance the ETL platform with reusable components and automation to reduce integration timelines.
• Ensure high data quality, performance, and reliability across large-scale datasets.
• Provide detailed documentation of system architecture, development processes, and enhancements.

Qualifications for the Software Engineer include:

• Proven experience with Databricks for data engineering and integration.
• Strong proficiency in Spark, Python, and SQL.
• Hands-on experience with Delta Lake, Delta Live Tables, and Databricks Workflows.
• Familiarity with cloud platforms such as AWS, Azure, etc.
• TS/SCI with CI Polygraph

Compensation for the Software Engineer include: • Salary: $150,000-$210,000 Depending on Experience and Education Level • Comprehensive Benefits: Medical, Dental, Vision, 401K, PTO, Sick Leave as required by law, and Holidays This job opens for applications on 6/30/25. Applications for this job will be accepted for at least 30 days from the posting date Keywords: Databricks, Apache Spark, Delta Lake, Delta Live Tables, Databricks Workflows, ETL Pipelines, Data Integration, Data Engineering, Data Transformation, Big Data, Python, SQL, SFTP, HTML, Cloud Platforms, AWS, Azure, IC ITE, TS/SCI, CI Polygraph, Clearance Required, Secure Data Ingestion, Government Data Systems, Advana, Databricks Runtime, Databricks SQL, Databricks Notebooks, Databricks Repos, Git, Version Control, Collaboration, Documentation, System Architecture, Cross-functional Teams, Data Validation, Agile Development, Feature Enhancement, Automation