Databricks Data Engineer - Manager - Consulting - Location Open - EY : Job Details

Overview

Location: Anywhere in Country

At EY, we're all in to shape your future with confidence. We'll help you succeed in a globally connected powerhouse of diverse teams and take your career wherever you want it to go. Join EY and help to build a better working world.

Technology – Data and Decision Science – Data Engineering – Manager

We are looking for a dynamic and experienced Manager of Data Engineering to lead our team in designing and implementing complex cloud analytics solutions with a strong focus on Databricks. The ideal candidate will possess deep technical expertise in data architecture, cloud technologies, and analytics, along with exceptional leadership and client management skills.

The opportunity

In this role, you will design and build analytics solutions that deliver significant business value. You will collaborate with other data and analytics professionals, management, and stakeholders to ensure that business requirements are translated into effective technical solutions.

Responsibilities

• Understanding and analyzing business requirements to translate them into technical requirements.
• Designing, building, and operating scalable data architecture and modeling solutions.
• Staying up to date with the latest trends and emerging technologies to maintain a competitive edge.
• Leading workstream delivery and ensuring quality in all processes.
• Engaging with clients on a daily basis, actively participating in working sessions, and identifying opportunities for additional services.
• Implementing resource plans and budgets while managing engagement economics.

Travel may be required regularly based on client needs.

Skills and attributes for success

• Lead the design and development of scalable data engineering solutions using Databricks on cloud platforms (e.g., AWS, Azure, GCP).
• Oversee the architecture of complex cloud analytics solutions, ensuring alignment with business objectives and best practices.
• Manage and mentor a team of data engineers, fostering a culture of innovation, collaboration, and continuous improvement.
• Collaborate with clients to understand their analytics needs and deliver tailored solutions that drive business value.
• Ensure the quality, integrity, and security of data throughout the data lifecycle, implementing data governance best practices.
• Drive end-to-end data pipeline development, including data ingestion, transformation, and storage, leveraging Databricks and other cloud services.
• Communicate effectively with stakeholders, including technical and non-technical audiences, to convey complex data concepts and project progress.
• Manage client relationships and expectations, ensuring high levels of satisfaction and engagement.
• Stay abreast of the latest trends and technologies in data engineering, cloud computing, and analytics.
• Strong analytical and problem-solving abilities.
• Excellent communication skills with the ability to convey complex information clearly.
• Proven experience in managing and delivering projects effectively.
• Ability to build and manage relationships with clients and stakeholders.

Qualifications

• Bachelor's degree in computer science, Engineering, or a related field required; Master's degree preferred.
• Typically, 4 - 6 years of relevant experience in data engineering, with a focus on cloud data solutions and analytics.
• Proven expertise in Databricks and experience with Spark for big data processing.
• Strong background in data architecture and design, with experience in building complex cloud analytics solutions.
• Experience in leading and managing teams, with a focus on mentoring and developing talent.
• Strong programming skills in Python, Scala, or SQL.
• Excellent problem-solving skills and the ability to work independently and as part of a team.
• Strong communication and interpersonal skills, with a focus on client management.

Expertise for managerial role

• Strategic Leadership
• Project Management
• Stakeholder Engagement
• Change Management
• Risk Management
• Technical Leadership
• Documentation and Reporting

Large-scale implementation programs

• Enterprise Data Lake Implementation: Led the design and deployment of a cloud-based data lake solution for a Fortune 500 retail client, integrating data from multiple sources to enable advanced analytics and reporting capabilities.
• Real-Time Analytics Platform: Managed the development of a real-time analytics platform using Databricks for a financial services organization, enabling real-time fraud detection and risk assessment through streaming data ingestion and processing.
• Data Warehouse Modernization: Oversaw the modernization of a legacy data warehouse to a cloud-native architecture for a healthcare provider, implementing ETL processes with Databricks and improving data accessibility for analytics and reporting.

Ideally, you'll also have

• Experience with advanced data analytics tools and techniques.
• Familiarity with machine learning concepts and applications.
• Knowledge of industry trends and best practices in data engineering.
• Familiarity with cloud platforms (AWS, Azure, GCP) and their data services.
• Knowledge of data governance and compliance standards.
• Experience with machine learning frameworks and tools.

What we offer

We offer a comprehensive compensation and benefits package with a competitive base salary and a flexible, hybrid work model. EY focuses on high-ethical standards and integrity and is committed to equal employment opportunities for all applicants and employees.

#J-18808-Ljbffr