Senior Data Engineer - hackajob : Job Details

hackajob is a matching platform partnering with multiple companies helping them to hire the best talent and build the future. To get the chance to get matched to this role and other similar roles, set up your free hackajob profile.Company descriptionOur client empowers public sector organisations to deliver award-winning services for citizens and they need passionate people to help them. They want to positively impact the future of the country by using technology to improve society, for everyone. They are already working with brilliant public servants to modernise technology and accelerate digital delivery. But they know they can do more to help those who share their vision. Use your skills to transform our society - join them in delivering technology that positively impacts the future of the UK.

Role: Senior Data Engineer

Your role

Define, shape and perfect data strategies in central and local governmentHelp public sector teams understand the value of their data, and make the most of itEstablish yourself as a trusted advisor in data driven approaches using public cloud services like AWS, Azure and GCPAs employee growth is a huge focus here, they would expect you to contribute to their recruitment efforts and take on line management responsibilities

What skills and experience are they looking for?

They are looking for candidates with a range of skills and experience, please apply even if you don’t meet all the criteria as if unsuccessful they can provide you with feedback.

Enthusiasm for learning and self-developmentProficiency in Git (inc. Github Actions) and able to explain the benefits of different branch strategiesGathering and meeting the requirements of both clients and users on a data projectStrong experience in IaC and able to guide how one could deploy infrastructure into different environmentsOwning the cloud infrastructure underpinning data systems through a DevOps approachKnowledge of handling and transforming various data types (JSON, CSV, etc) with Apache Spark, Databricks or HadoopGood understanding of the possible architectures involved in modern data system design (e.g. Data Warehouse, Data Lakes and Data Meshes) and the different use cases for themAbility to create data pipelines on a cloud environment and integrate error handling within these pipelines. With an understanding how to create reusable libraries to encourage uniformity of approach across multiple data pipelines.Able to document and present an end-to-end diagram to explain a data processing system on a cloud environment, with some knowledge of how you would present diagrams (C4, UMLetc.)To provide guidance how one would implement a robust DevOps approach in a data project. Also would be able to talk about tools needed for DataOps in areas such as orchestration, data integration and data analytics.Experience in improving resilience into a project by checking for software vulnerabilities and implement appropriate testing strategies (unit, integration, data quality etc.)Knowledge of SOLID, DRY and TDD principles and how to practically implement these into a project.Agile practices such as Scrum, XP, and/or KanbanDesigning and implementing efficient data transformation processes at scale, both in batch and streaming use casesOwning the cloud infrastructure underpinning data systems through a DevOps approachAgile practices such as Scrum, XP, and/or KanbanPeople skills such as mentoring, supportive team player and performing line management dutiesTo be able to demonstrate a commercial mindset when on projects to grow accounts organically with senior stakeholders

Desirable experience

Experience in the following things isn’t essential, but it’s highly desirable!

Working at a technology consultancyWorking with Docker and virtual environments as part of the development and CI/CD process.Working with senior stakeholders to gather requirements and keep them engaged withExperience in working with a team of engineers using a variety of techniques such as pair programming or mob programming.Working with data scientists to productionise advanced data deliverables, such as machine learning modelsWorking knowledge of statisticsWorking with multidisciplinary digital and technology teamsWorking within the public sectorWorking with data scientists to productionise advanced data deliverables, such as machine learning models

Benefits

They are always listening to their growing teams and evolving the benefits available to their people. As they scale, as do their benefits and they are scaling quickly. They've recently introduced a flexible benefit platform which includes a Smart Tech scheme, Cycle to work scheme, and an individual benefits allowance which you can invest in a Health care cash plan or Pension plan. They're also big on connection and have an optional social and wellbeing calendar of events for all employees to join should they choose to.

Here are some of their most popular benefits listed below:

?? 30 days Holiday - they offer 30 days of paid annual leave???Flexible Working Hours - they are flexible with what hours you work??Flexible Parental Leave - they offer flexible parental leave options????? Remote Working - they offer part time remote working for all their staff?? Paid counselling - they offer paid counselling as well as financial and legal advice.Please click on the link and create a free hackajob profile in order to get the chance to be matched with this role and many more.