Senior Data Engineer

Job summary

About Us

We help the UK move forward, faster.

For nearly 150 years, we've protected the UK economy with deep expertise and rigour, building the confidence that helps businesses access lending, investment and opportunity.

We help people deal with personal insolvency. We make statutory redundancy payments when insolvent employers can't. We investigate director conduct and take action where it's needed.

And right now, we're changing how we do all of this, becoming faster, more digitally driven, and more focused on stopping problems before they escalate.

More than 2,000 of us work in offices across England, Scotland and Wales. It might be time for you to join us.

The Role

We're looking for a Senior Data Engineer who wants more than a job that ticks boxes.

As a Senior Data Engineer, you will lead the development and governance of our enterprise architecture, helping the Insolvency Service align its technology with organisational strategy, digital transformation and secure-by-design principles. Your work will support long-term capability, operational resilience and value for money.This supports creating a modern, sustainable Insolvency Service by aligning technology decisions with our long-term organisational needs.

This is a role for someone who wants to think bigger, challenge the way things have always been done, and take ownership of the outcomes that matter.

We offer full-time, part-time, job share, and flexible working. We invest in your development and give our people the space to grow, take ownership and make decisions.

Job description

Reporting to the Head of Data & Technology, you will join the team, helping turn organisational data into trusted information.You will work across Microsoft Fabric, OneLake and other organisational systems to develop secure, appropriately governed data solutions. This will include integrating information from sources such as Dynamics 365, Dataverse and Azure services to support analytics, reporting and AI.Working with technical teams, third-party suppliers, data scientists and analysts, you will translate data requirements into robust engineering solutions. You will also provide technical leadership, support other engineers and act as an escalation point for complex data engineering and pipeline issues.Responsibilities

You'll use your judgement and expertise to:

• design, develop and maintain complex data ingestion, transformation and integration pipelines using Microsoft Fabric, OneLake and organisational data sources
• develop reusable engineering components, trusted datasets and data products to support analytics, reporting, Azure AI and machine-learning workloads
• implement validation, reconciliation and quality controls, ensuring that data solutions meet agreed lineage, metadata, governance and security standards
• implement CI/CD, automated testing and DataOps practices, optimising pipelines for performance, scalability, resilience and cost
• monitor and troubleshoot data pipelines, lead root-cause analysis and work with development security operations (DevSecOps), artificial intelligence operations (AIOps) and Application Support to improve operational reliability
• work with data scientists, analysts, delivery teams and suppliers to translate requirements into robust solutions, supported by appropriate documentation and recovery procedures
• provide technical leadership and management support to other engineers through mentoring, peer review and technical assurance, contributing to engineering standards and continuous improvement.

Person specification

We're looking for someone who can:

• apply strong data engineering knowledge to complex technical problems
• diagnose underlying issues and develop effective, sustainable solutions
• maintain high standards of data quality, engineering quality and operational reliability
• build effective working relationships with technical teams, suppliers, analysts and service stakeholders
• identify opportunities to improve data pipelines, automation and platform performance.

Essential criteria

As the successful candidate you will have:

• strong professional experience in data engineering
• advanced structured query language (SQL), data modelling and transformation skills
• experience with Microsoft Fabric, OneLake and/or Azure data services
• experience integrating transactional systems with analytical platforms
• a strong understanding of data quality, governance and lineage
• experience developing and operating complex data pipelines
• experience with continuous integration/continuous deployment (CI/CD), data operations (DataOps) and automated testing
• strong troubleshooting and root-cause analysis skills
• experience working across technical teams and third-party suppliers
• the ability to mentor and provide technical leadership to other engineers.

Further Information

Please note: This vacancy is advertised across 11 locations; however, Stratford and Croydon are only available to current Insolvency Service Staff. The advertised salary includes London weighting, which is only applicable to internal candidates.

The successful candidates will be required to meet nationality and residency requirements so that National Security Vetting (NSV) checks can be conducted. If you want to learn more, visit United Kingdom Security Vetting: Applicant - GOV.UK (www.gov.uk)

Behaviours

We'll assess you against these behaviours during the selection process:

• Delivering at Pace
• Communicating and Influencing
• Making Effective Decisions

Benefits

Alongside your salary of £48,429, Insolvency Service contributes £14,029 towards you being a member of the Civil Service Defined Benefit Pension scheme. Find out what benefits a Civil Service Pension provides (opens in a new window).

We want you to have a good work-life balance and want to support you in all that you do, so we offer a great benefits package including:

• flexible working arrangements and flexi-time
• full time new entrants to the Civil Service and those Civil Servants on modernised terms and conditions will be entitled to 25 days leave increasing on a sliding scale to 30 days after 5 years’ service
• in addition to this you are entitled to 8 public/bank holidays plus an additional day of privilege leave
• competitive maternity, paternity and parental leave
• 5 days paid leave for learning and development
• 5 days paid for volunteering
• a Cycle to work scheme
• staff have access to an employee assistance programme, Workplace Wellness, for confidential, independent support and advice during difficult times in either their professional or personal life

Your pension is a valuable part of your total reward package where the employer makes a significant contribution to the cost of your pension. Your contributions come out of your salary before any tax is taken. This means, if you pay tax, your take-home pay will not be reduced by the full amount of your contribution; and your pension will continue to provide valuable benefits for you and your family if you are too ill to continue to work or die before you retire. For more information, visit