Data Engineer (AI) - Until end of April - Inside IR35 - Remote

Lead Data Engineer

Location: Remote
Contract: Until 30/04/2027
IR35: In Scope
Rate: Up to £990/day U

The Role

We’re looking for an experienced Lead Data Engineer to support the delivery of enterprise-scale AI and data initiatives within a large public sector environment.

You’ll lead the design and implementation of complex data integration solutions, building secure, scalable data pipelines and enabling advanced AI-driven capabilities. Working across technical and business teams, you’ll help transform operational data into production-ready solutions while ensuring alignment with wider data architecture, governance, and security standards.

Key Responsibilities

• Lead the design and delivery of automated data pipelines, ETL/ELT processes, and API integrations.
• Establish data engineering standards and best practices across AI and automation initiatives.
• Ensure data quality, security, access controls, and compliance requirements are embedded within solutions.
• Conduct data diagnostics and readiness assessments to support AI and automation use cases.
• Build and maintain metadata, observability, and monitoring capabilities across data platforms.
• Act as a bridge between technical delivery teams and business stakeholders, translating complex requirements into effective solutions.
  

Essential Skills & Experience

• Strong hands-on experience building scalable ETL/ELT pipelines and API integrations.
• Experience supporting AI, data, or advanced analytics platforms in enterprise environments.
• Expertise in Identity & Access Management, data governance, and security controls.
• Strong understanding of UK GDPR and data compliance requirements.
• Advanced AWS, Python, and SQL skills.
• Experience with Terraform, CI/CD pipelines, automated testing, and modern engineering practices.
• Strong stakeholder management, communication, and leadership skills.
• Experience leading engineering teams and delivering complex data solutions in agile environments.
  

Please Note

Due to programme timescales and onboarding requirements, candidates must hold active SC Clearance at the point of application.