Data Engineer

Job summary

An experienced data engineer is required to join the Data Engineering team, part of the wider Data & Analytics function at Registers of Scotland. The team is responsible for developing and maintaining the RoS data warehouse, building robust data pipelines, data transformation processes and bespoke data products to support the needs of our internal and external stakeholders and customers

Job description

• Work independently and as part of a small Agile delivery team to deliver secure, robust, scalable and adaptable software solutions

• Collaborate with colleagues to deliver data integration, transformation and processing solutions through the full development lifecycle from inception to deployment

• Actively participate in team/agile events and knowledge sharing activities, contribute to improving team processes

• Collaborate closely with team members and stakeholders to ensure solutions meet user requirements

• Undertake data profiling and source system analysis across multiple subject areas

• Maintain and support existing systems and find, document and debug issues

• Create and maintain supporting technical and business documentation

• Ensure technical solutions comply with security, performance and operational standards

Person specification

Essential Criteria – Skills and Attributes for Success

Technical Experience:

We will assess you against the following Technical skills during the application and assessment process:

• Extensive working knowledge of Python programming language

• Experience using SQL and relational databases

• Experience in developing and maintaining data integration and transformation solutions using cloud tools and technology

• Experience implementing automated testing across data pipelines, integrations and transformation processes

• Experience identifying, analysing and resolving data quality issues across complex datasets

• Understanding of different data integration design patterns

• Understanding of logical and physical data modelling and database design

• Experience using version control systems to drive feature control and CI/CD in an enterprise development community

• Experience of the software development lifecycle in an Agile delivery model

• Understanding of data governance principles and their application across the data lifecycle

• Experience of delivering working software

• Experience of supporting and maintaining existing systems

Behaviours

At application stage, you will be scored against the bolded Behaviours and against all Behaviours for the assessment:

Managing a Quality Service

• implements and maintains resilient systems which successfully meet stakeholders needs. Identifies risks and resolves issues efficiently, involves colleagues and stakeholders when developing improvements

Developing self and others

• identifies capability gaps and ensures development objectives are set to address these and to enable deliver of current and future work

Delivering at Pace

• plans and delivers complex technical work across multiple priority areas while managing risk and maintaining existing services

Working Together

• works collaboratively in multidisciplinary teams, sharing knowledge and contributing to collective delivery of outcomes

Languages

Python programming language

Behaviours

We'll assess you against these behaviours during the selection process:

• Managing a Quality Service
• Developing Self and Others
• Delivering at Pace
• Working Together

Benefits

Alongside your salary of £47,590, Registers of Scotland contributes £13,786 towards you being a member of the Civil Service Defined Benefit Pension scheme. Find out what benefits a Civil Service Pension provides (opens in a new window).

• Learning and development tailored to your role
• An environment with flexible working options
• A culture encouraging inclusion and diversity
• A Civil Service pension with an employer contribution of 28.97%

Things you need to know

Artificial intelligence

Artificial intelligence can be a useful tool to support your application, however, all examples and statements provided must be truthful, factually accurate and taken directly from your own experience. Where plagiarism has been identified (presenting the ideas and experiences of others, or generated by artificial intelligence, as your own) applications may be withdrawn and internal candidates may be subject to disciplinary action. Please see our candidate guidance (opens in a new window) for more information on appropriate and inappropriate use.

Selection process details

This vacancy is using Success Profiles (opens in a new window), and will assess your Behaviours and Experience.

Stage one - Application Process

To apply, click on 'Apply now' and complete the online application form.

You will need to submit:

1. A CV outlining your career history and how you meet the Essential criteria (max 4 pages).

1. Your responses for the application questions in our application system. 1 will assess your experience and 1 will assess one of the advertised behaviours. (Max 400 words per response)

1. You will be invited for complete a technical assessment as part of your application via Hackerrank software, this will take place on the 23rd of October and you will have 3 calendar days to complete it.

Please note:

• If we receive a high volume of applications, we may complete an initial sift on Technical Experience.

• We reserve the right to invite candidates to participate in a telephone interview prior to being further assessed.

• Applications that are not accompanied by CVs will not be scored or responses over 400 words will not be considered.

• We would strongly recommend that your statement is written in the STAR format (Situation, Task, Action & Result) and suggest preparing your answers using software such as MS Word or Google Docs, and then uploading the file.

• We strongly advise you review our policy on responsible use of AI in the application process. RoS may contact you for a pre-screening call to verify your responses.

• Applications and appointments are subject to a strict merit-based assessment process, in line with the Civil Service Recruitment Principles.

Stage two – assessment

If successful at app