Job Description

This is an exciting opportunity to develop your data engineering skills, working at the forefront of technology within the Data, Technology and Analytics (DaTA) unit at the Competition and Markets Authority (CMA) to make a positive impact on society.

The CMA is a world-leading competition authority at the forefront of tackling pressing public policy questions, including the regulation of the biggest digital markets. Our mission is to make markets work well in the interests of consumers, businesses, and the economy.

The Data, Technology and Analytics (DaTA) unit is an established multidisciplinary team that brings together data engineers, data scientists, technologists, behavioural scientists and digital forensics and eDiscovery experts.

The data science and engineering team

As a Data Engineer in the DaTA unit, you will join an established team of around 15 data engineers and data scientists who are critical in designing and managing the CMA\'s analytical infrastructure and supporting the delivery of our most technically challenging projects.

Some of our recent work in Data Engineering includes:

• Designing pipelines featuring parallelization, workflow orchestration, data version control and MLOps to process large, complex data sources
• Securely translating large corpora of documents submitted by third parties using a containerised architecture on our cloud infrastructure
• Building end-to-end services, defined as Infrastructure as Code, to run jobs, including web scraping at scale and regular ML prediction on large datasets

The role

Your responsibilities will span the entire tech stack, with an emphasis on backend and infrastructure development, data orchestration and handling. This will include:

• Contributing to the data engineering elements of projects
• Helping to deliver new services, pipelines and data driven tools within our cloud platform
• Supporting the development and maintenance of our cloud-hosted analytics platform (JupyterHub, AWS EC2s) and existing services through Infrastructure as Code (AWS CDK)
• Producing high quality code in Python (and other languages, as needed)
• Assisting in developing architectural design and functional specifications
• Engaging with internal stakeholders to make sure we\'re building the most impactful tools possible for the CMA

You will be given time and support for study and development and will be expected to spend most of your time working on hands-on technical work.

What we\'re looking for

An undergraduate degree in a quantitative subject OR equivalent experience of working in data engineering, data science or development is essential.

You will need some knowledge of software development and data engineering best practices, as well as experience of coding in Python to work with large and messy datasets. Experience of using cloud services such as AWS would be ideal but is not essential.

An interest in learning about and understanding the latest methods and technologies within machine learning and data engineering is equally important.

We are looking for potential as much as experience, so if this role sounds exciting to you, please do apply.

What we can offer you

The CMA is a hugely diverse, rewarding and stimulating place to work - an opportunity to work for the public good and to stretch and develop yourself in doing so. We offer generous benefits, including an excellent pension scheme with an average employer contribution of 27%, at least 25 days leave (increasing to 30 over five years), and generous maternity/ paternity leave provision. You can also take advantage of interest-free season ticket loans, a cycle to work scheme, our employee assistance programme, and our extensive flexible working options.

To find out more about this opportunity and about working for the CMA, please click on the APPLY button.

The CMA, like many other organisations, operate a hybrid working model with a mix of office and home working. We believe this supports us to deliver our best work while allowing the flexibility to maintain balanced and healthy lives. Our staff work at least 50% of their time from their office location.

The CMA are an accredited Disability Confident Employer, and we are an equal opportunities employer, welcoming suitably qualified applicants from all backgrounds. We recruit by merit on the basis of fair and open competition, as outlined in the Civil Service Commission\'s recruitment principles.

Competition and Markets Authority