Lead Data Engineer (Cloud)

Descripción del puesto:

Job Title: Lead Data Engineer (Cloud)
Location: Preston, Yeovil, Portsmouth, Glasgow or Frimley - We offer a range of hybrid and flexible working arrangements - please speak to your recruiter about the options for this particular role
Salary: Competitive
Who we are:
Join BAE Systems and you'll be part of something bigger. As a valued member of our global colleague network, you'll bring your unique skills and perspectives to help pioneer progress and protect what matters most. You'll be trusted to play your part in delivering the advanced, technology-led defence, aerospace and security solutions of tomorrow, shaping a safer future, for all of us.
From the depths of the ocean, to the far reaches of space, there's no limit to where a career at BAE Systems could take you.
Job Description:
The role focuses on building and operating scalable ingestion pipelines within a modern lakehouse environment. It involves developing Spark transformation jobs and reusable pipeline patterns to support consistent, high-quality data processing. The position orchestrates end-to-end workflows in Airflow, progressing datasets through raw, bronze, silver, and gold layers. It also implements manifest-driven transformations using JSON configurations stored in MongoDB or CosmosDB. Responsibilities include maintaining and optimising Delta Lake tables while troubleshooting reliability and performance issues to ensure resilient, efficient, and well-governed data pipelines.

What you'll be doing:
* Building and operating ingestion pipelines into the lakehouse
* Developing Spark transformation jobs and reusable pipeline patterns
* Orchestrating workflows in Airflow (raw > bronze > silver > gold)
* Implementing manifest-driven transformation using JSON configuration stored in MongoDB or CosmosDB
* Maintaining Delta Lake tables and trouble shoot pipeline reliability/performance

Your skills and experiences:
* You will have deep understanding of modern data engineering principles, data lifecycle, and enterprise-scale architecture
* You will have extensive knowledge of data governance, metadata management, and quality frameworks, with ability to enforce standards
* You will have extensive experience managing and scaling data across hybrid environments (on-prem and cloud), particularly Azure and Databricks

Benefits:
As well as a competitive pension scheme, BAE Systems also offers employee share plans, an extensive range of flexible discounted health, wellbeing and lifestyle benefits, including a green car scheme, private health plans and shopping discounts - you may also be eligible for an annual incentive.
The Data team:
This is an opportunity to join a new part of the business, undertaking a new piece of work, introducing new technology into the wider BAE Business. Joining from the ground up, this is a chance to make your mark and the role your own. This role will provide the opportunity to grow the role & your responsibility into a wider scope or even specialise within a specific area.
Why BAE Systems?
This is a place where you'll be able to make a real difference. You'll be part of an inclusive culture that values diversity of thought, rewards integrity, and merit, and where you'll be empowered to fulfil your potential. We welcome people from all backgrounds and want to make sure that our recruitment processes are as inclusive as possible. If you have a disability or health condition (for example dyslexia, autism, an anxiety disorder etc.) that may affect your performance in certain assessment types, please speak to your recruiter about potential reasonable adjustments.
Please be aware that many roles at BAE Systems are subject to both security and export control restrictions. These restrictions mean that factors such as your nationality, any nationalities you may have previously held, and your place of birth can restrict the roles you are eligible to perform within the organisation. All applicants must as a minimum achieve Baseline Personnel Security Standard. Many roles also require higher levels of National Security Vetting where applicants must typically have 5 to 10 years of continuous residency in the UK depending on the vetting level required for the role, to allow for meaningful security vetting checks.
Closing Date: 6th May 2026
We reserve the right to close this vacancy early if we receive sufficient applications for the role. Therefore, if you are interested, please submit your application as early as possible.
#LI-NP1
#LI-Hybrid