Fully On-Site | Permanent
Note: Candidates must hold active DV (Developed Vetting) security clearance. This is a fully on-site role.
The Role
We’re seeking a detail-oriented, analytical Senior Data Engineer to join a high-performing multi-disciplinary data team. You’ll be essential to building and maintaining robust data pipelines and bespoke applications, ensuring data-driven projects deliver against demanding customer timelines and requirements.
Core Responsibilities
Pipeline Engineering:
p]:pt-0 [&>p]:mb-2 [&>p]:my-0’>
Design, manage, and optimise data ingestion pipelines and orchestration workflows
p]:pt-0 [&>p]:mb-2 [&>p]:my-0’>
Develop and maintain end-to-end bespoke data projects from requirements to production
p]:pt-0 [&>p]:mb-2 [&>p]:my-0’>
Monitor system performance and ensure high uptime across Linux-based infrastructure
p]:pt-0 [&>p]:mb-2 [&>p]:my-0’>
Collaborate closely with data scientists, analysts, product owners, and engineering teams
Technical Delivery:
p]:pt-0 [&>p]:mb-2 [&>p]:my-0’>
Implement scalable data processing solutions handling complex, high-volume datasets
p]:pt-0 [&>p]:mb-2 [&>p]:my-0’>
Drive continuous improvement in pipeline reliability, performance, and observability
p]:pt-0 [&>p]:mb-2 [&>p]:my-0’>
Support cross-functional delivery of mission-critical intelligence platforms
What We’re Looking For
Core Technical Expertise:
p]:pt-0 [&>p]:mb-2 [&>p]:my-0’>
Strong Python proficiency for data engineering and pipeline development
p]:pt-0 [&>p]:mb-2 [&>p]:my-0’>
Linux systems administration and performance optimisation experience
p]:pt-0 [&>p]:mb-2 [&>p]:my-0’>
Hands-on with Python orchestration frameworks (Dagster, Apache Airflow)
Cloud & Infrastructure:
p]:pt-0 [&>p]:mb-2 [&>p]:my-0’>
Serverless AWS experience (Lambda, Step Functions, Athena, Glue)
p]:pt-0 [&>p]:mb-2 [&>p]:my-0’>
Docker containerisation - building/maintaining production-grade containers
p]:pt-0 [&>p]:mb-2 [&>p]:my-0’>
Kubernetes familiarity for container orchestration and scaling
Security & Compliance:
p]:pt-0 [&>p]:mb-2 [&>p]:my-0’>
Knowledge of security, encryption, and compliance standards for secure networks
p]:pt-0 [&>p]:mb-2 [&>p]:my-0’>
Experience delivering data platforms in high-security environments