Make yourself visible and let companies apply to you.
Roles
Apache Airflow Jobs in London
Overview
Looking for top Apache Airflow jobs in London? Discover the latest opportunities for data engineers, ETL developers, and workflow automation specialists on Haystack. Find your next role working with Apache Airflow in the heart of London’s thriving tech scene today!
Senior Data Engineer (Big Data/ Hadoop/ Spark) (Banking)
Hays Technology
London
Remote or hybrid
Senior
£700/day - £850/day
RECENTLY POSTED
+5

Your new company Working for a renowned financial services organisation Your new role We’re looking for a Senior Data Engineer to design and deliver scalable on prem, high‑quality data solutions for low/ high-level data platforms that power analytical and business insights. This is a hands‑on role suited to someone with strong data engineering and big data expertise, ideally gained within financial services. Joining leading commodities, metals, trading, and exchange group, you will support a strategic metals initiative focused on reducing on‑prem platform costs and modernising legacy ETL processes. You’ll help design and build a new on‑prem data platform aligned to the metals strategy while developing and maintaining scalable data pipelines and analytics infrastructure. Using Hadoop, Big Data, and Spark technologies, you will ensure data quality through automated validation, monitoring, and testing. You will also enable seamless integration across data warehouses and data lakes, contributing to a robust, scalable, and resilient enterprise data ecosystem. What you’ll need to succeed Vast Data Engineering expertise with Big Data technologies. Experience designing and building on‑prem data platforms, from high‑level architecture to detailed technical design. Hands‑on experience configuring multi‑node Hadoop clusters, including resource management, security, and performance tuning. Strong Big Data engineering background using Apache Airflow, Spark, dbt, Kafka, and Hadoop ecosystem tools. Knowledge of RDBMS systems (PostgreSQL, SQL Server) and familiarity with NoSQL/distributed databases such as MongoDB. Proven delivery of streaming pipelines and real‑time data processing solutions. Improved job efficiency and reduced runtimes through Apache Spark optimisation and development. Some experience with containerisation (Docker, Kubernetes) and CI/CD pipelines. Delivered streaming pipelines and real‑time data processing solutions. Experience replacing legacy ETL tools (e.g., Informatica) with modern data engineering pipelines and platform builds. Proven background working within financial services environments. What you’ll get in return Flexible working options available. What you need to do now If you’re interested in this role, click ‘apply now’ to forward an up-to-date copy of your CV, or call us now. Hays Specialist Recruitment Limited acts as an employment agency for permanent recruitment and employment business for the supply of temporary workers. By applying for this job you accept the T&C’s, Privacy Policy and Disclaimers which can be found at (url removed)

Lead Data Engineer
83zero Ltd
London
In office
Senior
£90,000 - £100,000
RECENTLY POSTED
+1

Lead Data Engineer (with Data Analytics Background)

Location: City Of London

Employment Type: Full-time

Salary: £90,000 - £100,000k

Sector: Fintech / Payments

Overview

We are looking for a highly skilled Lead Data Engineer with a strong foundation in data analytics to join a growing team. The ideal candidate will have previously worked as a Data Analyst and since transitioned into a more engineering-focused role. You’ll help us scale our data infrastructure, design and build robust data models, and contribute directly to our data platform’s evolution.

This is a hands-on role where you’ll be expected to hit the ground running, contribute to ongoing projects with minimal hand-holding, and help us maintain (and improve) the current team’s velocity.

Key Responsibilities

Design, develop, and maintain data models to support analytical and operational use cases.
Write efficient, production-grade SQL to build data pipelines and transformations.
Develop and maintain data workflows and automation scripts in Python.
Collaborate with analysts, engineers, and stakeholders to deliver high-quality data solutions.
(Optional but highly valued) Contribute to our infrastructure as code efforts using tools like Terraform.
Work with modern data warehousing technologies such as Snowflake to ensure scalable and high-performing solutions.

Skills & Experience

5+ years of experience in data roles, ideally transitioning from Data Analyst to Data Engineer.
Proven expertise in SQL and building complex data models.
Strong proficiency in Python for data processing, ETL, and workflow automation.
Experience with cloud data platforms (Snowflake experience highly desirable).
Exposure to or experience with Terraform or similar infrastructure-as-code tools is a strong plus.
Comfortable working in fast-paced environments and able to contribute quickly without extensive onboarding.

Nice to Have

Experience with modern data stack tools (e.g., dbt, Airflow, etc.).
Understanding of CI/CD pipelines and data infrastructure automation.
Familiarity with data governance, security, and best practices in a cloud environment

Heat Pump Engineer (Commisioning)
Ernest Gordon Recruitment
Multiple locations
In office
Junior - Mid
£60,000
RECENTLY POSTED

London M25 Patch

£50,000 - £60,000 + Progression + Training + Company Benefits + No Overtime + Local Patch

Are you from a Heat Pumps, HVAC or MVHR background that wants to join a company that has seen huge success in Europe rivalling the likes of Daikin and Toshiba?

Do you want to work for a industry leading business with state of the art new suite of heat pumps that provides full training from industry experts?

This company have gone from strength to strength in the last decade due to their products being best in class and rivalling the usual go to names. They have taken huge amount of market share across Europe and are now finding the same success in the UK.

In this role you will be working the M25 patch with other inspectors, your jobs will be organised in location meaning you won’t be spending all day in traffic and be able to return home at a reasonable hour.

This business are the UK supplier of ventilation, heat recovery, and heat pump systems, providing warranty support, technical diagnostics, commissioning assistance, and product expertise to installers, developers, and end-users.

This position supports our role as the primary UK technical contact for their systems, offering advanced site-based troubleshooting and controller configuration when third-party engineers are unable to resolve issues.

THE ROLE:

  • London M25 patch shared with other inspectors
  • Carrying out diagnostics and commissioning
  • Performing airflow balancing and assisting with system commissioning
  • Diagnosing issues with controllers, heat pump components, airflow performance and ventilations issues

THE PERSON:

  • Experience in either, HVAC, MVHR, or Heat Pumps
  • London based
  • Full UK driving license

Reference: BBBH23065

Keywords: AC, HVAC, Air Con, Heat Pumps, Heat Exchange, Airflow, Testing, Field, M25, London,

If you’re interested in this role, click ‘apply now’ to forward an up-to-date copy of your CV.

We are an equal opportunities employer and welcome applications from all suitable candidates. The salary advertised is a guideline for this position. The offered renumeration will be dependent on the extent of your experience, qualifications, and skillset.

Ernest Gordon Recruitment Limited acts as an employment agency for permanent recruitment and employment business for the supply of temporary workers. By applying for this job, you accept the T&C’s, Privacy Policy and Disclaimers which can be found at our website

Data Architect
Stott & May Professional Search Limited
London
Hybrid
Mid - Senior
£550/day - £600/day
RECENTLY POSTED
+8

Job Title: Data Architect
Location: London (Hybrid - minimum 2 days per week in the office)
Day Rate: Market rate (Inside IR35)
Contract Duration: 6 months

Role Overview

We are seeking an experienced Data Architect to work with a high-performing data team, designing and delivering advanced data solutions that support the future data strategy of the organisation. You will harness modern technologies including Data Vault, Snowflake, DBT, Airflow and AWS/Azure to shape scalable, future-proof data architectures.
In this role, you will be responsible for defining, owning and governing data models across delivery teams, ensuring alignment with enterprise architecture principles and business objectives. You will collaborate closely with engineers, product managers, data scientists and the wider architecture community to design innovative, high-value data products and services.

Key Responsibilities

  • Triage new data requirements, assess their architectural impact and provide estimates for changes to data models.
  • Design, develop and enhance business and physical data models to meet evolving analytical and reporting needs.
  • Act as the custodian of data models, defining modelling standards and ensuring consistent adoption across delivery teams.
  • Create data architecture solutions that meet business needs and align with target-state architecture.
  • Document, communicate and centrally manage data models and associated artefacts.
  • Collaborate with the wider architecture community to promote alignment, reuse and innovation.
  • Apply strong expertise in data warehousing and end-to-end analytics architecture to bring structure and clarity to reporting environments.
  • Design and implement data models using methodologies such as 3NF, Dimensional and Data Vault.
  • Stay up to date with industry advancements, including machine learning and modern algorithmic techniques at scale, and embed best practice into data design.
  • Influence engineering and product teams to adopt robust data modelling and architecture standards.
  • Develop a deep understanding of business processes and the data they generate, identifying opportunities to structure and use data to drive business value.
  • Provide technical leadership and mentorship to data engineers.
  • Partner with data scientists to productionise research models on Snowflake and AWS.
  • Engage with product and business stakeholders to align data and AI solutions with enterprise strategy.

Essential Skills and Experience

  • Strong experience as a Data Architect or senior Data Modeller within complex data and analytics environments.
  • Deep expertise in data warehousing and end-to-end analytics architecture.
  • Proven experience with data modelling methodologies including 3NF, Dimensional and Data Vault.
  • Strong understanding of modern data platforms and cloud-based architectures.
  • Experience designing data solutions that incorporate machine learning or advanced analytics use cases.
  • Excellent communication and influencing skills, with the ability to engage both technical and non-technical stakeholders.
  • Strong stakeholder management and cross-functional collaboration skills.
  • Highly analytical mindset with the ability to translate business requirements into effective data architecture solutions.
  • Experience working with or supporting cloud migrations.

Languages: Python (primary), SQL, Bash
Cloud: Azure, AWS
Tools: Airflow, DBT, Docker, Fargate, FastAPI
Data Platforms: Snowflake, Delta Lake, Redis, Azure Data Lake
Infrastructure and Operations: Terraform, GitHub Actions, Azure DevOps, Grafana, Azure Monitor

Desirable Skills and Experience

  • Experience working with enterprise data platforms such as Snowflake and Azure Data Lake.
  • Experience deploying data or machine learning models as APIs using FastAPI or Azure Functions.
  • Understanding of monitoring, model performance tracking and observability best practices.
  • Familiarity with orchestration tools such as Airflow or Azure Data Factory.
Senior Data Engineer (DV Cleared)
IO Associates
London
In office
Senior
Private salary
RECENTLY POSTED
+1

Fully On-Site | Permanent Note : Candidates must hold active DV (Developed Vetting) security clearance . This is a fully on-site role. The Role We’re seeking a detail-oriented, analytical Senior Data Engineer to join a high-performing multi-disciplinary data team. You’ll be essential to building and maintaining robust data pipelines and bespoke applications, ensuring data-driven projects deliver against demanding customer timelines and requirements. Core Responsibilities Pipeline Engineering : p]:pt-0 [&>p]:mb-2 [&>p]:my-0’> Design, manage, and optimise data ingestion pipelines and orchestration workflows p]:pt-0 [&>p]:mb-2 [&>p]:my-0’> Develop and maintain end-to-end bespoke data projects from requirements to production p]:pt-0 [&>p]:mb-2 [&>p]:my-0’> Monitor system performance and ensure high uptime across Linux-based infrastructure p]:pt-0 [&>p]:mb-2 [&>p]:my-0’> Collaborate closely with data scientists, analysts, product owners, and engineering teams Technical Delivery : p]:pt-0 [&>p]:mb-2 [&>p]:my-0’> Implement scalable data processing solutions handling complex, high-volume datasets p]:pt-0 [&>p]:mb-2 [&>p]:my-0’> Drive continuous improvement in pipeline reliability, performance, and observability p]:pt-0 [&>p]:mb-2 [&>p]:my-0’> Support cross-functional delivery of mission-critical intelligence platforms What We’re Looking For Core Technical Expertise : p]:pt-0 [&>p]:mb-2 [&>p]:my-0’> Strong Python proficiency for data engineering and pipeline development p]:pt-0 [&>p]:mb-2 [&>p]:my-0’> Linux systems administration and performance optimisation experience p]:pt-0 [&>p]:mb-2 [&>p]:my-0’> Hands-on with Python orchestration frameworks (Dagster, Apache Airflow) Cloud & Infrastructure : p]:pt-0 [&>p]:mb-2 [&>p]:my-0’> Serverless AWS experience (Lambda, Step Functions, Athena, Glue) p]:pt-0 [&>p]:mb-2 [&>p]:my-0’> Docker containerisation - building/maintaining production-grade containers p]:pt-0 [&>p]:mb-2 [&>p]:my-0’> Kubernetes familiarity for container orchestration and scaling Security & Compliance : p]:pt-0 [&>p]:mb-2 [&>p]:my-0’> Knowledge of security, encryption, and compliance standards for secure networks p]:pt-0 [&>p]:mb-2 [&>p]:my-0’> Experience delivering data platforms in high-security environments TPBN1_UKTJ

Experienced "Techno-Functional" Business Analyst (Data Transformation, Capital Markets)
Boundaryless Ltd
Multiple locations
Hybrid
Mid - Senior
Private salary
RECENTLY POSTED
+3

Company Introduction

Boundaryless is a boutique consulting firm, providing clients with deep expertise in advanced analytics & data forensics, agentic automation, and Artificial Intelligence solutions. We operate around the world, with offices in 7 countries: United Kingdom, France, The Netherlands, Switzerland, India, Sri Lanka, and the USA.

Boundaryless is an equal opportunity employer. While we apply high standards to the experts we hire and the work we deliver, we also strive for diversity. Our team is a living example of this, with 13 nationalities and 50% female employees.

Due to the growing demand from financial services organizations for automation services supporting data transformation and agentic process automation, open positions for Business Analysts who understand operational and regulatory reporting processes in (investment) banking.

Capital Markets knowledge and Finance experience are key components for this role.

Role Description

  • The Technical Data Analyst will support a data transformation and controls program for a top-tier banking client
  • Translate business requirements into technical specifications.
  • Responsible for analyzing, validating, and reconciling large-scale datasets used for operational and regulatory reporting.
  • Work across IT teams to define data requirements, quality rules, and controls for critical data elements. Facilitating the UK issue remediation process by hosting and facilitating conference calls amongst SMEs required to drive items to closure
  • Tracking, adjudication, and reporting of Data Quality issues
  • You will work with team members on topics including data profiling, lineage validation, source-to-target mapping, and root-cause analysis for data issues.
  • Produce clear documentation and evidence to support UAT sign-off, audit reviews, and control attestations.
  • Ensure traceability from data requirement transformation logic quality checks reporting outputs audit evidence.

Location

  • The role supports one of our top-tier banking clients in London (Canary Wharf) and requires a minimum of three days on-site presence.
  • This is a permanent position based in the UK. We will only consider applicants who are eligible to work in the UK. For this role do NOT offer visa sponsorship.

Experience Requirements & Qualifications

  • Minimum 5 years of relevant experience in data analytics, data quality, reporting controls, or data transformation programs (preferably in financial services).
  • Proficiency in SQL (advanced querying, performance tuning, reconciliation logic).
  • Strong proficiency in Python for data analysis and automation (pandas, data validation frameworks, scripting).
  • Experience supporting or validating ETL/ELT pipelines and data quality frameworks (rules, thresholds, exception handling).
  • Working knowledge of Autosys & Apache Airflow (monitoring schedules, reruns, failure triage).
  • Experience with CI/CD tools (Git, Harness, UrbanCode Deploy (UCD), Red Hat OpenShift).
  • Familiarity with AWS S3 for large-scale data storage and dataset movement patterns.
  • Experience supporting Tableau dashboards (data validation, extract refresh checks, reconciliation to source).

Nice-to-Have

  • Ideally, you have experience with tools including PySpark, Spark SQL, Hive, Impala, HDFS, Parquet, and Oracle databases.
  • Experience in regulated or enterprise data environments (investment banking, risk, finance, compliance).
  • Exposure to data governance concepts: critical data elements (CDEs), lineage, data quality dimensions, audit frameworks.
  • Experience working in Agile/Scrum delivery models
  • Knowledge of monitoring/alerting tools for data pipelines and batch operations.
  • Familiarity with regulatory reporting domains or control frameworks (data controls, attestations, audit readiness).
  • Familiarity with Visio, as well as DCRM tools to manage, document and monitor data quality issues

Main tasks and responsibilities

  • Conduct discovery sessions to understand reporting objectives, key datasets, and edge cases.
  • Perform data profiling and produce findings on completeness, accuracy, consistency, and timeliness.
  • Design and execute reconciliation checks (source vs target, pre vs post transformation, report vs underlying data).
  • Support creation of data requirements artifacts (data dictionaries, source-to-target mapping support, business rules, quality rules).
  • Define and maintain data quality checks, exception logs, and analysis on recurring defects.
  • Lead/Support UAT activities for reporting and controls; validate outcomes and document evidence.
  • Produce audit-ready documentation: test packs, control evidence, runbooks, and explainable results.
  • Partner with engineers to troubleshoot data issues and ensure analytical intent is preserved in implementation.
  • Track and communicate risks, dependencies, and changes impacting reporting and control outcomes.

Your application

If you feel you fit this profile, please apply via

Please send your CV as well as an overview of automation projects you have delivered.

Heat Pump Engineer (Commisioning)
Ernest Gordon Recruitment Limited
Twickenham
In office
Junior - Mid
£50,000 - £60,000
RECENTLY POSTED

London M25 Patch

£50,000 - £60,000 + Progression + Training + Company Benefits + No Overtime + Local Patch

Are you from a Heat Pumps, HVAC or MVHR background that wants to join a company that has seen huge success in Europe rivalling the likes of Daikin and Toshiba?

Do you want to work for a industry leading business with state of the art new suite of heat pumps that provides full training from industry experts?

This company have gone from strength to strength in the last decade due to their products being best in class and rivalling the usual go to names. They have taken huge amount of market share across Europe and are now finding the same success in the UK.

In this role you will be working the M25 patch with other inspectors, your jobs will be organised in location meaning you won’t be spending all day in traffic and be able to return home at a reasonable hour.

This business are the UK supplier of ventilation, heat recovery, and heat pump systems, providing warranty support, technical diagnostics, commissioning assistance, and product expertise to installers, developers, and end-users.

This position supports our role as the primary UK technical contact for their systems, offering advanced site-based troubleshooting and controller configuration when third-party engineers are unable to resolve issues.

THE ROLE:

London M25 patch shared with other inspectors
Carrying out diagnostics and commissioning
Performing airflow balancing and assisting with system commissioning
Diagnosing issues with controllers, heat pump components, airflow performance and ventilations issuesTHE PERSON:

Experience in either, HVAC, MVHR, or Heat Pumps
London based
Full UK driving licenseReference: BBBH23065

Keywords: AC, HVAC, Air Con, Heat Pumps, Heat Exchange, Airflow, Testing, Field, M25, London,

If you’re interested in this role, click ‘apply now’ to forward an up-to-date copy of your CV.

We are an equal opportunities employer and welcome applications from all suitable candidates. The salary advertised is a guideline for this position. The offered renumeration will be dependent on the extent of your experience, qualifications, and skillset.

Ernest Gordon Recruitment Limited acts as an employment agency for permanent recruitment and employment business for the supply of temporary workers. By applying for this job, you accept the T&C’s, Privacy Policy and Disclaimers which can be found at our website

Senior Design Engineer
Kodu
Sutton
Hybrid
Senior
£400/day - £450/day
RECENTLY POSTED

Senior Design Engineer (Contract)

Move fast, own work-streams, ship manufacturable products now. Based in Central London, this Senior Design Engineer contract drives next-gen indoor heated appliances at pace. Outside IR35, £400£450 per day, initial three months with scope to extend. Minimum two days on site, ASAP start, clear deliverables, hands-on labs, and direct access to decision makers.

Scope of the Role:

As the Senior Design Engineer, youll reduce risk and accelerate NPD across multicookers, ovens, and air fryers. The Senior Design Engineer leads technical workstreams, makes confident calls, and keeps iteration cycles moving.

  • Lead airflow, heating and power-stack development to design-for-production.

  • Build rigs and prototypes for rapid technical and user validation.

  • Run CAD reviews, tolerance stacks, and pragmatic risk assessments.

  • Drive DFM with suppliers, sign off documentation, and push to tooling.

  • Mentor engineers, communicate proactively, and align stakeholders on site.

Key Skills and Experience Required:

  • Proven delivery in volume consumer hardware as Senior Design Engineer, Senior Mechanical Design Engineer, or Senior Product Design Engineer.

  • Depth in airflow, heat transfer, mechanisms, sealing, motors, plastics and metals.

  • Strong DFM/DFMA, tolerance analysis, verification, VAVE and cost discipline.

  • Fast, autonomous operator who decides with partial data and owns outcomes.

  • CAD fluency in SolidWorks or Creo; confident hands-on in labs and workshops

Salary and Benefits:

  • £400£450 per day

  • Outside IR35, subject to SDS assessment

  • Initial three-month contract, scope to extend

  • Central London location, minimum two days on site

  • ASAP start

  • Quick-turn prototyping, test facilities and direct factory interfaces

  • Clear deliverables: quick CAD models, prototypes, CAD and DFM reviews, tolerance stacks, VAVE feedback

Youll join a high-iteration, low-ceremony group where decisions happen quickly and in person.

The Senior Design Engineer will be the grown-up engineer in the room, bringing judgment, speed and manufacturing realism to a capable, collaborative team tackling indoor heat NPD.

How to Apply:

Want to find out more? Click the apply button and well be in touch.

Job Type: Temporary

Contract length: 3 months

Pay: £400.00-£450.00 per day

Work Location: In person

Data Scientist
Datasource
London
In office
Mid - Senior
£550/day - £595/day
RECENTLY POSTED
+2

Our client are a medium sized defence consultancy looking for a Data Scientist to join their team. You’ll be joining a small, highly skilled technical team working on a live AI computer vision capability within a secure defence environment. The team focuses on sustaining and enhancing a production system, delivering incremental improvements and new use cases rather than experimental or research-based work. The client is specifically looking for a DV-cleared Data Scientist with strong Python skills, proven experience supporting AI or computer vision models in production, hands-on MLOps experience (MLflow, Airflow, Docker, Kubernetes), familiarity with CI/CD pipelines such as GitLab or Jenkins, and a solid understanding of data engineering concepts including ETL and scalable data pipelines. Working Patterns: This will be full time on site in London The Key Responsibilities of a Job Title: * Sustain and optimise a live AI computer vision model in a secure production environment. * Enhance existing AI capability through new features, use cases, and performance improvements. * Manage the full ML lifecycle using MLOps best practices to ensure stability and repeatability. * Deploy and update models using CI/CD pipelines while minimising risk to live systems. * Ensure all solutions meet required security, ethical, and regulatory standards. * Design and support scalable, resilient data pipelines integrated with wider platforms Below is a list of Key Skills required for the job role, however you will not be expected to have everything: * Strong Python development skills for production AI solutions. * Experience supporting AI or computer vision models in live environments. * Hands-on MLOps experience (e.g. MLflow, Airflow, Docker, Kubernetes). * Familiarity with CI/CD pipelines such as GitLab or Jenkins. * Understanding of data engineering concepts, including ETL and data pipelines. * Experience designing or working with scalable, cloud-native system architectures. Our client is committed to providing a diverse and inclusive workplace and welcomes applications from all backgrounds. Part-time opportunities/flexible working is available to suit individual needs. Please note that the client has determined that the off-payroll working rules will apply to this assignment and therefore this contract will be run through an Umbrella Company. Income tax and primary national insurance contributions will be deducted at source from any payments made to the intermediary. RECOMMEND A FRIEND: If you have professional friends/colleagues who would be interested in one of our roles and our excellent levels of service too, we’d like to recognise your recommendations with a ‘thank you’ of our own. For every friend you refer who then starts a role through Datasource either Contract or Permanent, we will send you £200 of Love to Shop Gift Vouchers & gift your friend £100 in Love to Shop Gift Vouchers as well! You will be required to hold a minimum of DV clearance. If you do not hold an active DV clearance, please familiarise yourself with the vetting process before applying. © Copyright Datasource Computer Employment Limited 2026

Senior Data Engineer
83zero Limited
London
In office
Senior
£80,000
RECENTLY POSTED
+1

Location: London

Employment Type: Full-time

Salary: £80k per annum + 10% bonus & bens

Sector: Fintech / Payments

Overview

We are looking for a skilled Senior Data Engineer with a strong foundation in data analytics to join our growing team. The ideal candidate will have previously worked as a Data Analyst and since transitioned into a more engineering-focused role. You’ll help us scale our data infrastructure, design and build robust data models, and contribute directly to our data platform’s evolution.

This is a hands-on role where you’ll be expected to hit the ground running, contribute to ongoing projects with minimal hand-holding, and help us maintain (and improve) the current team’s velocity.

Key Responsibilities

Design, develop, and maintain data models to support analytical and operational use cases.

Write efficient, production-grade SQL to build data pipelines and transformations.

Develop and maintain data workflows and automation scripts in Python .

Collaborate with analysts, engineers, and stakeholders to deliver high-quality data solutions.

(Optional but highly valued) Contribute to our infrastructure as code efforts using tools like Terraform .

Work with modern data warehousing technologies such as Snowflake to ensure scalable and high-performing solutions.

Skills & Experience

5+ years of experience in data roles, ideally transitioning from Data Analyst to Data Engineer .

Proven expertise in SQL and building complex data models.

Strong proficiency in Python for data processing, ETL, and workflow automation.

Experience with cloud data platforms (Snowflake experience highly desirable).

Exposure to or experience with Terraform or similar infrastructure-as-code tools is a strong plus.

Comfortable working in fast-paced environments and able to contribute quickly without extensive onboarding.

Nice to Have

Experience with modern data stack tools (e.g., dbt, Airflow, etc.).

Understanding of CI/CD pipelines and data infrastructure automation.

Familiarity with data governance, security, and best practices in a cloud environment.

TPBN1_UKTJ

Commissioning Engineer (Heat Pumps)
Ernest Gordon Recruitment
Hounslow
Hybrid
Junior - Mid
£60,000
RECENTLY POSTED

London M25 Patch

£50,000 - £60,000 + Progression + Training + Company Benefits + No Overtime + Local Patch

Are you from a Heat Pumps, HVAC or MVHR background that wants to join a company that has seen huge success in Europe rivalling the likes of Daikin and Toshiba?

Do you want to work for a industry leading business with state of the art new suite of heat pumps that provides full training from industry experts?

This company have gone from strength to strength in the last decade due to their products being best in class and rivalling the usual go to names. They have taken huge amount of market share across Europe and are now finding the same success in the UK.

In this role you will be working the M25 patch with other inspectors, your jobs will be organised in location meaning you won’t be spending all day in traffic and be able to return home at a reasonable hour.

This business are the UK supplier of ventilation, heat recovery, and heat pump systems, providing warranty support, technical diagnostics, commissioning assistance, and product expertise to installers, developers, and end-users.

This position supports our role as the primary UK technical contact for their systems, offering advanced site-based troubleshooting and controller configuration when third-party engineers are unable to resolve issues.

THE ROLE:

  • London M25 patch shared with other inspectors
  • Carrying out diagnostics and commissioning
  • Performing airflow balancing and assisting with system commissioning
  • Diagnosing issues with controllers, heat pump components, airflow performance and ventilations issues

THE PERSON:

  • Experience in either, HVAC, MVHR, or Heat Pumps
  • London based
  • Full UK driving license

Reference: BBBH23065

Keywords: AC, HVAC, Air Con, Heat Pumps, Heat Exchange, Airflow, Testing, Field, M25, London,

If you’re interested in this role, click ‘apply now’ to forward an up-to-date copy of your CV.

We are an equal opportunities employer and welcome applications from all suitable candidates. The salary advertised is a guideline for this position. The offered renumeration will be dependent on the extent of your experience, qualifications, and skillset.

Ernest Gordon Recruitment Limited acts as an employment agency for permanent recruitment and employment business for the supply of temporary workers. By applying for this job, you accept the T&C’s, Privacy Policy and Disclaimers which can be found at our website

Snowflake Senior Developer
Resourgenix Ltd
London
Hybrid
Senior
£375 - £450
RECENTLY POSTED
+4

Location: London (Hybrid)
Employment Type: Full-time
Seniority: Senior Individual Contributor
Reports to: Data Engineering Lead / Manager

Summary of role

We are seeking a Snowflake Senior Developer to design, develop, and optimise data solutions on our cloud data platform. You will work closely with data engineers, analysts, and architects to deliver high-quality, scalable data pipelines and models. Strong expertise in Snowflake, ETL/ELT, data modelling, and data warehousing is essential.

Responsibilities

  • Snowflake Development: Build and optimise Snowflake objects (databases, schemas, tables, views, tasks, streams, resource monitors).
  • ETL/ELT Pipelines: Develop and maintain robust data pipelines using tools like dbt, Airflow, Azure Data Factory, or similar.
  • Data Modelling: Implement dimensional models (star/snowflake schemas), handle SCDs, and design efficient structures for analytics.
  • Performance Tuning: Optimise queries, manage clustering, caching, and warehouse sizing for cost and speed.
  • Data Quality: Implement testing frameworks (dbt tests, Great Expectations) and ensure data accuracy and freshness.
  • Security & Governance: Apply RBAC, masking policies, and comply with data governance standards.
  • Collaboration: Work with BI teams to ensure semantic alignment and support self-service analytics.
  • Documentation: Maintain clear technical documentation for pipelines, models, and processes.

Qualifications

  • Matric and a Degree in IT
  • Strong SQL skills (complex queries, performance tuning) and proficiency in Python for data processing.
  • Experience with ETL/ELT tools (dbt, Airflow, ADF, Informatica, Matillion).
  • Solid understanding of data warehousing concepts (Kimball, Data Vault, normalization).
  • Familiarity with cloud platforms (Azure preferred; AWS/GCP acceptable).
  • Knowledge of data governance, security, and compliance (GDPR).
  • Excellent problem-solving and communication skills.

Skills

  • Experience with Snowpark, UDFs, dynamic tables, and external tables.
  • Exposure to streaming/CDC (Kafka, Fivetran, Debezium).
  • BI tool integration (Power BI, Tableau, Looker).
  • Certifications: SnowPro Core or Advanced.
Service Engineer (Heat Pumps)
Ernest Gordon Recruitment Limited
Multiple locations
In office
Junior - Mid
£45,000 - £50,000
RECENTLY POSTED

London M25 Patch

£45,000 - £50,000 + Progression + Training + Company Benefits

Are you from a Heat Pumps, HVAC or MVHR role that wants to join a company that has seen huge success in Europe rivalling the likes of Daikin and Toshiba?

Do you want to work for a team with fantastic staff retention, a well run and organised business that put its staffs well being at the forefront of all decision making?

This company have gone from strength to strength in the last decade due to their products being best in class and rivalling the usual go to names. They have taken huge amount of market share across Europe and are now finding the same success in the UK.

In this role you will be working the M25 patch with other inspectors, your jobs will be organised in location meaning you wont be spending all day in traffic and be able to return home at a reasonable hour.

This business are the UK supplier of ventilation, heat recovery, and heat pump systems, providing warranty support, technical diagnostics, commissioning assistance, and product expertise to installers, developers, and end-users.

This position supports our role as the primary UK technical contact for our systems, offering advanced site-based troubleshooting and controller configuration when third-party engineers are unable to resolve issues.

THE ROLE:

London M25 patch shared with other inspectors
Carrying out warranty diagnostics and repairs
Performing airflow balancing and assisting with system commissioning
Diagnosing issues with PCB’s, controllers, heat pump components, airflow performance and ventilations issuesTHE PERSON:

Experience in either, HVAC, MVHR, or Heat Pumps
London based
Full UK driving licenseReference: BBBH22805

Keywords: AC, HVAC, Air Con, Heat Pumps, Heat Exchange, Airflow, Testing, Field, M25, London,

If you’re interested in this role, click ‘apply now’ to forward an up-to-date copy of your CV.

We are an equal opportunities employer and welcome applications from all suitable candidates. The salary advertised is a guideline for this position. The offered renumeration will be dependent on the extent of your experience, qualifications, and skillset.

Ernest Gordon Recruitment Limited acts as an employment agency for permanent recruitment and employment business for the supply of temporary workers. By applying for this job, you accept the T&C’s, Privacy Policy and Disclaimers which can be found at our website

Senior Data Engineer
Lynx Recruitment Limited
London
Hybrid
Senior
£85,000
RECENTLY POSTED
+1

Are you a Data Engineer passionate about buildingscalable, cloud-first data platformsthat power business insights and innovation? Our client is seeking an experienced engineer to design robust, secure, and future-ready data solutions that support analytics, AI, and strategic decision-making.

What Youll Do:

  • Build, test, and maintainETL/ELT pipelinesfor structured and unstructured data.
  • Design and optimisedata warehouses, lakes, and cloud-native platforms.
  • Implementmonitoring, security, and compliance frameworksin line with regulations (e.g., GDPR, financial standards).
  • Deliverhigh-quality datasetsto analysts, data scientists, and business stakeholders.
  • Work with modern technologies, includingcloud platforms, orchestration tools, and streaming frameworks.

What Were Looking For:

  • StrongSQL & Pythonskills.
  • Hands-on experience withETL/ELT tools(e.g., Matillion, Talend, FiveTran, Azure Data Factory).
  • Experience designing and managingcloud data platforms(Snowflake essential; AWS/Azure/GCP desirable).
  • Soliddata modelling knowledgeand performance optimisation skills.
  • Awareness ofdata governance, security, and regulatory compliance.
  • Ability to work closely with technical and business teams to deliver impactful solutions.

Nice-to-Haves:

  • Orchestration tools (Airflow, dbt, Prefect) or streaming frameworks (Kafka, Kinesis).
  • CI/CD experience and DevOps practices for data workflows.
  • Exposure to data visualisation platforms (PowerBI, Tableau, MicroStrategy).
  • Experience in financial services or other highly regulated industries.
Senior Data Engineer
83zero Ltd
London
In office
Senior
£80,000
RECENTLY POSTED

Location: London

Employment Type: Full-time

Salary: 80k per annum + 10% bonus & bens

Sector: Fintech / Payments

Overview

We are looking for a skilled Senior Data Engineer with a strong foundation in data analytics to join our growing team. The ideal candidate will have previously worked as a Data Analyst and since transitioned into a more engineering-focused role. You’ll help us scale our data infrastructure, design and build robust data models, and contribute directly to our data platform’s evolution.

This is a hands-on role where you’ll be expected to hit the ground running, contribute to ongoing projects with minimal hand-holding, and help us maintain (and improve) the current team’s velocity.

Key Responsibilities

  • Design, develop, and maintain data models to support analytical and operational use cases.
  • Write efficient, production-grade SQL to build data pipelines and transformations.
  • Develop and maintain data workflows and automation scripts in Python.
  • Collaborate with analysts, engineers, and stakeholders to deliver high-quality data solutions.
  • (Optional but highly valued) Contribute to our infrastructure as code efforts using tools like Terraform.
  • Work with modern data warehousing technologies such as Snowflake to ensure scalable and high-performing solutions.

Skills & Experience

  • 5+ years of experience in data roles, ideally transitioning from Data Analyst to Data Engineer.
  • Proven expertise in SQL and building complex data models.
  • Strong proficiency in Python for data processing, ETL, and workflow automation.
  • Experience with cloud data platforms (Snowflake experience highly desirable).
  • Exposure to or experience with Terraform or similar infrastructure-as-code tools is a strong plus.
  • Comfortable working in fast-paced environments and able to contribute quickly without extensive onboarding.

Nice to Have

  • Experience with modern data stack tools (e.g., dbt, Airflow, etc.).
  • Understanding of CI/CD pipelines and data infrastructure automation.
  • Familiarity with data governance, security, and best practices in a cloud environment.
Experienced "Techno-Functional" Business Analyst
Boundaryless Ltd
London
Hybrid
Mid - Senior
Private salary
+3

Company Introduction

Boundaryless is a boutique consulting firm, providing clients with deep expertise in advanced analytics & data forensics, agentic automation, and Artificial Intelligence solutions. We operate around the world, with offices in 7 countries: United Kingdom, France, The Netherlands, Switzerland, India, Sri Lanka, and the USA.

Boundaryless is an equal opportunity employer. While we apply high standards to the experts we hire and the work we deliver, we also strive for diversity. Our team is a living example of this, with 13 nationalities and 50% female employees.

Due to the growing demand from financial services organizations for automation services supporting data transformation and agentic process automation, open positions for Business Analysts who understand operational and regulatory reporting processes in (investment) banking.

Capital Markets knowledge and Finance experience are key components for this role.

Role Description

  • The Technical Data Analyst will support a data transformation and controls program for a top-tier banking client
  • Translate business requirements into technical specifications.
  • Responsible for analyzing, validating, and reconciling large-scale datasets used for operational and regulatory reporting.
  • Work across IT teams to define data requirements, quality rules, and controls for critical data elements. Facilitating the UK issue remediation process by hosting and facilitating conference calls amongst SMEs required to drive items to closure
  • Tracking, adjudication, and reporting of Data Quality issues
  • You will work with team members on topics including data profiling, lineage validation, source-to-target mapping, and root-cause analysis for data issues.
  • Produce clear documentation and evidence to support UAT sign-off, audit reviews, and control attestations.
  • Ensure traceability from data requirement transformation logic quality checks reporting outputs audit evidence.

Location

  • The role supports one of our top-tier banking clients in London (Canary Wharf) and requires a minimum of three days on-site presence.
  • This is a permanent position based in the UK. We will only consider applicants who are eligible to work in the UK. For this role do NOT offer visa sponsorship.

Experience Requirements & Qualifications

  • Minimum 5 years of relevant experience in data analytics, data quality, reporting controls, or data transformation programs (preferably in financial services).
  • Proficiency in SQL (advanced querying, performance tuning, reconciliation logic).
  • Strong proficiency in Python for data analysis and automation (pandas, data validation frameworks, scripting).
  • Experience supporting or validating ETL/ELT pipelines and data quality frameworks (rules, thresholds, exception handling).
  • Working knowledge of Autosys & Apache Airflow (monitoring schedules, reruns, failure triage).
  • Experience with CI/CD tools (Git, Harness, UrbanCode Deploy (UCD), Red Hat OpenShift).
  • Familiarity with AWS S3 for large-scale data storage and dataset movement patterns.
  • Experience supporting Tableau dashboards (data validation, extract refresh checks, reconciliation to source).

Nice-to-Have

  • Ideally, you have experience with tools including PySpark, Spark SQL, Hive, Impala, HDFS, Parquet, and Oracle databases.
  • Experience in regulated or enterprise data environments (investment banking, risk, finance, compliance).
  • Exposure to data governance concepts: critical data elements (CDEs), lineage, data quality dimensions, audit frameworks.
  • Experience working in Agile/Scrum delivery models
  • Knowledge of monitoring/alerting tools for data pipelines and batch operations.
  • Familiarity with regulatory reporting domains or control frameworks (data controls, attestations, audit readiness).
  • Familiarity with Visio, as well as DCRM tools to manage, document and monitor data quality issues

Main tasks and responsibilities

  • Conduct discovery sessions to understand reporting objectives, key datasets, and edge cases.
  • Perform data profiling and produce findings on completeness, accuracy, consistency, and timeliness.
  • Design and execute reconciliation checks (source vs target, pre vs post transformation, report vs underlying data).
  • Support creation of data requirements artifacts (data dictionaries, source-to-target mapping support, business rules, quality rules).
  • Define and maintain data quality checks, exception logs, and analysis on recurring defects.
  • Lead/Support UAT activities for reporting and controls; validate outcomes and document evidence.
  • Produce audit-ready documentation: test packs, control evidence, runbooks, and explainable results.
  • Partner with engineers to troubleshoot data issues and ensure analytical intent is preserved in implementation.
  • Track and communicate risks, dependencies, and changes impacting reporting and control outcomes.

Your application

If you feel you fit this profile, please apply via

Please send your CV as well as an overview of automation projects you have delivered.

Lead Data Engineer
83zero Ltd
London
In office
Senior
£90,000 - £100,000

Lead Data Engineer (with Data Analytics Background)

Location: City Of London

Employment Type: Full-time

Salary: 90,000 - 100,000k

Sector: Fintech / Payments

Overview

We are looking for a highly skilled Lead Data Engineer with a strong foundation in data analytics to join a growing team. The ideal candidate will have previously worked as a Data Analyst and since transitioned into a more engineering-focused role. You’ll help us scale our data infrastructure, design and build robust data models, and contribute directly to our data platform’s evolution.

This is a hands-on role where you’ll be expected to hit the ground running, contribute to ongoing projects with minimal hand-holding, and help us maintain (and improve) the current team’s velocity.

Key Responsibilities

  • Design, develop, and maintain data models to support analytical and operational use cases.
  • Write efficient, production-grade SQL to build data pipelines and transformations.
  • Develop and maintain data workflows and automation scripts in Python.
  • Collaborate with analysts, engineers, and stakeholders to deliver high-quality data solutions.
  • (Optional but highly valued) Contribute to our infrastructure as code efforts using tools like Terraform.
  • Work with modern data warehousing technologies such as Snowflake to ensure scalable and high-performing solutions.

Skills & Experience

  • 5+ years of experience in data roles, ideally transitioning from Data Analyst to Data Engineer.
  • Proven expertise in SQL and building complex data models.
  • Strong proficiency in Python for data processing, ETL, and workflow automation.
  • Experience with cloud data platforms (Snowflake experience highly desirable).
  • Exposure to or experience with Terraform or similar infrastructure-as-code tools is a strong plus.
  • Comfortable working in fast-paced environments and able to contribute quickly without extensive onboarding.

Nice to Have

  • Experience with modern data stack tools (e.g., dbt, Airflow, etc.).
  • Understanding of CI/CD pipelines and data infrastructure automation.
  • Familiarity with data governance, security, and best practices in a cloud environment.
Senior Data Engineer
Lynx Recruitment Limited
London
Remote or hybrid
Senior
£85,000
+3

Are you a Data Engineer passionate about building scalable, cloud-first data platforms that power business insights and innovation? Our client is seeking an experienced engineer to design robust, secure, and future-ready data solutions that support analytics, AI, and strategic decision-making.

What Youll Do:

Build, test, and maintain ETL/ELT pipelines for structured and unstructured data.

Design and optimise data warehouses, lakes, and cloud-native platforms .

Implement monitoring, security, and compliance frameworks in line with regulations (e.g., GDPR, financial standards).

Deliver high-quality datasets to analysts, data scientists, and business stakeholders.

Work with modern technologies, including cloud platforms, orchestration tools, and streaming frameworks .

What Were Looking For:

Strong SQL & Python skills.

Hands-on experience with ETL/ELT tools (e.g., Matillion, Talend, FiveTran, Azure Data Factory).

Experience designing and managing cloud data platforms (Snowflake essential; AWS/Azure/GCP desirable).

Solid data modelling knowledge and performance optimisation skills.

Awareness of data governance, security, and regulatory compliance .

Ability to work closely with technical and business teams to deliver impactful solutions.

Nice-to-Haves:

Orchestration tools (Airflow, dbt, Prefect) or streaming frameworks (Kafka, Kinesis).

CI/CD experience and DevOps practices for data workflows.

Exposure to data visualisation platforms (PowerBI, Tableau, MicroStrategy).

Experience in financial services or other highly regulated industries.

TPBN1_UKTJ

Staff Data Engineer
WeDoTech
London
Hybrid
Senior
£80,000 - £95,000

Role
Senior Data Engineer (Data Platform)

Salary
80,000 to 95,000 base salary

Location
London Paddington Hybrid 3 days a week

The Company
WeDo is working with a high growth fintech operating regulated payment platforms across multiple countries. As the business continues to expand internationally, data engineering has become a core strategic function, with significant investment in scalable, reliable, and automated data platforms.

The Position
This is a Senior Data Engineering role within the Regulatory Reporting function, focused on building a new data platform to support international growth.

The team currently delivers regulatory reporting for six countries and is scaling to more than thirty. Each country has different reporting rules, formats, and submission processes, creating a complex and highly impactful engineering challenge.

You will play a key role in designing and building this platform from the ground up, owning data models, pipelines, orchestration, and submission workflows. You will work closely with the core Data Engineering platform team while retaining clear ownership of the regulatory reporting layer.

The role is strongly engineering focused rather than BI oriented. You will work with both batch and real time data, integrate with microservices, and help transition the platform towards event driven architecture. Accuracy and reliability are critical, as these outputs are submitted directly to regulators.

This is an excellent opportunity for a senior data engineer looking for ownership, architectural influence, and a platform that will grow significantly in scale and complexity.

Requirements

  • Strong experience designing and building data platforms and data architectures
  • Hands on experience with design and build of cloud data warehouses
  • Snowflake experience is desirable, though Redshift or Synapse are also suitable
  • Experience with data orchestration tools such as Airflow or Prefect
  • Strong coding ability in Python, Java, or Scala
  • Experience building data infrastructure from scratch
  • Comfortable working with both batch and streaming data
  • Experience integrating data platforms with microservices and real time systems

Interested?
Apply for the position or send your CV to (url removed)

Page 1 of 2
Frequently asked questions
In London, you can find a variety of Apache Airflow roles including Data Engineer, DevOps Engineer, Cloud Engineer, Workflow Automation Specialist, and Big Data Engineer positions. These roles typically involve designing, building, and maintaining data pipelines using Apache Airflow.Employers in London typically seek candidates with strong experience in Apache Airflow, Python programming, SQL, cloud platforms (such as AWS, GCP, or Azure), and knowledge of ETL processes. Familiarity with containerization tools like Docker and orchestration tools like Kubernetes is also highly valued.Yes, many companies in London offer remote or hybrid work arrangements for Apache Airflow roles, especially post-pandemic. When browsing jobs, look for listings that specify remote-friendly or hybrid options.The average salary for Apache Airflow roles in London varies depending on experience and job level but generally ranges from £50,000 to £90,000 per year. Senior or specialist roles can offer salaries above this range.To increase your chances, build a solid portfolio showcasing your experience with Apache Airflow, contribute to open-source projects, acquire relevant certifications, and stay updated with the latest cloud and workflow automation technologies. Networking with local tech communities and attending industry events in London can also be very helpful.
Feedback
Contact