Make yourself visible and let companies apply to you.
Roles
Data Engineer Jobs in London
Overview
Looking for top Data Engineer jobs in London? Explore the latest opportunities on Haystack, your go-to IT job board connecting skilled data engineers with leading companies in the heart of the UK’s tech hub. Whether you're an experienced data engineer or just starting your career, find roles that match your skills and ambitions in London’s vibrant tech scene. Start your job search today and take the next step in your data engineering career!
Senior Data Engineer AWS
client server
Harrow
Hybrid
Senior
£90,000
RECENTLY POSTED

Senior Data Engineer (AWS) London / WFH to £90k

Do you have expertise with modern data platform engineering?

You could be progressing your career in a senior, hands-on role at a well established consumer facing financial services company that help people to manage debt, as they go through a technical transformation and scale-up following recent investment.

As a Senior Data Engineer you will be responsible for designing, building and owning the new cloud (AWS) hosted data platform from the ground up. You’ll collaborate with the Data Platform Lead, work closely with software engineering teams, the BI function and the Enterprise Architect to enable analytics, insight, AI and safe system transitions.

You’ll own and evolve data ingestion pipelines, including incremental migration from a legacy monolith and Oracle-based systems, dual-running and reconciliation during platform transition (12-24 month initiative) and be responsible for the ongoing ingestion from systems of record (e.g. Sage, HR systems, HubSpot) and partners with the ultimate aim of establishing a hub-and-spoke, single source of truth data architecture that supports both transition and long term scale.

Location / WFH:

You’ll be based in fantastic new offices in London that offer a wide range of facilities including wellness rooms and onsite gym for three days a week with flexibility to work from home twice a week.

About you:

  • You are a Senior Data Engineer, with experience of designing and building data platforms end-to-end
  • You have hands-on experience with cloud-native data infrastructure, ideally on AWS using IaC
  • You have experience with Lakehouse and modern Data Warehouse patterns; AWS S3-based Lakehouse patterns, Athena / Redshift, Glue, EMR and related native services and Metabase for self-service analytics
  • You have experience of designing and operating data ingestion pipelines at scale (batch and streaming)
  • You have experience of supporting system migrations and dual-running, including reconciliation and trust building
  • You have a strong understanding of data modelling for analytics
  • You have experience of enabling self-service analytics platforms (e.g. Metabase or similar)
  • You’ve had exposure to AI-adjacent data work, including: preparing data for RAG or ML use cases and supporting streaming or near-real-time analytics
  • You’re collaborative and pragmatic

What’s in it for you:

  • Salary to £90k
  • Bonus
  • 25 days holiday
  • Pension
  • Employee Assistance Programme
  • Onsite gym and well-being champions
  • X2 volunteering days per year
  • Opportunity to make an impact as part of new team in a role you can shape

Apply now to find out more about this Senior Data Engineer (AWS) opportunity.

Principal Data Engineer
VIQU IT Recruitment
London
Fully remote
Senior
£95,000
RECENTLY POSTED

Location: Remote
Salary: Up to £95,000
Sponsorship: Not available

VIQU have partnered with a nationally recognised organisation that has recently completed a full migration from on-premise infrastructure to Google Cloud Platform (GCP) and is now building a modern, domain-oriented Data Mesh. This is a critical leadership hire as they continue to scale their cloud data platform and embed engineering excellence across multiple product domains.

This is not a step-up role. They will only consider candidates with proven Principal or Lead-level experience, including clear ownership of engineers, standards, and cross-domain architectural direction.

The Role

As Principal Data Engineer, you will be the senior technical authority across data product squads, driving strategy, architecture, and engineering best practice.

Key responsibilities include:

  • Providing visible, hands-on technical leadership across multiple domain teams
  • Defining how projects are approached and ensuring delivery standards are upheld
  • Designing and governing scalable pipelines using BigQuery, Dataflow, Datastream, Data Fusion, Dataproc and Cloud Composer (Airflow)
  • Leading best practice across dbt, Terraform, Docker and CI/CD
  • Driving Data Mesh adoption, domain ownership, and interoperable data products
  • Setting modelling standards across raw, curated and semantic layers
  • Embedding governance covering lineage, MDM, data quality, PII and compliance
  • Mentoring and challenging senior engineers to maintain high standards

You will work closely with Architects and Platform Engineering to ensure performance, cost control, security and scalability across the GCP estate.

What They Need

  • 10+ years in Data Engineering
  • Clear, demonstrable experience leading engineers at Lead/Principal level
  • Deep, hands-on GCP experience (this is essential)
  • Strong SQL and Python expertise
  • Experience building cloud-native data platforms end-to-end
  • Strong background in Data Lake / Warehouse architecture
  • Proven experience implementing CI/CD and infrastructure as code
  • Confidence to challenge stakeholders and influence technical direction

Candidates without strong, proven leadership experience in enterprise-scale environments will not be considered.

Why Join?

You’ll be joining at a pivotal stage in the evolution of a 100% cloud-native platform. The foundations are in place, but the Data Mesh journey is still being shaped. This is a genuine opportunity to influence architecture, standards, and the long-term engineering strategy — fully remote, with executive backing and real scope for impact.

Apply now to speak with VIQU IT in confidence. Or contact Aaron Chiverton on the VIQU website. Know someone great? Refer them and receive up to £1,000 if successful (terms apply). For more exciting roles and opportunities, follow us on LinkedIn @VIQU IT Recruitment.

Data Engineer Python SQL AWS
client server
Richmond
Fully remote
Mid
£50,000
RECENTLY POSTED
+3

Data Engineer (Python SQL AWS) Remote UK to £50k

Would you like to work on complex and interesting AI based systems with a team of tech entrepreneurs?

You could be joining a growing start-up that is utilising Machine Learning and AI technology to revolutionise fish farming, improving fish health and growth; their carbon neutral technology is already making a difference in Scotland, Chile, Canada, Australia, Spain and Norway and the company has ambitious growth plans.

As a Data Engineer you will design, build and implement robust data pipelines that transform raw IoT sensor data into actionable insights for fish farmers worldwide. You’ll work on scalable data infrastructure, from ingesting real-time sensor streams to building analytics ready datasets, enabling data driven decision making and improving operational efficiency across the global farm network. This role offers exciting challenges involving high-volume data processing, data quality management and supporting AI/ML workflows.

There are excellent career progression opportunities as the company continues to scale; you’ll be an integral part of a small, distributed team.

Location / WFH:

You can work from home remotely from anywhere in the UK, there is also flexibility to work abroad for periods throughout the year and flexible start and finish times. There are two company ‘kick-off’ meetings per year at great destinations for a week at a time.

About you:

You have experience of building and maintaining data pipelines in production environments

You have Python and SQL skills coding skills including PostgreSQL, MySQL and NoSQL databases

Ideally you will have experience with some of the following technology that is also in the tech stack: data pipeline orchestration tools (e.g. Airflow, Prefect, Dagster), cloud data platforms (e.g. AWS, S3, Glue, Athena, Redshift, Kinesis), data warehouse concepts and dimensional modelling, data streaming tools (e.g. Kafka, Kinesis)

You’re collaborative with great communication skills

What’s in it for you:

Salary to £50k

Remote working (including abroad)

Paid for training and certifications

Home office budget

Bi-annual company kick-offs

Pension

Apply now to find out more about this Data Engineer (Python SQL AWS) remote opportunity.

At Client Server we believe in a diverse workplace that allows people to play to their strengths and continually learn. We’re an equal opportunities employer whose people come from all walks of life and will never discriminate based on race, colour, religion, sex, gender identity or expression, sexual orientation, national origin, genetics, disability, age, or veteran status. The clients we work with share our values.

TPBN1_UKTJ

SC Cleared Data Engineer - Azure - London - Azure/Databricks/Python
TrinIT Group
London
Hybrid
Mid - Senior
£500/day
RECENTLY POSTED

TrinIT Talent are looking for a SC Cleared Data Engineer to come on board for a 6 month contract based in London 2 days per week and 3 days remote. This role falls Inside Scope of IR35 and is paying £500 per day. Active SC Clearance is required for this position.

Job Description:-
We are seeking an experienced Data Engineer to support the design and delivery of scalable, secure and high-performance data platforms built on Microsoft Azure. The role will involve building modern data pipelines, supporting cloud migration initiatives and delivering reliable data services for analytics, reporting and operational workloads.

You will work closely with architects, analysts and engineering teams to deliver robust cloud-based data solutions while ensuring strong governance, performance optimisation and data quality across the platform.

Key skills:-

  • Strong experience with Azure data services including Azure Databricks, Azure Data Lake Storage and Azure Data Factory
  • Advanced development experience using Python, Spark/PySpark and SQL
  • Experience building scalable data pipelines and distributed data processing solutions
  • Experience implementing CI/CD pipelines using Azure DevOps or GitHub
  • Experience working in secure or regulated environments (Active SC Clearance required)

If you feel you have the right experience for this role, please get in touch by sending your CV in Word format to (see below)

TrinIT Talent will consider applications based only on skills and ability and will not discriminate on any grounds.

SC Cleared Data Engineer - Azure - London - Azure/Databricks/Python

Data Manager
Rise Technical Recruitment
London
In office
Mid - Senior
£40,000 - £42,500
RECENTLY POSTED
TECH-AGNOSTIC ROLE

Data & MIS Manager (Integration & Project Manager)
Wandsworth, London
40,000 to 42,500 + 30 days holiday + Bank Holidays + Pension + Life Insurance

Excellent opportunity for a Data Manager with MIS experience looking for a role offering autonomy and the opportunity to stamp your mark on an organisation, taking ownership of and modernising their data and MIS systems.

This organisation are in the education sector and have a brilliant reputation within their industry. They are well-established, stable, and pride themselves on their culture and being a great place to work.

This role is the first of its kind within the organisation, meaning that it is a great opportunity for you to come in, bring your ideas to the table and truly make your mark. On a day-to-day you will be responsible for data migration, integration, data integrity and quality, reporting and management information, as well as dealing with leadership, governors and stakeholders.

The ideal candidate will come from a Data Manager role (or similar background), ideally within education or broader public sector, and will have experience with an MIS system. You will have good data quality expertise and will be comfortable communicating and dealing with stakeholders in a school environment.

This is a fantastic opportunity to take full ownership of a core system, influence how data is managed across the organisation and contribute to a long term digital strategy, while retaining a strong work life balance in a supportive setting.

The Role:
MIS & Data Manager, acting as system owner and project lead for data migration
Responsible for data cleansing, mapping, validation, User Acceptance Testing and configuration of workflows
Day to day administration of the MIS
Produce reporting for SLT, Governors and compliance requirements, developing dashboards and reducing reliance on manual spreadsheets
Ensure data integrity across admissions, onboarding, year transitions and leavers
Onsite role in Wandsworth

The Person:
Experience in a Data Management role, ideally from education or the broader public sector
Experience with an MIS system
Data Quality expertise
Comfortable communicating with and dealing with stakeholders
Based within a commutable distance of Wandsworth and happy to work onsite

Reference Number: BBBH(phone number removed)

Rise Technical Recruitment Ltd acts an employment agency for permanent roles and an employment business for temporary roles.

The salary advertised is the bracket available for this position. The actual salary paid will be dependent on your level of experience, qualifications and skill set and will be decided by our client, the employer. Rise are not responsible or liable for any hiring decisions made by the end client.

We are an equal opportunities company and welcome applications from all suitable candidates.

Technical Lead Asset Management
Lorien
London
Hybrid
Senior
Private salary
RECENTLY POSTED

Technical Lead (Asset Management)

6 Month Contract

London (Hybrid)

Via Umbrella

Our UK leading Life insurance client are looking for a Technical Lead to join their team on an initial 6-month contract.

Key skills/knowledge required:

  • Deep knowledge of trading workflows, trade lifecycle events, and OMS integration patterns
  • Understanding of capital markets data flows, trade settlement, reference data, and portfolio management processes
  • Strong understanding of data modelling, data engineering workflows, and integration with front-office platforms
  • Awareness of regulatory and compliance considerations in capital markets delivery
  • Understanding of modern engineering practices, including agile methodologies, DevOps, and cloud-native development
  • Strong background in asset management or investment banking with hands-on delivery of capital markets solutions
  • Minimum 3-5 years leading development teams in financial services environments
  • Experience with OMS platform integration (any major platform - Aladdin, Murex, Charles River, etc.) and understanding of trade lifecycle data flows
  • Proven experience as a Tech Lead or Senior Engineer leading development teams in financial services
  • Experience working directly with business and front-office stakeholders
  • Track record of designing and delivering high-quality, scalable technical solutions
  • Experience in SQL, Python, Snowflake, and AWS within data-intensive, cloud-based environments

Desirable:

  • Specific experience with Aladdin, Murex, Charles River or other major OMS platforms
  • Familiarity with multiple asset classes such as equities, fixed income, and derivatives
  • Understanding of UK regulatory environment and FCA requirements
  • Awareness of risk management, portfolio management, and related asset management processes
  • Experience supporting delivery in a regulated financial services organisation
  • Background in multi-team delivery environments with complex dependencies
  • Experience in both hands-on coding and strategic technical leadership
  • Track record of successful stakeholder management across business and technology functions

If you find this opportunity intriguing and aligning with your skill set, we welcome the submission of your CV without delay.

Guidant, Carbon60, Lorien & SRG - The Impellam Group Portfolio are acting as an Employment Business in relation to this vacancy.

SparkScala Developer
Infoplus Technologies UK Ltd
London
Hybrid
Senior
£450/day
RECENTLY POSTED

Role Details:Position: SparkScala DeveloperLocation: London, UK (Hybrid)Work Mode: Hybrid (3 Days a week from Office)Duration: Initial contract will be for 12 months, however long-term projectRate: Inside IR35- Up to GBP 450/day
?? Visa Note: Open to British Citizenship, or ILR (Indefinite Leave to Remain), or UK Settlement Visa. We do not provide visa sponsorship.
Key Requirements:Must have skills:-Spark & Scala
Nice to have skills:-Spark Streaming, Hadoop,-Hive,-SQL,-Sqoop,- Impala
Detailed Job Description: At least 8+ years of experience and strong knowledge in Scala programming language. Able to write clean, maintainable and efficient Scala code following best practices. Good knowledge on the fundamental Data Structures and their usage At least 8+ years of experience in designing and developing large scale, distributed data processing pipelines using Apache Spark and related technologies. Having expertise in Spark Core, Spark SQL and Spark Streaming. Experience with Hadoop, HDFS, Hive and other BigData technologies. Familiarity with Data warehousing and ETL concepts and techniques Having expertise in Database concepts and SQL/NoSQL operations. UNIX shell scripting will be an added advantage in scheduling/running application jobs. At least 8 years of experience in Project development life cycle activities and maintenance/support projects. Work in an Agile environment and participation in scrum daily standups, sprint planning reviews and retrospectives. Understand project requirements and translate them into technical solutions which meets the project quality standards Ability to work in team in diverse/multiple stakeholder environment and collaborate with upstream/downstream functional teams to identify, troubleshoot and resolve data issues. Strong problem solving and Good Analytical skills. Excellent verbal and written communication skills. Experience and desire to work in a Global delivery environment. Stay up to date with new technologies and industry trends in Development.

Head of Data - London - Messy Data / Web Crawlers / Data Aggregation
Avanti
London
Hybrid
Leader
£90,000 - £100,000
RECENTLY POSTED

High Growth B2B SaaS AI & Machine Learning Platform

£90,000 - £100,000 + Significant Equity

I am working with a scaling London based technology business where Machine Learning and AI sit at the core of the product.

The platform is built around a large-scale dataset created by crawling the web and collecting millions of listings from multiple external sources. That raw data is then structured, matched and analysed to power a suite of SaaS tools used across the market.

One of the core technical challenges is that the same entity can appear multiple times across different sources, often with slightly different attributes or descriptions. The platform uses a combination of neural networks and rule based systems to match records and build a reliable dataset over time. They are now hiring a Head of Data to take ownership of their data and AI platform.

The Opportunity

This is a hands-on leadership role where you will lead a team of 5-6 across Data Science and Data Engineering while remaining technically involved in modelling, machine learning deployment and architectural decisions.

The platform runs on AWS and includes large-scale crawlers ingesting significant volumes of external data. However, the architecture has evolved over time and data currently sits across multiple siloed systems.

They need someone who understands what good looks like in a modern data platform and can bring structure, coherence and technical direction.

You will take ownership of improving the data architecture, strengthening the matching systems and defining a clear data and AI roadmap for the business.

Key Areas of Focus

  • Designing and improving a scalable AWS based data platform
  • Rationalising fragmented data across multiple systems
  • Leading the full machine learning lifecycle from ingestion and feature engineering through to deployment
  • Improving neural network and rule based matching systems used to identify the same entities across different sources
  • Embedding robust MLOps and model monitoring
  • Building a coherent data architecture that supports future AI development
  • Leading and developing a team of Data Scientists and Data Engineers

The Background That Works Well

Relevant experience in environments that deal with messy data from multiple external sources might include:

  • Web crawling or large-scale web data ingestion
  • Marketplace or data aggregation platforms
  • Entity resolution, record linkage or deduplication systems
  • Matching systems or recommendation engines
  • Geospatial or address based data platforms
  • ML systems deployed into production

You do not need sector experience, but you should be comfortable working with complex datasets where the same entity appears across multiple sources.

What They Are Looking For

  • Strong Data Science background with hands on machine learning experience
  • Experience deploying ML models into production environments
  • Understanding of data engineering concepts and modern cloud data platforms
  • Architectural thinking around data platforms and ML systems
  • Experience working with messy, multi source datasets
  • Leadership experience managing small, high impact teams
  • Someone proactive who can define standards and shape the data roadmap

Package

Salary: £90,000 - £100,000

Equity: Meaningful equity with real upside (3 year vesting)

Location: London - Hybrid working, typically 2-3 days in the office with a pragmatic approach to flexibility

This is a high ownership role where you will be shaping the foundations of a data and AI platform inside a scaling technology business.

If you enjoy solving complex data problems, building scalable machine learning systems and leading a small but impactful team, I would be keen to speak.

Salesforce Tableau Integration Consultant
ARM (Advanced Resource Managers)
London
Remote or hybrid
Mid - Senior
Private salary
RECENTLY POSTED

3 months
Remote/London
£Negotiable - INSIDE IR35

  • Experience in enterprise data integration, connectivity architecture, or cloud platform engineering.
  • Hands-on experience configuring and managing Tableau Bridge in enterprise environments
  • Experience integrating Salesforce with Tableau.

Disclaimer:

This vacancy is being advertised by either Advanced Resource Managers Limited, Advanced Resource Managers IT Limited or Advanced Resource Managers Engineering Limited (“ARM”). ARM is a specialist talent acquisition and management consultancy. We provide technical contingency recruitment and a portfolio of more complex resource solutions. Our specialist recruitment divisions cover the entire technical arena, including some of the most economically and strategically important industries in the UK and the world today. We will never send your CV without your permission. Where the role is marked as Outside IR35 in the advertisement this is subject to receipt of a final Status Determination Statement from the end Client and may be subject to change.

Salesforce Tableau Migration Consultant
ARM (Advanced Resource Managers)
London
Hybrid
Mid - Senior
Private salary
RECENTLY POSTED

3 months
Remote/London
£Negotiable - INSIDE IR35

  • Hands-on Tableau administration and development experience across Tableau Server and Tableau Cloud.
  • Proven experience delivering Tableau Server to Tableau Cloud migrations at enterprise scale (multi-site, large user base).
  • Expertise in Python (or equivalent) for automation of migration tasks, API-driven operations, and batch processing.

Disclaimer:

This vacancy is being advertised by either Advanced Resource Managers Limited, Advanced Resource Managers IT Limited or Advanced Resource Managers Engineering Limited (“ARM”). ARM is a specialist talent acquisition and management consultancy. We provide technical contingency recruitment and a portfolio of more complex resource solutions. Our specialist recruitment divisions cover the entire technical arena, including some of the most economically and strategically important industries in the UK and the world today. We will never send your CV without your permission. Where the role is marked as Outside IR35 in the advertisement this is subject to receipt of a final Status Determination Statement from the end Client and may be subject to change.

Analytics Solution Engineer - Inside IR35 - Remote
Tenth Revolution Group
London
Fully remote
Mid - Senior
£500/day - £550/day
RECENTLY POSTED
+2

Analytics Solution Engineer - Inside IR35 - RemoteRole Overview

This role sits at the intersection of Data Engineering, DevOps, and Site Reliability Engineering within the App Reporting team. You will be responsible for maintaining, improving, and operating critical data platforms - primarily Azure Databricks and Palantir Foundry - ensuring they are reliable, scalable, secure, and fully automated.

The role focuses heavily on platform reliability, infrastructure as code, and operational excellence, while also supporting Data Engineers in delivering high-quality analytics pipelines. You will play a key role in incident management, automation of manual processes, and continuous improvement of platform tooling and workflows.

Key ResponsibilitiesPlatform Engineering & Reliability

  • Maintain and improve the Azure Databricks and Palantir Foundry platforms to ensure reliability, performance, and scalability
  • Act as a Site Reliability Engineer for the data platforms, ensuring systems run as intended and meet availability expectations
  • Handle incidents, outages, alerts, and operational issues, including root cause analysis and preventative improvements
  • Implement and maintain health checks, monitoring, and alerting

DevOps & Automation

  • Design, implement, and maintain Terraform to automate infrastructure provisioning and management
  • Own and improve release processes, CI/CD pipelines, and deployment automation
  • Manage platform artefacts including clusters, secrets, releases, and configurations
  • Perform GitHub peer reviews and uphold software ownership and quality standards

Data Engineering Enablement

  • Provide platform and DevOps support to Data Engineers building pipelines
  • Enable and support data pipelines within Palantir Foundry and Azure Databricks
  • Assist with performance optimisation, pipeline reliability, and operational readiness

Analytics Infrastructure & Operations

  • Build and maintain analytics infrastructure to support reporting and redline initiatives
  • Improve operational processes across the data platform estate
  • Support audit requirements through data analysis, operating data restores, and immutable backups

Cloud & Infrastructure Operations

  • Manage networking, access control, and secrets management

  • Support and maintain:

    • Power BI Gateways
    • Event Hub throughput units
    • Serverless compute clusters
    • Reserved VM capacity
  • Ensure infrastructure meets security, governance, and compliance standards

Skills & ExperienceEssential

  • Strong experience with Azure Databricks
  • Infrastructure as Code using Terraform
  • DevOps practices and CI/CD pipelines
  • Git and peer review workflows
  • Python, PySpark, and SQL
  • Cloud operations within Azure

To apply for this role please submit your CV or contact Dillon Blackburn on or at .

Tenth Revolution Group are the go-to recruiter for Data & AI roles in the UK offering more opportunities across the country than any other recruitment agency. We’re the proud sponsor and supporter of SQLBits, Power Platform World Tour, and the London Fabric User Group. We are the global leaders in Data & AI recruitment.

Azure Data Engineer
VIQU IT Recruitment
London
Hybrid
Mid
£450/day - £550/day
RECENTLY POSTED

Azure Data Engineer - 3-6-month contract

We are looking for a Data Engineer to join a growing digital and data function supporting a modern, cloud-based data platform. This role focuses on building reliable, secure, and scalable data solutions that enable analytics, operational reporting, and data-driven decision making across the organisation.

You will work closely with technical and non-technical stakeholders to deliver well-engineered data pipelines and models, contributing to the continuous improvement of data platforms and engineering standards.

Azure data engineer responsibilities:

  • Build and support robust ELT data pipelines using Azure-based technologies and SQL
  • Develop structured data models aligned to modern data platform patterns
  • Ensure data solutions meet performance, security, quality, and reliability standards
  • Contribute to agile delivery, code reviews, and continuous improvement of engineering practices
  • Collaborate with stakeholders and technical teams to translate business needs into data solutions

Azure Data Engineer requirements:

  • Hands-on experience with Azure Data Factory, Databricks, and SQL-based databases
  • Strong understanding of data engineering principles, including ELT and data modelling
  • Experience working with CI/CD pipelines, automation, and testing
  • Knowledge of data governance, access control, and platform standards
  • Excellent communication and collaboration skills
  • Familiarity with modern data architectures such as Medallion patterns and metadata tools

This role will be hyrbid working - required to work 2 to 3 days per week onsite in London.

Apply now to speak with VIQU IT in confidence. Or reach out to Phoebe Thompson via the VIQU IT website.

Do you know someone great? We’ll thank you with up to £1,000 if your referral is successful (terms apply).

For more exciting roles and opportunities like this, please follow us on IT Recruitment.

Snowflake DevOps Engineer
Robert Half
London
Hybrid
Mid - Senior
Private salary
RECENTLY POSTED

Robert Half Technology are assisting a market leading insurance organisation to recruit a Snowflake DevOps Engineer on an 6 month contract basis. London based - hybrid working

Role

Core Responsibilities

The combined role demands expertise in both traditional database administration and modern DevOps principles:

  • Security and Compliance: Implementing and managing security measures like role-based access control (RBAC), user authentication (SSO, MFA), data encryption, and data masking to enforce security policies and compliance standards.
  • Automation and CI/CD: Automating routine administrative tasks and building/maintaining CI/CD pipelines (using tools like Azure DevOps, or ) for reliable and automated deployment of Snowflake SQL scripts and stored procedures.
  • Monitoring and Troubleshooting: Setting up and managing monitoring and alerting systems to track platform health and performance, and serving as the first point of contact for troubleshooting and resolving pipeline issues and operational incidents. Keeping artefactory certificates updated and solving snyk scanner/SonarQube issues. Understand networking issues is also a plus.
  • Collaboration: Acting as a liaison between data engineering and networking teams to solve issues in the pipeline
  • Platform Administration: Administering the Snowflake platform across different environments (development, test, production), including managing accounts, warehouses, databases, schemas, and other database objects. Managing secrets, RBAC (role hierarchy), Database change management and reporting role needs.
  • Performance and Cost Optimisation: Monitoring system performance, optimising query performance, managing warehouse sizes, and proactively controlling credit usage and storage costs to ensure efficiency.

Technologies

The Snowflake DevOps Engineer will have experience with the following:

  • Azure DevOps (or any other CI/CD pipeline technology)
  • SQL
  • Snowflake
  • DBT
  • DCM tech

Company

  • Market leading insurance organisation
  • global presence with offices in london
  • hybrid working

Salary & Benefits

company, depending on experience

The salary range/rates of pay is dependent upon your experience, qualifications or training.

Robert Half Ltd acts as an employment business for temporary positions and an employment agency for permanent positions. Robert Half is committed to diversity, equity and inclusion. Suitable candidates with equivalent qualifications and more or less experience can apply. Rates of pay and salary ranges are dependent upon your experience, qualifications and training. If you wish to apply, please read our Privacy Notice describing how we may process, disclose and store your personal data:

DevOps Engineer
Robert Half
London
Hybrid
Mid - Senior
Private salary
RECENTLY POSTED

Robert Half Technology are assisting a market leading insurance organisation to recruit a DevOps Engineer on an 6 month contract basis. London based - hybrid working

Role

DevOps & CI/CD for Data Platforms

  • Design, build, and maintain CI/CD pipelines (primarily in Azure DevOps) for deployment of Snowflake objects (SQL scripts, stored procedures, roles, schemas, DBT transformations).
  • Implement Infrastructure as Code (IaC) and automated database change management processes.
  • Drive DevOps best practices across the data lifecycle (branching strategies, automated testing, release governance).

Snowflake Platform Engineering

  • Administer and support Snowflake across development, test, and production environments.
  • Manage warehouses, databases, schemas, roles, and access structures.
  • Implement structured role hierarchies and RBAC aligned to enterprise security policies.
  • Oversee secrets management and secure configuration practices.

Security & Compliance

  • Implement and manage security controls including RBAC, SSO, MFA, encryption, and data masking.
  • Ensure compliance with internal governance and regulatory standards.
  • Support audit requirements and access reporting.

Monitoring, Reliability & Incident Management

  • Implement monitoring and alerting for Snowflake and associated pipelines.
  • Act as the primary escalation point for data pipeline failures and platform incidents.
  • Troubleshoot performance, networking, and integration issues across Azure and Snowflake.
  • Maintain artefact repositories and resolve tooling issues (e.g., certificate renewals, Snyk, SonarQube).

Performance & Cost Optimisation

  • Monitor query performance and optimise warehouse configuration.
  • Proactively manage Snowflake credit usage and storage costs.
  • Provide recommendations to improve platform scalability and efficiency.

Profile

  • Strong experience as an Azure DevOps Engineer supporting cloud-based data platforms.
  • Hands-on experience building and managing CI/CD pipelines in Azure DevOps (or similar tooling).
  • Strong SQL expertise and experience deploying database objects via automated pipelines.
  • Proven experience administering Snowflake in multi-environment enterprise setups.
  • Experience working closely with Data Engineering teams in modern analytics environments.
  • Solid understanding of RBAC, secrets management, and secure design principles.
  • Familiarity with monitoring, logging, and troubleshooting in Azure-based environments.
  • Experience with DBT for transformation workflows.

Company

  • Market leading insurance organisation
  • global presence with offices in London
  • hybrid working

Salary & Benefits

company, depending on experience

The salary range/rates of pay is dependent upon your experience, qualifications or training.

Robert Half Ltd acts as an employment business for temporary positions and an employment agency for permanent positions. Robert Half is committed to diversity, equity and inclusion. Suitable candidates with equivalent qualifications and more or less experience can apply. Rates of pay and salary ranges are dependent upon your experience, qualifications and training. If you wish to apply, please read our Privacy Notice describing how we may process, disclose and store your personal data:

Python Developer
Parkside Office Professional
London
In office
Senior
£400/day - £425/day
RECENTLY POSTED

Senior Python DeveloperLondon Contract Energy / Trading Environment£400-£425 per day (Inside IR35)We are supporting a leading organisation operating within the energy and commodities space who are looking to engage a Senior Python Developer to support the build-out of advanced data-driven applications and analytical tools.This is a hands-on engineering role working at the intersection of data, analytics and front-office stakeholders. You will be responsible for building clean, modular Python applications, manipulating complex datasets, and delivering interactive dashboards used for commercial insight.The RoleYou will:

  • Develop robust, production-grade Python applications
  • Manipulate and analyse large datasets using pandas and numpy
  • Build interactive dashboards using Plotly Dash
  • Design modular, reusable and well-tested code
  • Integrate with REST APIs and backend services
  • Collaborate with commercial and technical stakeholders to translate requirements into scalable solutions
  • This is a highly technical role suited to someone who enjoys building clean systems rather than quick scripts.

Required Experience

  • Hands-on Python development experience
  • Strong object-oriented programming skills
  • Deep experience with pandas and numpy for data manipulation
  • Experience with virtual environments, dependency management and packaging
  • Strong understanding of software engineering best practices including Git, unit testing (pytest), documentation and code quality tools
  • Experience building data-driven applications in a commercial environment.
Junior SQL Developer
Ashdown Group
Dartford
In office
Junior
£32,000 - £35,000
RECENTLY POSTED

A well-established business is looking for a Junior SQL Developer to join its team, based in Dartford, Kent. Please note that this role requires the chosen candidate to be based in the office 5 days per week.In order to be suitable for this role, you must be experienced in analysing data and producing complex reports using a variety of report writing technologies. The successful candidate must have demonstrable knowledge of SSRS and SQL Server, as well as experience with developing applications using Microsoft Office, particularly Access and Excel or other databases that use SQL Server. Any prior experience using Power BI would be advantageous to your application. You will assist in the development of systems to minimise duplication of effort and to continually improve the quality of data collection and dissemination, using technology to remove inefficiencies, so as to ensure that information is provided to key stakeholders in readily accessible formats. This is an exceptional opportunity for an organised and methodical Junior SQL Developer with excellent communication skills and attention to detail to join a supportive and collaborative organisation.

Oracle FDI Reporting Lead - SC Cleared
Lorien
London
In office
Senior
Private salary
RECENTLY POSTED

A major UK organisation is seeking an experienced Fusion Data Intelligence (FDI) Specialist to support and enhance their enterprise-wide Oracle Fusion data, reporting, and analytics landscape. This is a hands-on technical role with significant ownership, working at the heart of complex HCM, ERP, and EPM data flows.
You will play a key role in maturing the organisation’s FDI capability - driving high-quality data modelling, optimising performance, strengthening governance, and enabling robust, scalable reporting solutions.

Key Responsibilities

  • Leverage FDI subject areas and enhance existing models to meet evolving business needs.
  • Optimise data performance and query execution across FDI environments.
  • Ensure data integrity, consistency, and alignment with underlying source systems.
  • Work closely with report writers and business teams to maintain and enhance Oracle Data Visualization reporting solutions across Fusion HCM, ERP, and Oracle EPM Cloud datasets.
  • Support and evolve data governance, security, and RBAC models for reporting solutions.
  • Document data models, business logic, transformations, and metadata for reuse and governance compliance.
  • Troubleshoot and resolve issues related to data modelling and reporting within FDI.
  • Lead best-practice approaches for FDI deployment, security, optimisation, and performance tuning.
  • Collaborate with Technology teams and third-party partners to plan, coordinate, and deliver aligned work packages.
  • Champion continuous delivery and DevOps practices, driving automation and modern engineering standards.

Essential Requirements

  • 3+ years’ experience working with Oracle Fusion Data Intelligence (FDI).
  • Strong understanding of Fusion data structures, particularly HCM and ERP, with Oracle EPM Cloud knowledge beneficial.
  • Experience loading EPM data sets into FDI.
  • Expertise in Oracle Cloud Infrastructure (OCI), Oracle Integration Cloud (OIC), Oracle PaaS, and Fusion Middleware.
  • Hands-on experience building data pipelines, including integration from custom schemas (eg, EPM connectors).
  • Demonstrated ability to develop semantic models in FDI.
  • Proven experience designing and extending security models, security contexts, and RBAC.
  • Strong SQL & PL/SQL skills.
  • Practical experience with performance tuning in reporting and data-intensive environments.
  • Ability to work independently and own delivery of end-to-end solutions.
  • Experience integrating with Master Data Management solutions (eg, EDM).
  • Ability to clearly articulate technical and functional changes to both technical and non-technical audiences.
  • Proven ability to lead technical and/or functional teams in an Agile environment.
  • Strong analytical, troubleshooting, and problem-solving capabilities.
  • Excellent communication, stakeholder management, organisation, and self-motivation.
  • Ability to manage and prioritise a demanding workload.

Desirable Skills

  • Oracle Cloud certifications (eg, Oracle Analytics Cloud Professional, OCI Foundations, Autonomous Data Warehouse Foundations).
  • Background in IT consulting, support, ITIL processes, SDLC, and understanding of server/database environments.
  • Hands-on experience with FDI implementation or support, including knowledge of FDI data structures.
  • Experience building advanced BIP and OTBI reports.
  • Experience with REST/SOAP Web Services.
  • Experience supporting FDI in public sector environments.

Guidant, Carbon60, Lorien & SRG - The Impellam Group Portfolio are acting as an Employment Business in relation to this vacancy.

Cloud Consultant
83zero Ltd
London
Hybrid
Junior - Mid
£50,000 - £70,000
RECENTLY POSTED

Google Cloud Consultant (Cloud/Data/AI)

Location: London (Hybrid)

Salary: £50,000 - £70,000 + benefits

Type: Permanent

83zero are partnered with a leading technology consultancy that helps organisations modernise their digital platforms and unlock value through cloud, data, and AI technologies.

Due to continued growth, they are looking for a Google Cloud Consultant to join their expanding cloud practice. This is an excellent opportunity for someone with hands-on GCP experience who is looking to develop their consulting career while working on large-scale cloud and data transformation projects.

The Role

As a Google Cloud Consultant, you will work closely with clients and internal teams to design and deliver solutions on Google Cloud Platform (GCP). You will contribute to cloud platform implementations, data solutions, and emerging AI capabilities while supporting senior consultants and architects on customer engagements.

This role offers the opportunity to gain exposure to a variety of cloud transformation projects while developing both your technical and consulting skill set.

Key Responsibilities

  • Support the design and implementation of cloud solutions on Google Cloud Platform (GCP)
  • Work with clients to understand technical requirements and contribute to solution design
  • Help deliver cloud migration, platform modernisation, and cloud-native solutions
  • Assist with the design and development of data platforms and analytics solutions
  • Contribute to the implementation of AI or machine learning solutions where appropriate
  • Develop and maintain infrastructure using Infrastructure-as-Code tools such as Terraform
  • Support the creation of technical documentation including solution designs and implementation plans
  • Collaborate with architects, engineers, and client stakeholders to ensure successful project delivery
  • Follow best practices around security, governance, and cost optimisation (FinOps)

Skills & Experience

Essential

  • Experience working with Google Cloud Platform (GCP) in a professional environment
  • Exposure to GCP services such as Compute Engine, Cloud Run, GKE, BigQuery, Cloud Storage, Pub/Sub, or Vertex AI
  • Experience supporting the implementation of cloud infrastructure or data platforms
  • Understanding of Infrastructure-as-Code, ideally using Terraform
  • Strong problem-solving skills and the ability to work collaboratively within project teams
  • Good communication skills and an interest in developing a client-facing consulting career

Desirable

  • Experience with data engineering, analytics platforms, or machine learning technologies
  • Exposure to cloud migration or modernisation programmes
  • Knowledge of security or compliance practices within cloud environments
  • Relevant certifications such as Google Associate Cloud Engineer or Professional Cloud Architect

What They’re Looking For

The ideal candidate is someone who enjoys working with modern cloud technologies and wants to build a long-term career in cloud consulting. You’ll be curious, technically capable, and comfortable working in collaborative project environments.

This is a great opportunity to join a fast-growing consultancy where you will work on cutting-edge cloud, data, and AI projects while continuing to build your technical expertise.

SC & DV Cleared Data Consultants and Analysts
VIQU IT Recruitment
London
Hybrid
Mid - Senior
£60,000
RECENTLY POSTED

SC & DV Cleared Data Consultants and Analysts – London – Up to £60,000 per annum

Are you a data-driven professional with a passion for delivering impactful solutions? Do you excel in translating complex data challenges into actionable insights? If so, Morela has an exciting opportunity for you.

Morela is proud to partner with one of the UK’s leading data consultancies, renowned for their innovative approach to data integration and analytics. As they continue to expand, they’re seeking a skilled SC & DV Cleared Data Consultant and Analysts to join their dynamic team. This role is perfect for someone who combines technical expertise with a consultative mindset, aiming to drive value across diverse projects.

You’ll be part of a forward-thinking consultancy that operates at the intersection of advanced technology and real-world impact. Serving both public and private sectors, their services encompass strategic advisory, digital transformation, and end-to-end data engineering. As a SC & DV Cleared Data Consultant or Analyst, you’ll play a crucial role in designing and implementing data solutions that empower clients to make informed decisions.

Core Responsibilities

  • Data Integration: Connect and harmonise data from multiple sources, ensuring clean, reliable, and compliant data pipelines.
  • Data Modelling: Design and manage data models to create logical data structures that enhance accessibility and usability.
  • Application Development: Build full-stack applications using tools such as Python, SQL, and relevant frameworks, delivering intuitive user interfaces and interactive workflows.
  • Data Governance: Implement data lineage tracking and access controls to uphold compliance with organisational and regulatory standards.
  • Client Collaboration: Engage with clients to understand their needs, provide training sessions, and promote best practices for effective adoption and utilisation of data platforms.
  • Continuous Improvement: Contribute to internal capability building by improving frameworks, delivery processes, and team development across the consultancy.

What We’re Looking For

  • SC, DV or eDV Cleared: In this position, you will already be security cleared to one of those levels.
  • Technical Expertise: Proven experience in data engineering, software development, or systems integration, preferably within AI, analytics, or enterprise platforms.
  • Problem-Solving Skills: Strong analytical abilities with a knack for troubleshooting and optimising complex data workflows.
  • Communication Skills: Excellent ability to engage with both technical and non-technical stakeholders, providing clear and confident guidance.
  • Adaptability: Comfortable working across various sectors and with diverse clients, adjusting approaches as needed.
  • Travel Readiness: Open to occasional travel (up to 25%) depending on project requirements.
  • Palantir Foundry experience is an added bonus!

As a SC or DV Cleared Data Consultant or Analyst, you’ll lead the charge on some of the most complex, high-impact data programmes in the UK, helping clients unlock the power of their data while mentoring the next generation of engineering talent.

Please do not hesitate to reply and reach out to Morela today to find out more!

Hedge Fund - Python Developer (Equities) - Trade life cycle - PnL - Kafka - Contract
Scope AT Limited
London
In office
Senior
Private salary
RECENTLY POSTED
+1

Our Hedge Fund client is looking for a Python Developer/Engineer Contract role

This team is responsible for the firms equity transaction data platform, including trade life cycle event processing, enrichment, and PnL calculations. The role is ideal for an engineer who enjoys building robust, high-throughput services and data pipelines in a fast-paced, delivery-focused environment.

Principal Responsibilities
Design and develop solutions for trade life cycle event processing, including corporate actions, expiries, and other post-trade events.
Build and operate Python-based services that perform large-scale data transformations and calculations.
Publish and distribute transaction and PnL data using Kafka, including AVRO-based schemas and streaming patterns.

Required Skills
Minimum of 6+ years of professional Python development experience, ideally in capital markets or a fintech firm.
Experience in finance: understanding of common financial asset classes; knowledge of equities corporate action processing, trade life cycle concepts, and/or P&L calculations is a strong plus.
Experience with Kafka (or equivalent streaming/messaging platforms) and schema-based event publishing (eg, AVRO).
Strong experience performing large-scale data calculations in Python using libraries like pandas, polars, and NumPy.
Experience building REST services using frameworks such as FastAPI and/or Flask.
Strong SQL skills and experience working with relational databases in production environments.
Hands-on experience with containerized deployments and modern infrastructure tooling (Docker, Kubernetes) and familiarity with cloud platforms.
Understanding of modern SDLC practices (testing strategy, CI/CD, release management, observability, and operational ownership).

Office based, 5 days per week.
Based in London.

Contract role inside IR35

By applying to this job you are sending us your CV, which may contain personal information. Please refer to our Privacy Notice to understand how we process this information. In short, in order to supply you with work finding services, we will hold and process your personal data, and only with your express permission we will share this personal data with a client (or a third party working on behalf of the client) by email or by upload to the Client/third parties vendor management system. By giving us permission to send your CV to a client, this constitutes permission to share the personal data that would be necessary to consider your application, interview you (Phone/video/face to face) and if successful hire you.
Scope AT acts as an employment agency for Permanent Recruitment and an employment business for the supply of temporary workers. By applying for this job you accept the Terms and Conditions, Data Protection Policy, Privacy Notice and Disclaimers which can be found at our website.

SC & DV Cleared Senior Data Consultants and Analysts
VIQU IT Recruitment
London
Hybrid
Senior
£70,000
RECENTLY POSTED

SC & DV Cleared Senior Data Consultants and Analysts – London – Up to £70,000 per annum

Are you a data-driven professional with a passion for delivering impactful solutions? Do you excel in translating complex data challenges into actionable insights? If so, Morela has an exciting opportunity for you.

Morela is proud to partner with one of the UK’s leading data consultancies, renowned for their innovative approach to data integration and analytics. As they continue to expand, they’re seeking a skilled SC & DV Cleared Senior Data Consultant and Analysts to join their dynamic team. This role is perfect for someone who combines technical expertise with a consultative mindset, aiming to drive value across diverse projects.

You’ll be part of a forward-thinking consultancy that operates at the intersection of advanced technology and real-world impact. Serving both public and private sectors, their services encompass strategic advisory, digital transformation, and end-to-end data engineering. As a SC & DV Senior Cleared Data Consultant or Analyst, you’ll play a crucial role in designing and implementing data solutions that empower clients to make informed decisions.

Core Responsibilities

  • Data Integration: Connect and harmonise data from multiple sources, ensuring clean, reliable, and compliant data pipelines.
  • Data Modelling: Design and manage data models to create logical data structures that enhance accessibility and usability.
  • Application Development: Build full-stack applications using tools such as Python, SQL, and relevant frameworks, delivering intuitive user interfaces and interactive workflows.
  • Data Governance: Implement data lineage tracking and access controls to uphold compliance with organisational and regulatory standards.
  • Client Collaboration: Engage with clients to understand their needs, provide training sessions, and promote best practices for effective adoption and utilisation of data platforms.
  • Continuous Improvement: Contribute to internal capability building by improving frameworks, delivery processes, and team development across the consultancy.

What We’re Looking For

  • SC, DV or eDV Cleared: In this position, you will already be security cleared to one of those levels.
  • Technical Expertise: Proven experience in data engineering, software development, or systems integration, preferably within AI, analytics, or enterprise platforms.
  • Problem-Solving Skills: Strong analytical abilities with a knack for troubleshooting and optimising complex data workflows.
  • Communication Skills: Excellent ability to engage with both technical and non-technical stakeholders, providing clear and confident guidance.
  • Adaptability: Comfortable working across various sectors and with diverse clients, adjusting approaches as needed.
  • Travel Readiness: Open to occasional travel (up to 25%) depending on project requirements.
  • Palantir Foundry experience is an added bonus!

As a SC or DV Cleared Senior Data Consultant or Analyst, you’ll lead the charge on some of the most complex, high-impact data programmes in the UK, helping clients unlock the power of their data while mentoring the next generation of engineering talent.

Please do not hesitate to reply and reach out to Morela today to find out more!

Page 1 of 7
Frequently asked questions
Haystack features a wide range of Data Engineer roles in London, including positions in startups, established tech companies, financial institutions, and more, covering junior to senior levels.
Most London-based Data Engineer jobs require valid work authorization or visa sponsorship. Job listings typically specify these requirements to help you apply accordingly.
Yes, many employers offer remote or hybrid working options for Data Engineers in London. You can filter job listings based on work location preferences on Haystack.
Key skills include proficiency in SQL, Python, ETL tools, cloud platforms like AWS or Azure, and experience with big data technologies such as Hadoop or Spark.
You can browse listings, create a profile, upload your CV, and apply directly through the platform. Many listings also provide contact details for recruiters if you prefer direct communication.