Make yourself visible and let companies apply to you.
Roles
Data Engineer Jobs
Overview
Looking for top Data Engineer jobs? Explore the latest data engineering opportunities on Haystack, your go-to IT job board. Whether you're skilled in ETL, data pipelines, or big data technologies, find the perfect role to advance your career today. Start your search for Data Engineer positions now!
Data Manager
Circle Group
Manchester
Hybrid
Senior - Leader
Private salary
RECENTLY POSTED

Technical Manager / Data Manager / Python / AWS

Not every Engineering Manager role is about running sprints or firefighting delivery issues.

This one is about building strong teams, setting clear technical direction, and helping a data platform mature in a way that is sustainable, consistent and genuinely useful to customers.

You will not be coding day to day, but this is not a hands off role either. It suits an Engineering Manager who is comfortable going deep on architecture, data models and trade offs, and who enjoys working closely with senior engineers and tech leads to get the best outcomes.

What you will be responsible for

You will lead engineering across a set of data product teams, with responsibility for both people and outcomes.

That includes:

  • Teams building and maintaining data feeds, datasets and client facing outputs
  • The evolution of shared data models and event schemas, making products more consistent and easier to extend
  • The automation and internal tooling that improves quality and efficiency, including testing, rules engines and AI assisted workflows

You will own direction and delivery across these areas, making sure teams are aligned, supported and focused on the right problems.

What you will be working on day to day

In practice, you will:

  • Own the roadmap and execution for data products spanning multiple domains such as apps, web, media, social and commerce
  • Lead teams responsible for schemas, datasets and reporting outputs used directly by customers
  • Drive improvements to data models and event structures, reducing complexity and inconsistency
  • Shape and prioritise work on automation and internal tools that reduce manual effort and raise quality
  • Partner closely with Product, Data Engineering and ML, Apps, QA and client facing teams
  • Hire, develop and support engineers and tech leads through one to ones, feedback and career development
  • Establish and improve engineering practices around observability, data quality, documentation, incident response and service levels

This role has real scope, technically, organisationally and culturally.

Who this role suits

This role is a strong fit if you:

  • Enjoy leading engineers, not just managing work
  • Have a solid technical background and like being able to challenge designs and assumptions
  • Care about building well modelled, trustworthy data products
  • Are comfortable balancing delivery, quality and long term platform health
  • Like working cross functionally and navigating real world constraints

You will likely bring:

  • Proven experience as an Engineering Manager or Tech Lead Manager in a data, platform or backend environment
  • A background in data or backend engineering, such as AWS, Python or Scala, Spark, Airflow or similar
  • Experience owning or supporting analytics, data or reporting products
  • Strong people leadership skills including hiring, coaching and performance management
  • A track record of delivering complex, cross functional initiatives

Nice to have:

  • Experience with automation or test tooling
  • Familiarity with data privacy and governance, such as GDPR or consented data

How you will work

  • Hybrid role, Manchester based
  • Two days per week in the office, the rest flexible
  • Flexible start and finish times
  • Full home working setup provided

For further details and to apply, please get in touch with jon.brass @ circlerecruitment.com

Engineering Manager - Data Products /Technical Manager / Data Manager / Python / AWS

Circle Recruitment is acting as an Employment Agency in relation to this vacancy. Earn yourself a referral bonus if you refer somebody else who fills the role! We also offer an iPad if you refer a new client to us and we recruit for them. Follow us on Facebook - Circle Recruitment , Twitter - @Circle_Rec and LinkedIn - Circle Recruitment.

Machine Learning Engineer
Run-Time Group Ltd
London
Hybrid
Mid - Senior
Private salary
RECENTLY POSTED

Machine Learning Engineer Full Time London - Hybrid

Were partnering with a rapidly scaling PropTech SaaS business transforming how property data is enriched, automated, and delivered across multi-tenant environments. Theyre now hiring a Machine Learning Engineerto help build intelligent, production-grade ML systems at the core of their platform. Responsibilities Build and deploy machine learning models into production.

Develop ML systems optimised for a multi-tenant SaaS platform.

Create ETL pipelines for large, complex property datasets.

Monitor, tune, and iterate on model performance.

Collaborate with product and engineering teams on ML-driven features.

Document solutions and communicate clearly with technical and non-technical stakeholders.

Key Skills 4+ years as a Machine Learning Engineer or similar role.

Strong Pythonengineering skills.

Experience deploying ML models in production.

Understanding of multi-tenant SaaS architecture.

Solid ETL, data processing, and feature engineering experience.

Strong statistical and analytical capabilities.

Experience in start-up or scale-up environments.

Desirable MLOps tools (MLflow, Kubeflow, Sagemaker, etc.)

Experience in PropTech or property data.

Cloud experience (AWS/GCP/Azure).

Docker/Kubernetes, CI/CD, and event-driven data tools (Kafka/Kinesis).

Knowledge of data governance in SaaS environments.

TPBN1_UKTJ

Business Intelligence Developer
Ashurst
Glasgow
Hybrid
Mid - Senior
Private salary

The Opportunity

We have an exciting opportunity for a Business Intelligence Developer to join Ashurst’s global Business Intelligence team on a full-time, permanent basis.

The role holder will proactively support management in achieving the Firm’s strategy by engaging in operational Business Intelligence activities which may include, but are not limited to:

  • Implementing data warehouse designs that support demands for business intelligence and data analytics;
  • Identifying and validating internal and external data sets generated from a diverse range of business and operational processes;
  • Transforming the results of analysis into information that can be communicated to stakeholders using dashboards and reports;
  • Interpreting and analysing data, comparative analysis, benchmarking, trend analysis;
  • Focusing on data quality to provide confidence for making decision on a single version of the truth.

The role is based in our Glasgow office with hybrid working.

A full job description including a breakdown of responsibilities can be found attached to the role on our careers page.

We are interested in hearing from people who have:

  • Extensive (circa 5 years) business intelligence experience - deep knowledge of dimensional modelling and the BI domain, both current and future trends. Knowledge of data protection legislation globally, and data management is highly desirable.
  • Demonstrated capability to gather and translate data requirements from stakeholders into repeatable, performant processes and reporting structures.
  • Good knowledge of Cloud concepts, or the ability to learn the techniques and technology necessary to implement an enterprise data platform with such technology.
  • Proactive approach, self-motivated with the ability to work to realistic and challenging goals. Common-sense style of working, works within policy and procedure but remains business enabling.
  • Excellent interpersonal skills with the ability to communicate clearly and persuasively, orally or in writing, at all levels.
  • Experience working with Databricks, Python, Azure (not essential but very beneficial).

What makes Ashurst a great place to work?

We offer you all the things you should expect from an international law firm, some of which include:

  • competitive remuneration with the flexibility to reward high performance;
  • flexible working;
  • corporate health plans;
  • a global professional development offering for all employees; and
  • an industry-leading programme that celebrates diversity and inclusion.

We are committed to delivering positive impacts to our communities through our Social Impact programme.

We aim to recruit, retain and promote the best people from the widest possible talent pools. We are committed to offering a safe and welcoming environment for all employees to ensure they are supported to work at their best.

Beyond this, what sets Ashurst apart from others is our global strength, our drive to innovate and collaborate, and our commitment to excellence. It is these values that make Ashurst a unique place to work.

Interim Customer Master Data Manager
HAYS
Birmingham
Hybrid
Senior - Leader
£350/day
TECH-AGNOSTIC ROLE

Location: Birmingham (Hybrid working)
Requirement: DBS Check
Contract: Interim Assignment

About the RoleHays are partnering with a local council to build a new project team focused on transforming and improving customer records. We are recruiting an Interim Customer Master Data Manager to lead a team of four and oversee all technical and operational customer data processes.

This is a key role within an important transformation programme, ensuring the delivery of accurate, compliant and high-quality customer master data across the organisation.

Key Responsibilities
Leadership & Delivery

  • Lead and manage all Customer Master Data processes, ensuring accuracy, compliance and operational efficiency.
  • Ensure all deadlines, SLAs and targets are consistently met.
  • Manage, allocate and quality-check the work of a team of four.
  • Ensure team members are trained and able to perform duties to the required standard.

Customer Records & Compliance

  • Deliver and maintain accurate, up-to-date and fit-for-purpose customer records.
  • Oversee processes relating to Accounts Receivable, Line of Business systems, compliance reporting and DDI hand-off.
  • Ensure all processes comply with statutory regulations, council policies and internal/external audit requirements.
  • Lead interactions with a wide range of stakeholders, adapting communication for varying levels of understanding.

Fraud Prevention & Data Integrity

  • Take ownership of fraud prevention within Customer Master Data, ensuring records are accurately created and maintained.
  • Lead investigations into duplicate customer accounts and potential fraud cases.
  • Analyse complex compliance data and produce regular and ad-hoc financial reports and KPIs.

Project & System Support

  • Support the programme with data management activities related to Oracle or SAP customer management systems.
  • Continue the data cleanse for newly created customer records.
  • Test processes and act as proof of concept/validation for new data initiatives.

About YouYou will bring:

  • Strong experience working with Oracle or SAP for customer management or master data.
  • Proven experience managing customer master data, compliance and operational processes.
  • Experience leading teams within a data or finance environment.
  • Strong analytical skills and the ability to interpret complex data.
  • Understanding of fraud prevention processes and data governance.
  • A proactive, detail-oriented approach to improving data quality.

If you are an experienced data professional with a background in customer records and a passion for improving data quality and compliance, please send your updated CV!

Hays Specialist Recruitment Limited acts as an employment agency for permanent recruitment and employment business for the supply of temporary workers. By applying for this job you accept the T&C’s, Privacy Policy and Disclaimers which can be found at hays.co.uk

Geospatial Software Engineer
Bright Purple Resourcing
Bath
Fully remote
Mid - Senior
£420/day

Geospatial Data Engineer - Contract
Remote UK
£420 per day
12 Months - the entirety of 2026 into 2027
Deemed Outside IR35 (pending QDOS assessment)
This Contract Geospatial Data role is a fantastic opportunity to work on cutting edge data problems at a leading environmental risk consultancy. The position has arisen due to the success and growth of Bright Purple’s impressive established client. They are a leading player in their field with a powerful and highly regarded platform built using the latest technologies.
You will be working in a team of software and data engineers supporting data workflow & orchestration, within an AWS environment and must have experience of RASTER data sets.
In this role, you will be:

  • Developing ETL pipelines - Raster, Vector, Tabular data
  • Configuring CI/CD pipelines
  • Managing data storage within an AWS environment
  • Improving data automation, workflow and efficiency
  • Developing Python based ML pipelines

Key skills for this role include:

  • Good knowledge of Python programming
  • Experience in cloud computing (ideally AWS)
  • Strong experience across industries in both Geospatial and non-Geospatial domains
  • Experience with Machine Learning (sci-kit learn, tensorflow, metaflow, MLOps)

Preferred Experience:

  • Experience with frameworks like Metaflow, Prefect, etc.
  • Experience with geospatial libraries i.e. Raster, Geo-pandas, Vector databases

Bright Purple is an equal opportunities employer: we are proud to work with clients who share our values of diversity and inclusion in our industry.

Data Engineer
Anson McCade
Multiple locations
Hybrid
Mid - Senior
£90,000

Data Engineer Hybrid / UK (DV Clearance Required)

We are working with a leading global consultancy to hire a DV-cleared Data Engineer who will turn complex data into actionable insights. In this role, youll collaborate with multidisciplinary teams to design, build, and optimise production data pipelines, delivering scalable, high-impact digital solutions across a variety of sectors.

About the company:
Our client operates at the intersection of strategy, technology, and innovation. With a diverse team of over 4,000 experts across the UK, Ireland, US, Nordics, and Netherlands, they help clients adapt and transform across multiple industries, including consumer and manufacturing, defence and security, energy and utilities, financial services, government, health and life sciences, and transport.

The role:
As a DV-cleared Data Engineer, youll work alongside cross-functional teams to design, build, and optimise production data pipelines. Youll leverage AWS cloud technologies and open-source tools to transform complex data into scalable solutions that power decision-making and innovation.

Why you should apply:

  • Collaborate with product, design, and technology experts to bring ideas to life through innovative software solutions.
  • Progress your career on a technical track in a supportive, inclusive, and trust-based environment.
  • Hybrid working: minimum two days per week in the office or on client site.
  • Work on diverse projects with varied tech stacks across multiple industries.
  • Access professional development, including technical courses, certifications, mentoring, and coaching.

Tech stack:

  • AWS cloud (EMR, Glue, RedShift, Kinesis, Lambda, DynamoDB) for ETL, data lake/warehouse design, and data movement.
  • Programming: Java, Python, Scala, Spark, SQL.
  • Experience integrating and processing large-scale structured and unstructured datasets from multiple sources on AWS cloud.

Essential requirements:

  • DV clearance is mandatory.
  • Strong problem-solving and analytical skills.
  • Collaborative mindset, comfortable working with multiple stakeholders in fast-paced environments.
  • Proven experience designing and deploying production data pipelines from ingestion to consumption.
  • Familiarity with API data extraction, scripting, and SQL querying.
  • Experience processing large-scale data in cloud environments (AWS preferred)

What’s in it for you?

  • 25 days annual leave (+ Christmas Eve half-day) with option to buy additional days
  • Private healthcare for you and your family
  • Generous pension scheme and performance-based bonus
  • Share ownership and tax-efficient benefits
  • Community, charity initiatives, and career development support

Ok I’m in what’s next?
Please apply with your latest CV

Data Engineer DV Cleared
SoCode Limited
Bristol
Remote or hybrid
Mid - Senior
£45,000 - £90,000
+2

About the Role I am working with a growing consultancy delivering high-impact data solutions across secure government and defence environments. Due to continued project wins, we are looking for experienced DV Cleared Data Engineers to join their team.

You will work on mission-critical programmes, designing and building scalable, secure, and high-performing data platforms in AWS environments.

Key Responsibilities

Design, build, and maintain secure data pipelines and ETL processes

Develop scalable data lake and data warehouse solutions in AWS

Implement infrastructure-as-code and CI/CD for data platforms

Optimise data workflows for performance, reliability, and cost-efficiency

Collaborate with architects, analysts, and client stakeholders

Ensure solutions meet strict security and compliance requirementsEssential Skills & Experience

Active DV Clearance (mandatory)

Strong hands-on experience with AWS data services (e.g., S3, Glue, Lambda, Redshift, EMR, RDS)

Proficiency in Python and/or Scala

Experience with SQL and data modelling

Knowledge of infrastructure as code (Terraform / CloudFormation)

Experience building production-grade data pipelines

Strong understanding of security best practices in cloud environmentsDesirable Experience

Experience working within government or defence sectors

Familiarity with DevOps and CI/CD tooling

Containerisation (Docker / Kubernetes)

Streaming technologies (Kafka / Kinesis)What We Offer

Competitive salary (£45,000 – £90,000 depending on experience)

Performance bonus

Flexible working arrangements

Private healthcare

Pension contribution

Ongoing training and AWS certifications

Opportunity to work on high-profile national programmes

Level 5 Data Engineer Apprentice
Surrey County Council
Reigate
Hybrid
Graduate - Junior
£24,330 - £24,330

This role has a starting salary of £24,330 per annum, based on a 36-hour working week. This role is a 24-month fixed term apprenticeship opportunity. We are excited to be recruiting a Level 5 Data Engineer Apprentice to join the dynamic Data Insight Team with the Surrey Fire and Rescue Service. Based at Woodhatch Place in Reigate, this role operates on a hybrid working model, with a minimum of two days per week in the office. There may be occasional travel within the county, and when appropriate, you'll also have the flexibility to work from a local fire station or a Surrey County Council premises. Our Offer to You The chance to get paid to learn and use your own personal talents to shape your future 26 days' holiday, rising to 28 days after 2 years' service and 31 days after 5 years' service (prorated for part time staff) Option to buy up to 10 days of additional annual leave A generous local government salary related pension Up to 5 days of carer's leave and 2 paid volunteering days per year Paternity, adoption and dependents leave A generous local government salary related pension Lifestyle discounts including gym, travel, shopping and many more 2 paid volunteering days per year Learning and development hub where you can access a wealth of resourcesAbout Us Our Data Insight Team at Surrey Fire and Rescue Service plays a vital role in keeping our communities safe. We manage and analyse life-critical information that supports operational decision-making and risk management. From creating and maintaining accurate data systems to developing innovative solutions, our work ensures firefighters have the information they need when it matters most. We work collaboratively with other data and technology specialists to deliver reliable, effective tools that meet business needs. About your Apprenticeship We want this apprenticeship to be an opportunity for you to gain experience across a wide range of duties putting you in the best position to succeed in your apprenticeship qualification and take the first steps on your career journey! This apprenticeship is a 24-month development programme, consisting of 20% off the job training (e.g. attending lectures, online learning, shadowing, learning support, written assessments) and 80% on the job learning. In this role, you will: Design and build data pipelines to collect, transform, and load data for analytics and reporting. Re-engineer manual data flows into automated, scalable Extract, Transform, Load or streaming solutions. Support and manage data streaming systems, monitoring performance and resolving issues promptly. Ensure data quality, accuracy and compliance with governance and security standards. Collaborate with technology teams and communicate solutions clearly to non-technical stakeholders.We won't be expecting you to jump in and be able to do this all from day one. You'll first go through an induction period allowing you to get used to the office and the team. As you gain more confidence in your role, you'll be supported to do more and more! The learning side of your apprenticeship will be delivered by a provider of your choice from our approved list. We will support you throughout the process to help you select the provider that best fits your needs and preferences. As your qualification comes to an end and you begin to turn your eye to the future, we have a fantastic support programme in place that will put you in the best position to take the next step on your exciting career journey. Our desire is for all our apprenticeships to be the first step on a long and successful career journey within SCC. Your Application In order to be considered for shortlisting, your application will clearly evidence the following skills and align with our behaviours: Attention to detail and accuracy. Problem-solving and analytical thinking Ability to learn new technologies quickly and adapt to evolving tools and processes. Effective communication skillsTo apply, we request that you submit a CV, and you will be asked the following 4 questions: Why are you interested in becoming a Data Engineer? Describe your interest in data, technology, or analytics and how you have explored these areas so far. This apprenticeship involves learning new technologies and concepts quickly. How do you approach learning something unfamiliar? Tell us about a time you had to communicate complex information to a non-technical audience. How did you ensure they understood? Describe a situation where you worked as part of a team to achieve a goal. What was your role?Skills and Knowledge Training will be provided as part of the apprenticeship, ensuring you have the support you need to develop all the required skills. However, having a basic understanding of data or some initial familiarity or experience with data engineering concepts, tools, or programming languages would be beneficial. For example, exposure to tools such as FME (Feature Manipulation Engine) for spatial data processing, SQL for database querying and management, Python for data transformation and automation, or Excel for data manipulation can help you adapt more quickly. Any existing knowledge in these areas will support your learning and enable you to contribute effectively to our data‑driven projects. Please note: This apprenticeship is only available for those who will not be enrolled in another government funded programme as of 1st September 2025 and do not possess a qualification at a higher or the same level as this one in the same or similar subject. If you have any questions regarding your eligibility please contact . If you do not hold an English and Maths GCSE graded A-C or 4-9, you will be required to complete these in addition to the apprenticeship. Additional tutoring and support will be provided. The job advert closes at 23:59 on 04/03/2026 with interviews to follow. Our Commitment We are a disability confident employer which means if you have shared a disability on your application form and have evidenced you meet the minimum criteria, we guarantee you an interview. Your skills and experience truly matter to us. From application to your first day, we're committed to supporting you with any adjustments you need, we value inclusion and warmly welcome you to join and help build a workplace where everyone belongs

AI Engineer - AI Foundry
Real
Egham
Fully remote
Mid - Senior
£500/day - £700/day
TECH-AGNOSTIC ROLE

We have a current opportunity for a Foundry AI Engineer on a contract basis. The position will be based in Egham. For further information about this position ple

AI Engineer - Contract Role

I am working with a university that is looking for an AI Engineer with experience in AI Foundry to support the implementation of a number of new use cases.

This is a remote contract for approximately three months.

The role is outside IR35, with a start date planned for early to mid‑March.

Job Description

Title: AI Engineer
Contract: 3 months
Location: Remote
IR35 Status: Outside IR35
Start: Early to mid‑March

Overview
The university is delivering a series of AI initiatives and requires an AI Engineer with hands‑on experience in AI Foundry to support the design, build, and deployment of AI use cases across the organisation.

Responsibilities
* Work with stakeholders to understand business requirements and translate them into AI use cases.
* Build, deploy, and optimise AI models within AI Foundry.
* Develop pipelines, workflows, and integrations needed to operationalise AI solutions.
* Work closely with data teams, product teams, and technical leads to ensure successful delivery.
* Troubleshoot issues and ensure models perform effectively in a production environment.
* Provide documentation, knowledge transfer, and support the internal team throughout delivery.

Requirements
* Proven experience as an AI Engineer or similar role.
* Hands‑on experience working with AI Foundry.
* Strong understanding of machine learning, model development, and deployment workflows.
* Experience with data pipelines, ML Ops, or cloud‑based AI tooling.
* Ability to work autonomously in a fast‑paced project environment.
* Strong communication skills and ability to collaborate with both technical and non‑technical teams.

ase apply.

Please click to find out more about our Key Information Documents. Please note that the documents provided contain generic information. If we are successful in finding you an assignment, you will receive a Key Information Document which will be specific to the vendor set-up you have chosen and your placement.

To find out more about Real, please visit

Real Staffing, a trading division of SThree Partnership LLP is acting as an Employment Business in relation to this vacancy | Registered office | 8 Bishopsgate, London, EC2N 4BQ, United Kingdom | Partnership Number | OC(phone number removed) England and Wales

Data Engineer
Hays Technology
Glasgow
Hybrid
Junior - Mid
£55,000

Your new company You will be working at the UK's largest public ultra‑rapid electric vehicle charging network, known for its reliability, simplicity, and customer‑first approach. Founded in 2016, the company operates high‑power DC chargers ranging from 50kW to 160kW, delivering fast, hassle‑free charging across convenient locations nationwide. The company continues to expand rapidly, with over (phone number removed) live chargers across the UK as of late 2024 and a growing presence in Europe, supported entirely by 100% renewable energy. With chargers positioned at popular retail and hospitality partners such as McDonald's, Costa Coffee and Bannatyne Health Club this company enables drivers to "recharge" themselves while charging their vehicles. Their focus on user convenience includes simple contactless payments, transparent pricing, and a reputation for industry‑leading reliability. Recognised as one of the most dependable networks in the UK, they continue to scale their infrastructure to meet growing EV demand, supporting the transition to cleaner, more sustainable transport nationwide. Your new role You'll work with the Senior Data Engineer and wider teams to maintain and improve InstaVolt's data warehouse and data pipelines. Your main focus will be integrating new data sources, building data models, fixing issues, and helping the team expand our data capabilities. This role is ideal for someone who enjoys problem‑solving, learning new tools, and working with data. Key responsibilities include - Keeping an eye on data systems & fixing issues when they arise. - Building, updating & maintaining data models using dbt core and vs code. - Reviewing new potential data sources. - Connecting new data sources to the internal data pipeline and data warehouse. What you'll need to succeed - Technical - Strong SQL skills - Experience using dbt - Ability to model business processes using SQL in dbt - Familiarity with Git and version control. - An understanding of cloud data warehouse concepts. - Basic knowledge of SOAP/REST API's, JSON and YAML. - Basic Python for API data retrieval and data movement. Soft skills - Have a logical and problem-solving mindset - Be comfortable working both independently and with other members of the business. - Have strong relationship building skills across teams. - Positive attitude and eagerness to grow your technical knowledge - High attention to detail What you'll get in return - Hybid working (3 days a week in the office). - Join a fast growing company - Competitive Salary - £55,000 - Expert training and development opportunities - Employees contribute directly to reducing carbon emissions and supporting environmentally friendly transportation. What you need to do now If you're interested in this role, click 'apply now' to forward an up-to-date copy of your CV. If this job isn't quite right for you, but you are looking for a new position, please contact us for a confidential discussion about your career. Hays Specialist Recruitment Limited acts as an employment agency for permanent recruitment and employment business for the supply of temporary workers. By applying for this job you accept the T&C's, Privacy Policy and Disclaimers which can be found at (url removed)

Data Scientist (Government)
Hays Technology
London
Remote or hybrid
Mid - Senior
£300/day - £310/day

Your new company Working for a globally renowned consultancy (end client is a public sector organisation). Your new role We are offering an exciting opportunity for a Data Scientist to join our expanding AI delivery team. In this role, you will work hands-on as an AI engineer, data scientist, and developer, contributing to the design and delivery of strategic AI initiatives. You'll help build intelligent solutions, automate processes, and apply modern AI technologies to real business challenges within a public sector environment. What you'll need to succeed Must have lived in the UK for a minimum of 5 years (essential for security clearance checks). Experience with key AI platforms and tools, including: Microsoft Copilot / Copilot Studio Experience configuring or building AI-driven workflows, copilots, or automation solutions. Familiarity with prompt design, data integration, and governance within the Microsoft ecosystem is beneficial. AWS Bedrock Hands-on experience using Bedrock to access and apply foundation models for tasks such as text generation, summarisation, classification, or search. Understanding how to integrate Bedrock models into wider AWS services is advantageous. IBM ICA (Intelligent Content Analysis) - Desirable Useful experience with document understanding, processing unstructured data, and rule‑based or AI‑assisted content analysis. What you'll get in return Flexible working options available. What you need to do now If you're interested in this role, click 'apply now' to forward an up-to-date copy of your CV, or call us now. Hays Specialist Recruitment Limited acts as an employment agency for permanent recruitment and employment business for the supply of temporary workers. By applying for this job you accept the T&C's, Privacy Policy and Disclaimers which can be found at (url removed)

Data Engineer
Hays Technology
London
Fully remote
Mid
£300/day - £310/day

Your new company
Working for a renowned global consultancy.
This is a remote role with very rare possible to onsite visits in Hursley

Your new role
Seeking a Data Engineer to help to design, build, and maintain reports and interactive dashboards using Power BI. Translate business requirements into meaningful insights through data modelling, DAX measures, and visualisations. Work closely with data engineers to ensure data accuracy, availability, and quality. Support the data team by maintaining data dictionaries, metrics definitions, and documentation. Perform data validation, analysis, and ad-hoc reporting while adhering to data governance, security, and compliance standards.

What you’ll need to succeed

  • Strong experience with Power BI (report building, dashboards, DAX, data modelling)
  • Proficiency in SQL for querying, validating, and analysing data
  • Solid understanding of data modelling concepts (e.g. star schema, facts and dimensions)
  • Experience working with data warehouses and/or data lakes
  • Ability to create and maintain data dictionaries and metrics definitions
  • Strong analytical and problem-solving skills
  • Ability to communicate insights clearly to technical and non-technical stakeholders
  • Understanding of data governance, security, and data quality principles

What you’ll get in return
Flexible working options available.

What you need to do now
If you’re interested in this role, click ‘apply now’ to forward an up-to-date copy of your CV, or call us now.

Hays Specialist Recruitment Limited acts as an employment agency for permanent recruitment and employment business for the supply of temporary workers. By applying for this job you accept the T&C’s, Privacy Policy and Disclaimers which can be found at (url removed)

Python Developer
Parkside
Not Specified
In office
Senior
Private salary

Senior Python Developer
London Contract Energy / Trading Environment£400-£425 per day (Inside IR35)

We are supporting a leading organisation operating within the energy and commodities space who are looking to engage a Senior Python Developer to support the build-out of advanced data-driven applications and analytical tools.

This is a hands-on engineering role working at the intersection of data, analytics and front-office stakeholders. You will be responsible for building clean, modular Python applications, manipulating complex datasets, and delivering interactive dashboards used for commercial insight.

The Role

You will:

  • Develop robust, production-grade Python applications
  • Manipulate and analyse large datasets using pandas and numpy
  • Build interactive dashboards using Plotly Dash
  • Design modular, reusable and well-tested code
  • Integrate with REST APIs and backend services
  • Collaborate with commercial and technical stakeholders to translate requirements into scalable solutions
  • This is a highly technical role suited to someone who enjoys building clean systems rather than quick scripts.

Required Experience

  • Hands-on Python development experience
  • Strong object-oriented programming skills
  • Deep experience with pandas and numpy for data manipulation
  • Experience with virtual environments, dependency management and packaging
  • Strong understanding of software engineering best practices including Git, unit testing (pytest), documentation and code quality tools
  • Experience building data-driven applications in a commercial environment.
Lead Data Engineer
Head Resourcing
Glasgow
Hybrid
Senior
£70,000 - £85,000
+4

Lead Data Engineer (Azure / Databricks)

NO VISA REQUIREMENTS

MUST BE BASED NEAR GLASGOW TO WORK 3 DAYS ONSITE

My FMCG client is undergoing a major transformation of their entire data landscape-migrating from legacy systems and manual reporting into a modern Azure + Databricks Lakehouse. They are building a secure, automated, enterprise-grade platform powered by Lakeflow Declarative Pipelines, Unity Catalog and Azure Data Factory.
They are looking for a Lead Data Engineer to help deliver high-quality pipelines and curated datasets used across Finance, Operations, Sales, Customer Care and Logistics.

What You’ll Do

Lakehouse Engineering (Azure + Databricks)

  • Build and maintain scalable ELT pipelines using Lakeflow Declarative Pipelines, PySpark and Spark SQL.
  • Work within a Medallion architecture (Bronze ? Silver ? Gold) to deliver reliable, high-quality datasets.
  • Ingest data from multiple sources including ChargeBee, legacy operational files, SharePoint, SFTP, SQL, REST and GraphQL APIs using Azure Data Factory and metadata-driven patterns.
  • Apply data quality and validation rules using Lakeflow Declarative Pipelines expectations.

Curated Layers & Data Modelling

  • Develop clean and conforming Silver & Gold layers aligned to enterprise subject areas.
  • Contribute to dimensional modelling (star schemas), harmonisation logic, SCDs and business marts powering Power BI datasets.
  • Apply governance, lineage and permissioning through Unity Catalog.

Orchestration & Observability

  • Use Lakeflow Workflows and ADF to orchestrate and optimise ingestion, transformation and scheduled jobs.
  • Help implement monitoring, alerting, SLAs/SLIs and runbooks to support production reliability.
  • Assist in performance tuning and cost optimisation.

DevOps & Platform Engineering

  • Contribute to CI/CD pipelines in Azure DevOps to automate deployment of notebooks, Lakeflow Declarative Pipelines, SQL models and ADF assets.
  • Support secure deployment patterns using private endpoints, managed identities and Key Vault.
  • Participate in code reviews and help improve engineering practices.

Collaboration & Delivery

  • Work with BI and Analytics teams to deliver curated datasets that power dashboards across the business.
  • Contribute to architectural discussions and the ongoing data platform roadmap.

Tech You’ll Use

  • Databricks: Lakeflow Declarative Pipelines, Lakeflow Workflows, Unity Catalog, Delta Lake
  • Azure: ADLS Gen2, Data Factory, Event Hubs (optional), Key Vault, private endpoints
  • Languages: PySpark, Spark SQL, Python, Git
  • DevOps: Azure DevOps Repos & Pipelines, CI/CD
  • Analytics: Power BI, Fabric

What We’re Looking For

Experience

  • Commercial and proven Lead Data Engineering experience.
  • Hands-on experience delivering solutions on Azure + Databricks.
  • Strong PySpark and Spark SQL skills within distributed compute environments.
  • Experience working in a Lakehouse/Medallion architecture with Delta Lake.
  • Understanding of dimensional modelling (Kimball), including SCD Type 1/2.
  • Exposure to operational concepts such as monitoring, retries, idempotency and backfills.

Mindset

  • Good energy and enthusiasm
  • Keen to grow within a modern Azure Data Platform environment.
  • Comfortable with Git, CI/CD and modern engineering workflows.
  • Able to communicate technical concepts clearly to non-technical stakeholders.
  • Quality-driven, collaborative and proactive.

Why Join?

  • Opportunity to shape and build a modern enterprise Lakehouse platform.
  • Hands-on work with Azure, Databricks and leading-edge engineering practices.
  • Real progression opportunities within a growing data function.
  • Direct impact across multiple business domains.
Database Developer
First Databank
Exeter
Hybrid
Mid - Senior
Private salary

Exeter, Devon (Hybrid with 2 days per week in office)

About Us

At FDB (First Databank), we create and deliver the world s most trusted drug knowledge, enabling healthcare professionals to make critical decisions that improve patient safety, efficiency, and outcomes. Our solutions are embedded across hospitals, GP practices, pharmacies, and wider healthcare systems, supporting millions of patients every day.

Our values guide everything we do: Better Together, Clear Expectations, Constantly Curious, and Health at the Heart. If these resonate with you, you ll feel right at home with us.

The Opportunity

We’re looking for a talented Database Developer to join us on a full-time, permanent basis.

This is an exciting opportunity to work at the heart of innovative healthcare technology, shaping and optimising complex database environments that operate at the cutting edge of the medical industry.

We ll enable you to grow your expertise in modern data platforms and AI-supported development tools, work alongside like-minded and exceptional people and further develop your technical capabilities.

The Role

As a Database Developer, you will design, develop and test high-quality database applications that support both internal systems and external business solutions.

Specifically, you ll seek to improve processes, solve complex business problems and work in a collaborative style to support your colleagues. You ll provide resource estimates and progress updates, as well as ensuring documentation can be understood.

Working in our agile environment, you will follow Scrum and SOLID principles, take part in structured testing, including TDD, design reviews, code walkthroughs and inspections, and contribute to continuous improvement.

You will work with internal and external customers to capture requirements, such as user stories and supporting analysis, communicating technical concepts clearly to non-technical audiences. Supporting our 24/7 clinical prescribing production environment, you will ensure systems continue to meet the needs of new and existing prescribing platforms.

Additionally, you will:

  • Mentor colleagues in design and coding syntax/style
  • Utilise AI agentic tools within software development to enhance productivity and efficiency

About You

  • Relational database analysis and design experience
  • Experience with performance tuning
  • Data experience, including warehousing analytics and visualisation platform development, e.g. Power BI/Tableau
  • Evidence of high-level participation in database-orientated commercial projects
  • Proficient T-SQL development skills in Microsoft SQL Server from version 2016
  • Proficient in SSIS, SSRS and SSAS Development
  • Experience in using agentic AI environments i.e. Cline, Copilot, Gemini, etc.
  • Good communication skills, both verbal and written, both external and internal, for example, during agile ceremonies, writing updates for internal and external users

The Benefits

You will be joining a very supportive team where you will have the opportunity to grow and develop new skills. In addition, FDB offers:

  • Competitive salary
  • 25 working days holiday per annum plus statutory holidays
  • Flexible option for employees to take additional holiday
  • Annual company bonus scheme
  • Health and Wellbeing allowance
  • HealthShield flexible health cash-back scheme
  • Electric Vehicle scheme
  • Enhanced pension scheme
  • Cycle to work scheme
  • Charity days
  • Full flexible working
  • Enhanced maternity/paternity schemes
  • and many more !

Other organisations may call this role SQL Developer, Senior SQL Developer, Database Engineer, BI Developer, Data Warehouse Developer, or SQL Server Developer.

Azure Data Engineer
VIQU IT
London
Hybrid
Mid
£300/day - £400/day

Azure Data Engineer - 3 6-month contract

We are looking for a Data Engineer to join a growing digital and data function supporting a modern, cloud-based data platform. This role focuses on building reliable, secure, and scalable data solutions that enable analytics, operational reporting, and data-driven decision making across the organisation.

You will work closely with technical and non-technical stakeholders to deliver well-engineered data pipelines and models, contributing to the continuous improvement of data platforms and engineering standards.

Azure data engineer responsibilities:

  • Build and support robust ELT data pipelines using Azure-based technologies and SQL
  • Develop structured data models aligned to modern data platform patterns
  • Ensure data solutions meet performance, security, quality, and reliability standards
  • Contribute to agile delivery, code reviews, and continuous improvement of engineering practices
  • Collaborate with stakeholders and technical teams to translate business needs into data solutions

Azure Data Engineer requirements:

  • Hands-on experience with Azure Data Factory, Databricks, and SQL-based databases
  • Strong understanding of data engineering principles, including ELT and data modelling
  • Experience working with CI/CD pipelines, automation, and testing
  • Knowledge of data governance, access control, and platform standards
  • Excellent communication and collaboration skills
  • Familiarity with modern data architectures such as Medallion patterns and metadata tools

This role will be hyrbid working - required to work 2 to 3 days per week onsite in London.

Apply now to speak with VIQU IT in confidence. Or reach out to Phoebe Thompson via the VIQU IT website.

Do you know someone great? We ll thank you with up to £1,000 if your referral is successful (terms apply).

For more exciting roles and opportunities like this, please follow us on IT Recruitment.

Data Modeller
Damia Group Ltd
London
Hybrid
Senior
£80,000 - £90,000

Data Modeller - London, hybrid - Salary 80 - 90k + 15% cash flex + benefits + bonus.

Role Overview

We are seeking a highly experienced Data Modeller with deep expertise in the Lloyd’s of London insurance market. The ideal candidate will be responsible for designing, implementing, and optimizing complex data models that support underwriting, claims, pricing, and regulatory reporting processes. This role requires a strong understanding of insurance data structures, market-specific standards, and advanced data architecture principles.

Key Responsibilities

  • Data Modelling & Architecture
    • Design and maintain conceptual, logical, and physical data models for insurance systems.
    • Ensure alignment with Lloyd’s market standards, including Core Data Record (CDR) and Blueprint Two initiatives.
    • Develop data dictionaries, metadata, and governance frameworks.
  • Data Integration & Transformation
    • Collaborate with business analysts, actuaries, and IT teams to integrate data from multiple sources (policy, claims, bordereaux, exposure).
    • Optimize data flows for reporting, analytics, and regulatory compliance.
  • Stakeholder Engagement
    • Work closely with underwriters, brokers, and market participants to understand data requirements.
    • Provide subject matter expertise on Lloyd’s data standards and market processes.
  • Quality & Compliance
    • Implement data quality checks and validation rules.
    • Ensure compliance with Lloyd’s market regulations, GDPR, and Solvency II requirements.

Required Skills & Experience

  • Technical Expertise
    • 10+ years of experience in data modelling within the Lloyd’s of London or London Market insurance sector.
    • Proficiency in ER modelling, relational and dimensional modelling, and data warehousing.
    • Strong SQL skills and experience with tools such as ERwin, PowerDesigner, or similar.
  • Domain Knowledge
    • Deep understanding of Lloyd’s market processes, including placement, claims, and regulatory reporting.
    • Familiarity with ACORD standards and Lloyd’s Blueprint Two data initiatives.
  • Analytical & Communication Skills
    • Ability to translate complex business requirements into robust data models.
    • Excellent stakeholder management and communication skills.

Preferred Qualifications

  • Experience with cloud-based data platforms (Azure,).
  • Knowledge of data governance frameworks and MDM (Master Data Management).
  • Exposure to advanced analytics and BI tools (Power BI, Tableau).

Damia Group Limited acts as an employment agency for permanent recruitment and employment business for the supply of temporary workers. By applying for this job you accept our Data Protection Policy which can be found on our website.

Please note that no terminology in this advert is intended to discriminate on the grounds of a person’s gender, marital status, race, religion, colour, age, disability or sexual orientation. Every candidate will be assessed only in accordance with their merits, qualifications and ability to perform the duties of the job.

Damia Group is acting as an Employment Business in relation to this vacancy and in accordance to Conduct Regulations 2003.

Data Engineer
Randstad Technologies Recruitment
London
Hybrid
Mid - Senior
£80,000 - £90,000

Data Engineer - Robotics

The Mission: Data infrastructure behind the world’s most advanced robots. You will curate and manage the massive datasets that allow our robots to learn, move, and interact with the physical world.

Key Responsibilities:

  • Pipeline Design: Build and maintain scalable data pipelines for ML training.
  • Data Curation: Preprocess large-scale datasets to ensure consistency and accuracy.
  • Quality Control: Develop metrics and reporting systems to monitor data integrity.
  • Security: Implement best practices for data versioning, security, and compliance.

Requirements:

  • Degree: BSc/MSc in Computer Science, Data Science, or similar.
  • Technical Skills: Strong proficiency in Python and SQL.
  • Experience: Proven track record in data engineering or data quality management.
  • ML Knowledge: Understanding of how data impacts machine learning performance.

Preferred:

  • Experience in Robotics or autonomous systems.
  • Familiarity with Cloud (AWS/GCP/Azure) storage and processing.

Randstad Technologies Ltd is a leading specialist recruitment business for the IT & Engineering industries. Please note that due to a high level of applications, we can only respond to applicants whose skills & qualifications are suitable for this position. No terminology in this advert is intended to discriminate against any of the protected characteristics that fall under the Equality Act 2010. For the purposes of the Conduct Regulations 2003, when advertising permanent vacancies we are acting as an Employment Agency, and when advertising temporary/contract vacancies we are acting as an Employment Business.

Back End Developer SPFYJP
Randstad Technologies Recruitment
London
Hybrid
Mid - Senior
£550/day - £600/day

Back End Developer / Engineer III (Java / GCP)

Duration:1 year contract

Location:London New office

Mode:Hybrid(2-3 days in office)

We are looking for a high-impact Back End Engineer to lead solution designs and execute end-to-end implementations of critical service capabilities.

Based in the CET timezone (Sweden, UK, or Germany), you will drive technical excellence in a collaborative environment that prioritizes fast decision-making and a strong bias for action.

Key Responsibilities

  • Solution Design: Lead the architecture and implementation of scalable features within our core services.
  • System Evolution: Execute meaningful changes to high-scale, complex distributed systems.
  • Collaboration: Drive engineering deep dives, technical workshops, and stakeholder demos.
  • Mentorship: Participate in tight feedback loops and peer reviews to elevate the team’s output.

Required Experience & Skills

  • Core Stack: Proven expertise in building and scaling services using Java, Postgres, and BigTable on Google Cloud Platform (GCP).
  • Data Engineering: Hands-on experience managing data pipelines, specifically utilizing Scio and Flight.
  • Domain Knowledge: Previous experience in E-commerce or Financial Engineering is highly preferred.
  • Communication: Exceptional writing and verbal skills; ability to translate complex technical concepts for diverse stakeholders.
  • Mindset: Self-driven, collaborative, and thrives in a high-autonomy environment.

Location & Timezone

  • This role operates on CET, supporting a distributed team across Sweden, the UK, and Germany.

Randstad Technologies is acting as an Employment Business in relation to this vacancy.

Software Engineer - Data Analytics
CBSbutler Holdings Limited trading as CBSbutler
Shropshire
Hybrid
Junior - Mid
£450/day
+8

Job Title: Data Engineer

Rate: 450 per day inside ir35

Duration: 6 months

Location: Telford/hybrid - (2 days on site)

SC security clearance is required for this role

Job Description:

You should have experience as a Software Engineer delivering within large scale data analytics solutions and the ability to operate at all stages of the software engineering lifecycle, as well as some experience in the following;

  • Awareness of Devops culture and modern engineering practices
  • Experience of Agile Scrum based delivery
  • Proactive in nature, personal drive, enthusiasm, willingness to learn
  • Excellent communications skills including stakeholder management

Have experience in some of the following technologies:

  • ETL toolset (Talend, Pentaho, SAS DI, Informatica etc)
  • Database (Oracle, RDS, Redshift, MySQL, Hadoop, Postgres, etc)
  • Job Scheduling toolset (Job Scheduler, TWS, etc)
  • Programming and scripting languages (PL/SQL, SQL, Unix, Java, Python, Hive, HiveQL, HDFS, Impala, etc)

Must have knowledge of these tools:

  • ALM Tooling (Jira, Confluence, Bitbucket)
  • CI/CD toolsets (Gitlab, Jenkins, Ansible)
  • Data virtualisation tools (Denodo)
  • Reporting (Pentaho BA, Power BI, Business Objects, Grafana)

If you are interested in this role or wish to apply, please feel free to submit your CV.

Data Engineer
BGTS LTD
London
Remote or hybrid
Mid - Senior
£60,000 - £70,000

As a Data Engineer, you will be responsible for:

Data Engineering & Development

  • Design, build, and maintain high-quality, scalable, and tested data pipelines.
  • Develop and manage Databricks structured streaming pipelines.
  • Build and optimize event-driven and real-time data processing solutions.
  • Implement and maintain Unity Catalog-based Lakehouse architecture.
  • Develop analytics-ready datasets to support business insights and reporting.

Platform & Automation

  • Build and manage CI/CD pipelines using Azure DevOps.
  • Identify and implement automation opportunities across workflows.
  • Ensure reliable and stable data platform operations.
  • Apply governance, security, and documentation standards.

Data Quality & Reliability

  • Establish the Data Lakehouse as a trusted and reliable source of truth.
  • Monitor, troubleshoot, and resolve data incidents.
  • Support business users and technical teams with data-related queries.
  • Continuously improve platform performance and reliability.

Collaboration & Support

  • Work closely with data science, analytics, platform, and business teams.
  • Champion data engineering best practices.
  • Provide technical guidance and mentorship where required.
  • Contribute to a culture of learning, quality, and continuous improvement.

Essential Skills

  • Strong experience with Azure Databricks and cloud data platforms.
  • Advanced proficiency in Python, PySpark, and SQL.
  • Experience developing Spark/Databricks pipelines.
  • Hands-on experience with structured streaming and event-driven systems.
  • Strong understanding of Lakehouse architecture and best practices.
  • Experience with Unity Catalog.
  • Expertise in Azure DevOps and CI/CD pipelines.
  • Knowledge of data modelling (dimensional/star schemas).
  • Experience working in Agile environments.

Desirable Skills

  • Exposure to multiple data technology stacks.
  • Experience in large-scale enterprise environments.
  • Knowledge of security, governance, and compliance frameworks.
Frequently asked questions
Typically, a Data Engineer should have a strong background in computer science or related fields, proficiency in programming languages like Python or Java, and experience with data warehousing, ETL processes, and big data technologies such as Hadoop or Spark.
Haystack features a wide range of Data Engineer positions, including roles in startups, large enterprises, and remote opportunities. You can find jobs specializing in cloud data engineering, real-time data processing, data pipeline development, and more.
To improve your chances, tailor your resume to highlight relevant skills and projects, gain hands-on experience with popular data tools, contribute to open-source projects, and stay updated with the latest trends in data engineering.
Yes, Haystack lists entry-level Data Engineer roles suitable for recent graduates or professionals transitioning into data engineering, as well as internships and junior positions to help you start your career.
Absolutely. Haystack offers many remote and flexible Data Engineer job listings to suit your preferred working style and location.