Make yourself visible and let companies apply to you.
Roles
Data Engineer Jobs
Overview
Looking for top Data Engineer jobs? Explore the latest data engineering opportunities on Haystack, your go-to IT job board. Whether you're skilled in ETL, data pipelines, or big data technologies, find the perfect role to advance your career today. Start your search for Data Engineer positions now!
Oracle Software Engineer
Spectrum IT Recruitment
Southampton
Hybrid
Junior - Mid
£38,000/day - £40,000/day
RECENTLY POSTED

Solving real problems with PL/SQL precision and designing ETL processes that unlock the true value of enterprise date. Work on complex data challenges, modern tooling, and create meaningful technical impact. Oracle Software Engineer Circa £38k + Up to 15% bonus Twice a month in the Southampton area based office The Role You'll join a cross-functional product team that thrives on pace, collaboration, and innovation. Every day, you'll help shape the data foundations that keep our products and services running seamlessly for thousands of users. You'll design and develop clean, efficient, and fully tested PL/SQL code, contributing your expertise to build reliable features that teams rely on. Working with our established data structures, you'll turn complex requirements into robust, performant database solutions. As a key participant in our sprint cycle, you'll embrace agile ways of working, bringing transparency, adaptability, and continuous improvement to everything you do. This role would suit Someone with commercial PL/SQL experience using ANSI syntax and a strong approach to unit testing. Experience with ETL processes, to handle data with confidence, turning it into reports and transformations that power the business. Experience with tools and frameworks like Bitbucket, JSON, REST, Confluence, Jira, TOAD, and Scrum And with skills in Python, Azure DevOps, APIs, or other databases, Current tech stack includes: Oracle, PL/SQL, ETL, Toad, Git, Jira, BitBucket, Agile, UT PL/SQL (Unit testing framework), Azure DevOps, API first, MongoDB, PostGres, Python This Oracle Software Engineer role is paying circa £38k with benefits including, 15% Bonus, 25 days holiday, enhanced pension, onsite gym, Car Scheme, healthcare scheme and more. Apply now or contact Chris Lynes at Spectrum IT for more information. Spectrum IT Recruitment (South) Limited is acting as an Employment Agency in relation to this vacancy

Data Manager
Circle Group
Manchester
Hybrid
Senior - Leader
Private salary
RECENTLY POSTED

Technical Manager / Data Manager / Python / AWS

Not every Engineering Manager role is about running sprints or firefighting delivery issues.

This one is about building strong teams, setting clear technical direction, and helping a data platform mature in a way that is sustainable, consistent and genuinely useful to customers.

You will not be coding day to day, but this is not a hands off role either. It suits an Engineering Manager who is comfortable going deep on architecture, data models and trade offs, and who enjoys working closely with senior engineers and tech leads to get the best outcomes.

What you will be responsible for

You will lead engineering across a set of data product teams, with responsibility for both people and outcomes.

That includes:

  • Teams building and maintaining data feeds, datasets and client facing outputs
  • The evolution of shared data models and event schemas, making products more consistent and easier to extend
  • The automation and internal tooling that improves quality and efficiency, including testing, rules engines and AI assisted workflows

You will own direction and delivery across these areas, making sure teams are aligned, supported and focused on the right problems.

What you will be working on day to day

In practice, you will:

  • Own the roadmap and execution for data products spanning multiple domains such as apps, web, media, social and commerce
  • Lead teams responsible for schemas, datasets and reporting outputs used directly by customers
  • Drive improvements to data models and event structures, reducing complexity and inconsistency
  • Shape and prioritise work on automation and internal tools that reduce manual effort and raise quality
  • Partner closely with Product, Data Engineering and ML, Apps, QA and client facing teams
  • Hire, develop and support engineers and tech leads through one to ones, feedback and career development
  • Establish and improve engineering practices around observability, data quality, documentation, incident response and service levels

This role has real scope, technically, organisationally and culturally.

Who this role suits

This role is a strong fit if you:

  • Enjoy leading engineers, not just managing work
  • Have a solid technical background and like being able to challenge designs and assumptions
  • Care about building well modelled, trustworthy data products
  • Are comfortable balancing delivery, quality and long term platform health
  • Like working cross functionally and navigating real world constraints

You will likely bring:

  • Proven experience as an Engineering Manager or Tech Lead Manager in a data, platform or backend environment
  • A background in data or backend engineering, such as AWS, Python or Scala, Spark, Airflow or similar
  • Experience owning or supporting analytics, data or reporting products
  • Strong people leadership skills including hiring, coaching and performance management
  • A track record of delivering complex, cross functional initiatives

Nice to have:

  • Experience with automation or test tooling
  • Familiarity with data privacy and governance, such as GDPR or consented data

How you will work

  • Hybrid role, Manchester based
  • Two days per week in the office, the rest flexible
  • Flexible start and finish times
  • Full home working setup provided

For further details and to apply, please get in touch with jon.brass @ circlerecruitment.com

Engineering Manager - Data Products /Technical Manager / Data Manager / Python / AWS

Circle Recruitment is acting as an Employment Agency in relation to this vacancy. Earn yourself a referral bonus if you refer somebody else who fills the role! We also offer an iPad if you refer a new client to us and we recruit for them. Follow us on Facebook - Circle Recruitment , Twitter - @Circle_Rec and LinkedIn - Circle Recruitment.

Junior Data Scientist / Data Analyst
Akkodis
Tamworth
In office
Junior
£34,000 - £38,000
RECENTLY POSTED

34,000 - 38,000 + benefits

Full Time / Permanent

Tamworth

The Company

Akkodis are partnering with a market leading manufacturing company who are looking for a driven Junior Data Scientist / Data Analyst to join their IT development team.

This is primarily an office based role based at the head office in Tamworth, West Midlands.

The Role

The Junior Data Scientist will drive the development and adoption of a data driven decision making culture within the company. The current Software Development team has been building systems and tools for several years, all of which manage the company from an operational point of view. This includes the implementation of bespoke and commonly used tools and platforms such as Power BI, Smartsheet and Dynamics 365 Business Central.

The Junior Data Scientist will play a pivotal part in the continued development of these tools alongside the implementation, embedding and deployment of these tools into the day-to-day business processes that drive the company.

Key Responsibilities

  • To model datasets and provide data-driven insights to drive business recommendations.
  • To work with internal and external stakeholders to understand and document their requirements.
  • To present and report results of your analysis in accessible and appealing formats, using relevant visualisations.
  • To identify new and innovative ways to analysis and present business data in a way that improves awareness, visibility, acceptance and improvement.
  • To manage and maintain the various reporting platforms used by the company. This includes Power BI, Smartsheet, Dynamics 365 Business Central amongst others.
  • To work with and support the Development team in supporting end users and providing data to their requirements.

Skills and Experience

  • At least 1+ year commercial experience working in a similar Junior Data Scientist, Data Engineer or Data Analyst position.
  • Knowledge or experience using software-based data analysis tools such as Excel, Power BI, Reporting Services, SQL, Jet for Business Central .
  • Knowledge of reporting and analysis-based languages such as T-SQL, DAX, Python, R and the principles that they implement.
  • Knowledge of different forms of data visualisation and interaction.
  • The ability to communicate effectively with internal and external stakeholders.
  • Competent in carrying out hypothesis testing & knowledge of statistical methods.
  • Preferably you will be degree qualified in Data or Computer Science or similar or have equivalent experience

Please apply via the link or contact (url removed) for more information.

Modis International Ltd acts as an employment agency for permanent recruitment and an employment business for the supply of temporary workers in the UK. Modis Europe Ltd provide a variety of international solutions that connect clients to the best talent in the world. For all positions based in Switzerland, Modis Europe Ltd works with its licensed Swiss partner Accurity GmbH to ensure that candidate applications are handled in accordance with Swiss law.

Both Modis International Ltd and Modis Europe Ltd are Equal Opportunities Employers.

By applying for this role your details will be submitted to Modis International Ltd and/ or Modis Europe Ltd. Our Candidate Privacy Information Statement which explains how we will use your information is available on the Modis website.

Data Engineer
Randstad Technologies Recruitment
London
Hybrid
Mid - Senior
£80,000 - £90,000

Data Engineer - Robotics

The Mission: Data infrastructure behind the world’s most advanced robots. You will curate and manage the massive datasets that allow our robots to learn, move, and interact with the physical world.

Key Responsibilities:

Pipeline Design: Build and maintain scalable data pipelines for ML training.

Data Curation: Preprocess large-scale datasets to ensure consistency and accuracy.

Quality Control: Develop metrics and reporting systems to monitor data integrity.

Security: Implement best practices for data versioning, security, and compliance.

Requirements:

Degree: BSc/MSc in Computer Science, Data Science, or similar.

Technical Skills: Strong proficiency in Python and SQL.

Experience: Proven track record in data engineering or data quality management.

ML Knowledge: Understanding of how data impacts machine learning performance.

Preferred:

Experience in Robotics or autonomous systems.

Familiarity with Cloud (AWS/GCP/Azure) storage and processing.

Randstad Technologies Ltd is a leading specialist recruitment business for the IT & Engineering industries. Please note that due to a high level of applications, we can only respond to applicants whose skills & qualifications are suitable for this position. No terminology in this advert is intended to discriminate against any of the protected characteristics that fall under the Equality Act 2010. For the purposes of the Conduct Regulations 2003, when advertising permanent vacancies we are acting as an Employment Agency, and when advertising temporary/contract vacancies we are acting as an Employment Business

Software Engineer - Data Analytics
CBSbutler Holdings Limited trading as CBSbutler
Telford
Hybrid
Mid - Senior
£450/day
+8

Job Title: Data Engineer

Rate: £450 per day inside ir35

Duration: 6 months

Location: Telford/hybrid - (2 days on site)

SC security clearance is required for this role

Job Description:

You should have experience as a Software Engineer delivering within large scale data analytics solutions and the ability to operate at all stages of the software engineering lifecycle, as well as some experience in the following;

Awareness of Devops culture and modern engineering practices
Experience of Agile Scrum based delivery
Proactive in nature, personal drive, enthusiasm, willingness to learn
Excellent communications skills including stakeholder management Have experience in some of the following technologies:

ETL toolset (Talend, Pentaho, SAS DI, Informatica etc)
Database (Oracle, RDS, Redshift, MySQL, Hadoop, Postgres, etc)
Job Scheduling toolset (Job Scheduler, TWS, etc)
Programming and scripting languages (PL/SQL, SQL, Unix, Java, Python, Hive, HiveQL, HDFS, Impala, etc) Must have knowledge of these tools:

ALM Tooling (Jira, Confluence, Bitbucket)
CI/CD toolsets (Gitlab, Jenkins, Ansible)
Data virtualisation tools (Denodo)
Reporting (Pentaho BA, Power BI, Business Objects, Grafana) If you are interested in this role or wish to apply, please feel free to submit your CV

Data Operations Manager
Vitality Corporate Services Limited - Tech
Bournemouth
Hybrid
Senior - Leader
£75,000

About The Role
Team Group Architect and Engineering Standards
Working Pattern - Hybrid 2days per week in either our Bournemouth or London Vitality Offices.Full time hours.

We are happy to discuss flexible working!

Top 3 skills needed for this role:

  • Data Operations Leadership
  • Strategic stakeholder management skills
  • Scalable Systems & Compliance Mindset

What this role is all about:
At Vitality, data isnt just numbers, its the engine that powers our strategy, drives our Journey model and enables smarter, faster decisions across the business. We rely on quick, accurate and accessible data to fuel insights, support our operational teams and continuously improve how we work. As we scale our data platforms and increase the demand for reliable, automated data flows, were now expanding our leadership capability, which is why were hiring a Data Operations Manager to help take our data delivery to the next level.

The Data Engineering function plays a pivotal role in bringing together cutting-edge technology, strong processes, skilled people and clear principles to enable seamless, automated data orchestration across the organisation.

Key Actions

  • Develop and manage data pipelines to support data integration, data processing, and data management
  • Offer technical leadership and mentorship of DataOps within the Data Engineering team
  • Lead development teams to ensure data operations run smoothly and delivery is to plan
  • Establish scalable, efficient, and automated processes for large scale deployments (including machine learning solutions)
  • Manage, monitor, and troubleshoot machine learning infrastructure
  • Develop and maintain relationships with stakeholders to understand their data needs and provide appropriate data solutions
  • Identify and implement new data technologies and tools to improve data operations and increase efficiency
  • Ensure best practice adopted and followed in relation to build, release and deployment activities
  • Monitor data operations to ensure their completeness, and consistency across different environments and processes
  • Ensure environments are usable, consistent and compliant amidst an environment of rapid change and growth
  • Ensure data operations comply with regulatory requirements and industry standards
  • Provide regular reports on data operations and performance to senior management and stakeholders.
  • Work with stakeholders to identify key performance indicators (KPIs) and metrics

What do you need to thrive?

  • Prince 2, APM Certification or Agile equivalent
  • Minimum of 5 years of experience in data operations, data management, or related field
  • Confidence in delivering both Business and Technology Change Initiatives
  • Experience working with Exec level Stakeholders and Sponsors
  • Demonstrable experience working within a complex matrix management environment
  • Experience in managing teams of Data Analysts, Data Engineers, and QA analysts both on and offshore in waterfall and agile disciplines

So, whats in it for you?

  • Bonus Schemes A bonus that regularly rewards you for your performance
  • A pension of up to 12% We will match your contributions up to 6% of your salary
  • Our award-winning Vitality health insurance With its own set of rewards and benefits
  • Life Assurance Four times annual salary

These are just some of the many perks that we offer! To view the extensive range of benefits we offer, please visit our careers page.

If you are successfulin your application and join us at Vitality, this is our promise to you, we will:

  • Help you to be the healthiest youve ever been
  • Create an environment that embraces you as you are and enables you to be your best self
  • Give you flexibility on how, where and when you work
  • Help you advance your career by playing you to your strengths
  • Give you a voice to help our business grow and make Vitality a great place to be
  • Give you the space to try, fail and learn
  • Provide a healthy balance of challenge and support
  • Recognise and reward you with a competitive salary and amazing benefits
  • Be there for you when you need us

We commit to all these things because we want you to feel that you belong, and are supported to be happy and healthy.

About The Company
We’re really excited to announce that we have recently been awarded “Top 10 Best Places To Work” in The Sunday Times Awards 2024!

Vitality is a multi-award-winning UK insurance brand, here to make the world a healthier, happier place.

Weve been a purpose and values-driven business from day 1- long before it became fashionable. Our core purpose is to make people healthier and enhance protect their lives. Were successful because we attract, develop, and retain the best people and because we care.

Diversity & Inclusion
At Vitality, were committed to diversity and inclusion because its good for our employees, for our business, and for society. We welcome applications from individuals of all backgrounds, experiences, and perspectives.

Vitalitys approach to sustainability
Vitality is a business that drives positive change. We reward people for making and sustaining healthier choices. But healthy people also need a healthy environment. To learn more please visit our Careers page.

If we are fortunate in receiving a high volume of quality applications we may need to close this vacancy early.

Data Engineer
Anson McCade
Multiple locations
Hybrid
Mid - Senior
£90,000

Data Engineer Hybrid / UK (DV Clearance Required)

We are working with a leading global consultancy to hire a DV-cleared Data Engineer who will turn complex data into actionable insights. In this role, youll collaborate with multidisciplinary teams to design, build, and optimise production data pipelines, delivering scalable, high-impact digital solutions across a variety of sectors.

About the company:
Our client operates at the intersection of strategy, technology, and innovation. With a diverse team of over 4,000 experts across the UK, Ireland, US, Nordics, and Netherlands, they help clients adapt and transform across multiple industries, including consumer and manufacturing, defence and security, energy and utilities, financial services, government, health and life sciences, and transport.

The role:
As a DV-cleared Data Engineer, youll work alongside cross-functional teams to design, build, and optimise production data pipelines. Youll leverage AWS cloud technologies and open-source tools to transform complex data into scalable solutions that power decision-making and innovation.

Why you should apply:

  • Collaborate with product, design, and technology experts to bring ideas to life through innovative software solutions.
  • Progress your career on a technical track in a supportive, inclusive, and trust-based environment.
  • Hybrid working: minimum two days per week in the office or on client site.
  • Work on diverse projects with varied tech stacks across multiple industries.
  • Access professional development, including technical courses, certifications, mentoring, and coaching.

Tech stack:

  • AWS cloud (EMR, Glue, RedShift, Kinesis, Lambda, DynamoDB) for ETL, data lake/warehouse design, and data movement.
  • Programming: Java, Python, Scala, Spark, SQL.
  • Experience integrating and processing large-scale structured and unstructured datasets from multiple sources on AWS cloud.

Essential requirements:

  • DV clearance is mandatory.
  • Strong problem-solving and analytical skills.
  • Collaborative mindset, comfortable working with multiple stakeholders in fast-paced environments.
  • Proven experience designing and deploying production data pipelines from ingestion to consumption.
  • Familiarity with API data extraction, scripting, and SQL querying.
  • Experience processing large-scale data in cloud environments (AWS preferred)

What’s in it for you?

  • 25 days annual leave (+ Christmas Eve half-day) with option to buy additional days
  • Private healthcare for you and your family
  • Generous pension scheme and performance-based bonus
  • Share ownership and tax-efficient benefits
  • Community, charity initiatives, and career development support

Ok I’m in what’s next?
Please apply with your latest CV

Data Engineer DV Cleared
SoCode Limited
Bristol
Remote or hybrid
Mid - Senior
£45,000 - £90,000
+2

About the Role I am working with a growing consultancy delivering high-impact data solutions across secure government and defence environments. Due to continued project wins, we are looking for experienced DV Cleared Data Engineers to join their team.

You will work on mission-critical programmes, designing and building scalable, secure, and high-performing data platforms in AWS environments.

Key Responsibilities

Design, build, and maintain secure data pipelines and ETL processes

Develop scalable data lake and data warehouse solutions in AWS

Implement infrastructure-as-code and CI/CD for data platforms

Optimise data workflows for performance, reliability, and cost-efficiency

Collaborate with architects, analysts, and client stakeholders

Ensure solutions meet strict security and compliance requirementsEssential Skills & Experience

Active DV Clearance (mandatory)

Strong hands-on experience with AWS data services (e.g., S3, Glue, Lambda, Redshift, EMR, RDS)

Proficiency in Python and/or Scala

Experience with SQL and data modelling

Knowledge of infrastructure as code (Terraform / CloudFormation)

Experience building production-grade data pipelines

Strong understanding of security best practices in cloud environmentsDesirable Experience

Experience working within government or defence sectors

Familiarity with DevOps and CI/CD tooling

Containerisation (Docker / Kubernetes)

Streaming technologies (Kafka / Kinesis)What We Offer

Competitive salary (£45,000 – £90,000 depending on experience)

Performance bonus

Flexible working arrangements

Private healthcare

Pension contribution

Ongoing training and AWS certifications

Opportunity to work on high-profile national programmes

Level 5 Data Engineer Apprentice
Surrey County Council
Reigate
Hybrid
Graduate - Junior
£24,330 - £24,330

This role has a starting salary of £24,330 per annum, based on a 36-hour working week. This role is a 24-month fixed term apprenticeship opportunity. We are excited to be recruiting a Level 5 Data Engineer Apprentice to join the dynamic Data Insight Team with the Surrey Fire and Rescue Service. Based at Woodhatch Place in Reigate, this role operates on a hybrid working model, with a minimum of two days per week in the office. There may be occasional travel within the county, and when appropriate, you'll also have the flexibility to work from a local fire station or a Surrey County Council premises. Our Offer to You The chance to get paid to learn and use your own personal talents to shape your future 26 days' holiday, rising to 28 days after 2 years' service and 31 days after 5 years' service (prorated for part time staff) Option to buy up to 10 days of additional annual leave A generous local government salary related pension Up to 5 days of carer's leave and 2 paid volunteering days per year Paternity, adoption and dependents leave A generous local government salary related pension Lifestyle discounts including gym, travel, shopping and many more 2 paid volunteering days per year Learning and development hub where you can access a wealth of resourcesAbout Us Our Data Insight Team at Surrey Fire and Rescue Service plays a vital role in keeping our communities safe. We manage and analyse life-critical information that supports operational decision-making and risk management. From creating and maintaining accurate data systems to developing innovative solutions, our work ensures firefighters have the information they need when it matters most. We work collaboratively with other data and technology specialists to deliver reliable, effective tools that meet business needs. About your Apprenticeship We want this apprenticeship to be an opportunity for you to gain experience across a wide range of duties putting you in the best position to succeed in your apprenticeship qualification and take the first steps on your career journey! This apprenticeship is a 24-month development programme, consisting of 20% off the job training (e.g. attending lectures, online learning, shadowing, learning support, written assessments) and 80% on the job learning. In this role, you will: Design and build data pipelines to collect, transform, and load data for analytics and reporting. Re-engineer manual data flows into automated, scalable Extract, Transform, Load or streaming solutions. Support and manage data streaming systems, monitoring performance and resolving issues promptly. Ensure data quality, accuracy and compliance with governance and security standards. Collaborate with technology teams and communicate solutions clearly to non-technical stakeholders.We won't be expecting you to jump in and be able to do this all from day one. You'll first go through an induction period allowing you to get used to the office and the team. As you gain more confidence in your role, you'll be supported to do more and more! The learning side of your apprenticeship will be delivered by a provider of your choice from our approved list. We will support you throughout the process to help you select the provider that best fits your needs and preferences. As your qualification comes to an end and you begin to turn your eye to the future, we have a fantastic support programme in place that will put you in the best position to take the next step on your exciting career journey. Our desire is for all our apprenticeships to be the first step on a long and successful career journey within SCC. Your Application In order to be considered for shortlisting, your application will clearly evidence the following skills and align with our behaviours: Attention to detail and accuracy. Problem-solving and analytical thinking Ability to learn new technologies quickly and adapt to evolving tools and processes. Effective communication skillsTo apply, we request that you submit a CV, and you will be asked the following 4 questions: Why are you interested in becoming a Data Engineer? Describe your interest in data, technology, or analytics and how you have explored these areas so far. This apprenticeship involves learning new technologies and concepts quickly. How do you approach learning something unfamiliar? Tell us about a time you had to communicate complex information to a non-technical audience. How did you ensure they understood? Describe a situation where you worked as part of a team to achieve a goal. What was your role?Skills and Knowledge Training will be provided as part of the apprenticeship, ensuring you have the support you need to develop all the required skills. However, having a basic understanding of data or some initial familiarity or experience with data engineering concepts, tools, or programming languages would be beneficial. For example, exposure to tools such as FME (Feature Manipulation Engine) for spatial data processing, SQL for database querying and management, Python for data transformation and automation, or Excel for data manipulation can help you adapt more quickly. Any existing knowledge in these areas will support your learning and enable you to contribute effectively to our data‑driven projects. Please note: This apprenticeship is only available for those who will not be enrolled in another government funded programme as of 1st September 2025 and do not possess a qualification at a higher or the same level as this one in the same or similar subject. If you have any questions regarding your eligibility please contact . If you do not hold an English and Maths GCSE graded A-C or 4-9, you will be required to complete these in addition to the apprenticeship. Additional tutoring and support will be provided. The job advert closes at 23:59 on 04/03/2026 with interviews to follow. Our Commitment We are a disability confident employer which means if you have shared a disability on your application form and have evidenced you meet the minimum criteria, we guarantee you an interview. Your skills and experience truly matter to us. From application to your first day, we're committed to supporting you with any adjustments you need, we value inclusion and warmly welcome you to join and help build a workplace where everyone belongs

Lead Data Engineer
SR2
Swindon
Hybrid
Senior
£75,000

Location: Swindon (Hybrid working) Salary: Up to £75,000 Type: Full-time | Permanent A UK-based organisation is seeking a Lead Data Engineer to take ownership of its enterprise data platform and drive the next phase of its data maturity journey. This is a key leadership role responsible for building a secure, scalable and high-performing data environment that underpins reporting, analytics and strategic decision-making across the organisation. The Opportunity You will lead the design, implementation and optimisation of a modern data warehouse, integrating multiple business-critical systems and ensuring high standards of governance, quality and accessibility. This role combines hands-on technical leadership with stakeholder engagement, making it ideal for someone who enjoys building robust data infrastructure while influencing business strategy. Key Responsibilities Own the architecture and roadmap for the enterprise data warehouse Design and maintain scalable ETL/ELT pipelines across multiple systems (CRM, ERP, digital platforms, membership systems) Ensure data quality, validation, integrity and security Lead data governance, metadata management and lineage practices Partner with BI and analytics teams to enable high-quality reporting and dashboards Mentor and guide data/BI professionals Evaluate and implement modern data technologies to enhance capability What We're Looking For Experience: Proven experience leading data engineering or BI functions Strong background in enterprise data warehouse design and optimisation Experience integrating complex system landscapes Demonstrable experience with data governance and best practice security controlsTechnical Skills: Advanced SQL Modern ETL/ELT tooling Cloud data platforms (Azure, AWS or GCP) BI/reporting platforms (e.g., Power BI or equivalent)Qualifications: Degree in Computer Science, Data Engineering, Information Systems or similar (or equivalent experience) Professional data certifications are advantageous What's on Offer Hybrid working model Generous annual leave entitlement Competitive pension scheme Private healthcare / wellbeing support Professional development support A collaborative, purpose-driven environment This is a fantastic opportunity to shape the data strategy of a respected, mission-driven organisation and play a pivotal role in enabling data-led transformation

Data Engineer (AEOI)
CBSbutler Holdings Limited trading as CBSbutler
Telford
Hybrid
Mid - Senior
£386/day

Job Title: Data Engineer (AEOI) Rate: £386 per day inside ir35 Duration: 6 months Location: Telford/hybrid (2 days per week on site) SC security clearance is required for this role Job Description: My client is supporting a major expansion within the AEOI (Automatic Exchange of Information) programme and are looking for a Developer to join a growing delivery team to support ongoing project work on a government account. The role will work across multiple regulatory data exchange initiatives, including: Pillar R7 / ETR Exchange NTJ Exchange CRS Outbound ExchangeDue to increasing demand across the AEOI programme, additional teams are being established and existing teams expanded to support ongoing and upcoming deliveries. You will be responsible for developing and supporting solutions primarily using Talend and Oracle RDS, working within established Talend frameworks, design patterns, and best practices. The role will involve building, enhancing, and maintaining data integration and exchange processes in line with regulatory and operational requirements. Expereince required: Data ETL product experience - Talend preferred Pentaho/Informatica experience will be transferable. Oracle RDS Nice to have: SQL AWS GenAI

SC Cleared Data Engineer
83zero Ltd
City of London
In office
Mid - Senior
£500/day - £550/day
+1

Day rate: £500 - £550 Inside IR35 Location: London Key Responsibilities Design, build, and maintain scalable data pipelines, ETL processes, and data integrations. Develop and optimize data models, storage solutions, and analytics environments. Partner with UX/UI designers to create user-friendly dashboards, data tools, and internal products. Implement visualizations that make complex datasets understandable for technical and non-technical users. Work with cross-functional teams to translate product requirements into technical designs. Ensure data quality, governance, and best practices across systems. Contribute to the evolution of our design systems and front-end components for data tools. Required Skills & Experience Proven experience as a Data Engineer, BI Engineer, or similar role. Strong proficiency in SQL, Python, and modern data engineering frameworks (e.g., Airflow, dbt, Spark, etc.). Experience with cloud platforms such as AWS, Azure, or GCP. Solid understanding of data warehousing and ETL/ELT architecture. Demonstrable UX/UI skills: wireframing, prototyping, and designing clean, intuitive interfaces. Experience with front-end technologies (e.g., React, Vue, or similar) is a plus. Familiarity with visualization tools (e.g., Tableau, Power BI, or custom solutions)

GIS Python Developer Outside IR35
Cathcart Technology
Bath
Hybrid
Mid - Senior
£400/day - £425/day

GIS Python Developer 12 Months Outside IR35 GIS Python Developer required by a leading tech company for an initial 12 month contract. It's fully remote, outside IR35, and will likely extend due to the amount of work they have in the pipeline. The Role: You will be part of a rapidly growing software team helping to deliver their leading analytics application that is being used to help drive critical decision making from gathering large amounts of intelligence on the human population and its use around the world; tech for good, you could say! As a GIS Python Developer, you will be responsible for various tasks, mainly focusing on Python development to combine geospatial datasets to automate the creation of sizeable subnational index data sets. The main tools you will be using day to day are: \* Python \* Docker \* ETL pipelines \* GIS - PostGIS or ESRI knowledge (Ideally Raster Data Sets) \* AWS You: Our customer is looking for someone well versed with the above tools technologies, and they need someone who has a strong understanding of Geospatial Data and is willing to roll their sleeves up as this project is critical for them. As a Senior member of the team, they expect you to pick up their tooling pretty quickly, work closely with other people in the group and help build upon an already industry-leading product. Rate & Process: Depending on the candidate's preference, this urgent role based in Bath can offer a hybrid or fully remote working model. It's a two-stage interview process consisting of a call with the Head of Engineering and other team members. We can organise interviews within a few days as this is an absolute priority across the business. Cathcart Technology is acting as an Employment Business in relation to this vacancy.

Data Engineer
Randstad Technologies Recruitment
London
Hybrid
Mid - Senior
£80,000 - £90,000

Data Engineer - Robotics

The Mission: Data infrastructure behind the world’s most advanced robots. You will curate and manage the massive datasets that allow our robots to learn, move, and interact with the physical world.

Key Responsibilities:

  • Pipeline Design: Build and maintain scalable data pipelines for ML training.
  • Data Curation: Preprocess large-scale datasets to ensure consistency and accuracy.
  • Quality Control: Develop metrics and reporting systems to monitor data integrity.
  • Security: Implement best practices for data versioning, security, and compliance.

Requirements:

  • Degree: BSc/MSc in Computer Science, Data Science, or similar.
  • Technical Skills: Strong proficiency in Python and SQL.
  • Experience: Proven track record in data engineering or data quality management.
  • ML Knowledge: Understanding of how data impacts machine learning performance.

Preferred:

  • Experience in Robotics or autonomous systems.
  • Familiarity with Cloud (AWS/GCP/Azure) storage and processing.

Randstad Technologies Ltd is a leading specialist recruitment business for the IT & Engineering industries. Please note that due to a high level of applications, we can only respond to applicants whose skills & qualifications are suitable for this position. No terminology in this advert is intended to discriminate against any of the protected characteristics that fall under the Equality Act 2010. For the purposes of the Conduct Regulations 2003, when advertising permanent vacancies we are acting as an Employment Agency, and when advertising temporary/contract vacancies we are acting as an Employment Business.

Back End Developer SPFYJP
Randstad Technologies Recruitment
London
Hybrid
Mid - Senior
£550/day - £600/day

Back End Developer / Engineer III (Java / GCP)

Duration:1 year contract

Location:London New office

Mode:Hybrid(2-3 days in office)

We are looking for a high-impact Back End Engineer to lead solution designs and execute end-to-end implementations of critical service capabilities.

Based in the CET timezone (Sweden, UK, or Germany), you will drive technical excellence in a collaborative environment that prioritizes fast decision-making and a strong bias for action.

Key Responsibilities

  • Solution Design: Lead the architecture and implementation of scalable features within our core services.
  • System Evolution: Execute meaningful changes to high-scale, complex distributed systems.
  • Collaboration: Drive engineering deep dives, technical workshops, and stakeholder demos.
  • Mentorship: Participate in tight feedback loops and peer reviews to elevate the team’s output.

Required Experience & Skills

  • Core Stack: Proven expertise in building and scaling services using Java, Postgres, and BigTable on Google Cloud Platform (GCP).
  • Data Engineering: Hands-on experience managing data pipelines, specifically utilizing Scio and Flight.
  • Domain Knowledge: Previous experience in E-commerce or Financial Engineering is highly preferred.
  • Communication: Exceptional writing and verbal skills; ability to translate complex technical concepts for diverse stakeholders.
  • Mindset: Self-driven, collaborative, and thrives in a high-autonomy environment.

Location & Timezone

  • This role operates on CET, supporting a distributed team across Sweden, the UK, and Germany.

Randstad Technologies is acting as an Employment Business in relation to this vacancy.

Software Engineer - Data Analytics
CBSbutler Holdings Limited trading as CBSbutler
Shropshire
Hybrid
Junior - Mid
£450/day
+8

Job Title: Data Engineer

Rate: 450 per day inside ir35

Duration: 6 months

Location: Telford/hybrid - (2 days on site)

SC security clearance is required for this role

Job Description:

You should have experience as a Software Engineer delivering within large scale data analytics solutions and the ability to operate at all stages of the software engineering lifecycle, as well as some experience in the following;

  • Awareness of Devops culture and modern engineering practices
  • Experience of Agile Scrum based delivery
  • Proactive in nature, personal drive, enthusiasm, willingness to learn
  • Excellent communications skills including stakeholder management

Have experience in some of the following technologies:

  • ETL toolset (Talend, Pentaho, SAS DI, Informatica etc)
  • Database (Oracle, RDS, Redshift, MySQL, Hadoop, Postgres, etc)
  • Job Scheduling toolset (Job Scheduler, TWS, etc)
  • Programming and scripting languages (PL/SQL, SQL, Unix, Java, Python, Hive, HiveQL, HDFS, Impala, etc)

Must have knowledge of these tools:

  • ALM Tooling (Jira, Confluence, Bitbucket)
  • CI/CD toolsets (Gitlab, Jenkins, Ansible)
  • Data virtualisation tools (Denodo)
  • Reporting (Pentaho BA, Power BI, Business Objects, Grafana)

If you are interested in this role or wish to apply, please feel free to submit your CV.

Senior Data Engineer - Active DV Required
Matchtech
Worcestershire
In office
Senior
£78/hour

Location: Worcester area (fully onsite)

Duration: 6 month initial contract

Rate: 78ph LTD (Outside IR35)

Due to the nature of the role, candidates must hold active DV clearance.

Role details:

Our client, a leading defence and security company, are looking for DV cleared Data Engineers to join their team on a contract basis. This is a fully onsite role with the option of compressed hours.

This role requires strong expertise in building and managing data pipelines using the Elastic Stack (Elasticsearch, Logstash, Kibana) and Apache NiFi. The successful candidate will design, implement, and maintain scalable, secure data solutions, ensuring compliance with strict security standards and regulations.

Responsibilities not limited to:

  • Design, develop, and maintain secure and scalable data pipelines using the Elastic Stack (Elasticsearch, Logstash, Kibana) and Apache NiFi.
  • Implement data ingestion, transformation, and integration processes, ensuring data quality and security.
  • Collaborate with data architects and security teams to ensure compliance with security policies and data governance standards.
  • Manage and monitor large-scale data flows in real-time, ensuring system performance, reliability, and data integrity.
  • Develop robust data models to support analytics and reporting within secure environments.
  • Perform troubleshooting, debugging, and performance tuning of data pipelines and the Elastic Stack.
  • Build dashboards and visualizations in Kibana to enable data-driven decision-making.
  • Ensure high availability and disaster recovery for data systems, implementing appropriate backup and replication strategies.
  • Document data architecture, workflows, and security protocols to ensure smooth operational handover and audit readiness.

Interested? Apply today via the link provided!

Data Engineer
BGTS LTD
London
Remote or hybrid
Mid - Senior
£60,000 - £70,000

As a Data Engineer, you will be responsible for:

Data Engineering & Development

  • Design, build, and maintain high-quality, scalable, and tested data pipelines.
  • Develop and manage Databricks structured streaming pipelines.
  • Build and optimize event-driven and real-time data processing solutions.
  • Implement and maintain Unity Catalog-based Lakehouse architecture.
  • Develop analytics-ready datasets to support business insights and reporting.

Platform & Automation

  • Build and manage CI/CD pipelines using Azure DevOps.
  • Identify and implement automation opportunities across workflows.
  • Ensure reliable and stable data platform operations.
  • Apply governance, security, and documentation standards.

Data Quality & Reliability

  • Establish the Data Lakehouse as a trusted and reliable source of truth.
  • Monitor, troubleshoot, and resolve data incidents.
  • Support business users and technical teams with data-related queries.
  • Continuously improve platform performance and reliability.

Collaboration & Support

  • Work closely with data science, analytics, platform, and business teams.
  • Champion data engineering best practices.
  • Provide technical guidance and mentorship where required.
  • Contribute to a culture of learning, quality, and continuous improvement.

Essential Skills

  • Strong experience with Azure Databricks and cloud data platforms.
  • Advanced proficiency in Python, PySpark, and SQL.
  • Experience developing Spark/Databricks pipelines.
  • Hands-on experience with structured streaming and event-driven systems.
  • Strong understanding of Lakehouse architecture and best practices.
  • Experience with Unity Catalog.
  • Expertise in Azure DevOps and CI/CD pipelines.
  • Knowledge of data modelling (dimensional/star schemas).
  • Experience working in Agile environments.

Desirable Skills

  • Exposure to multiple data technology stacks.
  • Experience in large-scale enterprise environments.
  • Knowledge of security, governance, and compliance frameworks.
SC Cleared Data Engineer
83zero Ltd
London
In office
Mid - Senior
£500/day - £550/day

Day rate: 500 - 550 Inside IR35

Location: London

Key Responsibilities

  • Design, build, and maintain scalable data pipelines, ETL processes, and data integrations.
  • Develop and optimize data models, storage solutions, and analytics environments.
  • Partner with UX/UI designers to create user-friendly dashboards, data tools, and internal products.
  • Implement visualizations that make complex datasets understandable for technical and non-technical users.
  • Work with cross-functional teams to translate product requirements into technical designs.
  • Ensure data quality, governance, and best practices across systems.
  • Contribute to the evolution of our design systems and front-end components for data tools.

Required Skills & Experience

  • Proven experience as a Data Engineer, BI Engineer, or similar role.
  • Strong proficiency in SQL, Python, and modern data engineering frameworks (e.g., Airflow, dbt, Spark, etc.).
  • Experience with cloud platforms such as AWS, Azure, or GCP.
  • Solid understanding of data warehousing and ETL/ELT architecture.
  • Demonstrable UX/UI skills: wireframing, prototyping, and designing clean, intuitive interfaces.
  • Experience with front-end technologies (e.g., React, Vue, or similar) is a plus.
  • Familiarity with visualization tools (e.g., Tableau, Power BI, or custom solutions).
Data & AI Automation Lead
Tria
London
Hybrid
Senior
Private salary
TECH-AGNOSTIC ROLE

Data, AI, Automation, Machine Learning, Transformation, Global B2C organisation

London Hybrid

Immediate OIR35 Contract - longer term permanent opportunity

A market-leading global B2C organisation is seeking a Data & AI Automation Lead to own and scale its enterprise AI and intelligent automation agenda.

This is a high-impact leadership role responsible for defining AI strategy, building production-grade AI/ML and automation capabilities, and delivering measurable commercial value across customer experience and operations.

The Role

  • Define and execute the enterprise AI & automation roadmap
  • Identify high-value use cases (personalisation, dynamic pricing, forecasting, workforce optimisation)
  • Own AI/ML platforms, MLOps and LLM architecture (Azure preferred)
  • Lead end-to-end delivery from experimentation to scaled deployment
  • Build and lead a multi-disciplinary AI team
  • Embed responsible AI, governance and cost control

The Profile

  • Proven track record delivering enterprise-scale AI/ML and intelligent automation
  • Strong hands-on knowledge of cloud AI platforms, data engineering and LLM/RAG architectures
  • Experience implementing MLOps, observability and model governance
  • Commercially minded, able to link AI outcomes to revenue, efficiency and customer impact
  • Background within consumer-led / B2C environments is essential

This is a rare opportunity to shape and scale AI capability within a complex, customer-centric international business.

If you’re ready to lead AI from strategy through to real-world impact, we’d love to speak with you.

Data & AI Automation Lead

Senior Data Engineer
Meraki IT Recruitment
London
Hybrid
Senior
Private salary

UK-Based Hybrid Working
SC Clearable Required
Permanent

Meraki are working on behalf of a high-growth digital consultancy delivering mission-critical data platforms across the UK public sector.

We re looking for a Senior Data Engineer to design, build and operate modern data pipelines and analytics platforms that power secure, large-scale digital services.

This is a hands-on, delivery-focused role within multidisciplinary agile teams. You ll play a key part in enabling organisations to collect, process and use data effectively supporting operational reporting, analytics and meaningful insight across complex environments.

This role would suit someone who enjoys solving well-defined problems independently, applying strong engineering judgement, and contributing to continuous platform improvement rather than being tied to one specific technology stack or cloud vendor.

The Role

You will:

  • Design, build and maintain reliable data pipelines to ingest, transform and serve data from multiple sources
  • Develop analytics-ready data models to support reporting and operational insight
  • Support the full data lifecycle (retention, archiving, decommissioning) in line with governance requirements
  • Apply data quality, testing and monitoring best practices
  • Translate user and business needs into practical, well-engineered data solutions
  • Contribute to shared data standards, documentation and data dictionaries
  • Collaborate with cross-functional delivery teams to drive improved data outcomes

Technical Experience

You ll bring strong commercial experience across several of the following:

  • Modern data engineering patterns (batch and event-driven pipelines)
  • Strong SQL and at least one data-focused programming language (e.g. Python)
  • Data integration, transformation and orchestration tooling
  • Analytical data platforms (data warehouses, lakehouse architectures)
  • Applying DevOps and software engineering practices to data (CI/CD, version control, automated testing)
  • Working across cloud platforms in a vendor-agnostic way
  • Contributing to open-source tooling where appropriate

What We re Looking For

  • Operates confidently at senior level
  • Comfortable working independently within defined delivery scopes
  • Strong communicator able to explain data concepts to both technical and non-technical stakeholders
  • Collaborative, pragmatic and delivery-focused
  • Comfortable in customer-facing environments
  • Understands secure-by-design and government data principles

Security Clearance

Due to the nature of the work, candidates must:

  • Be eligible for SC Clearance
  • Have lived continuously in the UK for the past 5+ years
  • Have the right to work in the UK without sponsorship

What s on Offer

Competitive salary with annual review
Employer pension contribution starting at 5%, increasing with tenure
Group life assurance

Genuine hybrid working + home setup allowance
25 days annual leave + bank holidays (with buy/sell option)

Fully funded professional certifications (AWS, GCP, Agile etc.)
5 days paid study leave + £500 annual personal development fund
1-2-1 coaching and structured career progression
Private medical insurance
Cycle to Work scheme
2 paid volunteering days per year

Inclusive Hiring

We strongly encourage applications from individuals who may not meet every single requirement. If you re excited by the opportunity but don t tick every box, we d still love to hear from you.

Frequently asked questions
Typically, a Data Engineer should have a strong background in computer science or related fields, proficiency in programming languages like Python or Java, and experience with data warehousing, ETL processes, and big data technologies such as Hadoop or Spark.
Haystack features a wide range of Data Engineer positions, including roles in startups, large enterprises, and remote opportunities. You can find jobs specializing in cloud data engineering, real-time data processing, data pipeline development, and more.
To improve your chances, tailor your resume to highlight relevant skills and projects, gain hands-on experience with popular data tools, contribute to open-source projects, and stay updated with the latest trends in data engineering.
Yes, Haystack lists entry-level Data Engineer roles suitable for recent graduates or professionals transitioning into data engineering, as well as internships and junior positions to help you start your career.
Absolutely. Haystack offers many remote and flexible Data Engineer job listings to suit your preferred working style and location.