Make yourself visible and let companies apply to you.
Roles
Data Engineer Jobs
Overview
Looking for top Data Engineer jobs? Explore the latest data engineering opportunities on Haystack, your go-to IT job board. Whether you're skilled in ETL, data pipelines, or big data technologies, find the perfect role to advance your career today. Start your search for Data Engineer positions now!
Data Engineer (Online Monitoring)
Advertising Standards Authority
Not Specified
Hybrid
Graduate - Junior
£42,000 - £52,000
RECENTLY POSTED

The Vacancy

28-35hrs per week- open to discuss flexible working of these hours

Location

Remote with some attendance at our London office in Shoreditch

The ASA is the UK s regulator of advertising across all media, including online. Our work includes taking proactive action against misleading, harmful, offensive or otherwise irresponsible ads and acting on complaints. In short, we make sure ads are legal, decent, honest and truthful.

In this role you will join our Data Science team and work on our world-leading Active Ad Monitoring system, which uses AI to proactively monitor online advertising. In 2025 the system captured and processed 60 million ads across social media, search and programmatic display. The ASA uses this intelligence to help regulate ads across high-priority topics like injectable weight-loss medications, green claims companies make to consumers, disclosure of influencer marketing and many more.

You will help develop and maintain the tools we use to capture, process, and apply AI models to large datasets of ads within the Active Ad Monitoring system. We re looking for someone who wants to use their skills and expertise to help shape a safer advertising landscape. Our team mission is to protect UK consumers from adverts that are misleading, cause harm and target those within our society that are the most vulnerable. Working as part of our small agile team you will have the opportunity to own your work end-to-end, seeing directly how the code you write helps protect UK consumers. You will work in a cloud-based environment, primarily in Python, and with a range of industry standard tools such as Snowflake, Docker and Airflow. You will work primarily with unstructured data - namely ads in a variety of formats including images, videos and text from a range of online channels.

About you

  • You may not have been a Data Engineer before but you will have the ability to work with data in Python to a professional standard, and deliver high-quality code that works reliably in a production setting.
  • You ll be working with people from both technical and non-technical backgrounds so you ll need to be adept at being able to translate complex technical language to non-technical people.
  • You ll be impact focused- understanding the problems the ASA faces and prioritising technical solutions that will deliver real impact.
  • You will need to be curious and ambitious, creatively solving problems that may arise whilst always having an eye on system/process improvements.
  • You ll enjoy working with others from different technical disciplines each using your unique expertise to further the work, whilst also developing your own technical knowledge and skills.

We are committed to building a workforce that reflects the full diversity of the UK population. We believe that varied perspectives and experiences strengthen our organisation and help us deliver our work more effectively.

We welcome applications from people of all backgrounds and identities, and we actively encourage candidates from minority or underrepresented groups to apply. Women are currently under represented within data engineering roles, and within our Data Science team. In line with our commitment to equality, diversity and inclusion, we particularly encourage applications from women and others who are under represented in this area. Our recruitment process ensures applications are absent of names or any identifiable information which supports our aim of finding the best person for the role based on their skills and experience only.

How to apply: If you re interested in applying for this role, please review the job description below and complete our online application process which includes answering some online questions regarding your motivation for applying for this role and your skills and experience. Should you require any adjustments to our application process please contact us.

Closing date: 16th March 2026. Please note we will be reviewing applications as they come in and we reserve the right to close the advert early if we receive a significantly high number of applicants.

Please feel free to use AI to enhance your application but not to write it for you. We re interested to know your thoughts, experiences and ideas. You ll need to stand up what you ve told us in your application if you attend an interview, so please make sure we feel the person we ve met on paper is the person we meet in the room.

The Company

We are the UK s independent frontline regulator of ads by legitimate businesses and other organisations in all media, including online. We are authoritative and influential on ad regulation; the centre of expertise. The rules we administer and enforce are contained in the UK Advertising Codes, written by the industry Committees of Advertising Practice (CAP). To help maintain our independence from the industry that funds us, we are primarily funded at arm s length by the Advertising Standards Boards of Finance (Asbof). Together, the ASA, CAP and Asbof make up the ASA system.

Our purpose is to make sure ads are responsible. Our ambition is to make sure every UK ad is a responsible ad. Our values are to be proactive, collaborative, accountable, transparent and decisive. We want external stakeholders to find us to be: independent in administering the Codes; evidence-based, proportionate, targeted and consistent; and reflective of society, not a social engineer.

We are passionate about what we do because responsible ads are good for people, good for society and good for business. They entertain and inform us, helping us to choose products and services. They fund the media, sport and culture we all enjoy. They can be a force for social good, encouraging us to contribute to good causes, make more responsible choices and stay safe. And they help deliver competition and power the economy. By making sure ads are responsible, we protect people from being misled, harmed or offended, helping them feel more confident in the ads they see and hear.

Blue Prism Developer // United Kingdom
Akkodis
UK
Hybrid
Mid - Senior
£50,000 - £60,000
RECENTLY POSTED

Are you an experienced Blue Prism Developer looking for your next challenge? This is an exciting opportunity to join a growing Process Excellence & Automation team, where you will play a key role in delivering high‑quality, scalable automations that drive real business impact.

This role is hands‑on, fast‑paced, and ideal for someone who loves building robust automation solutions, improving processes, and working across multiple business functions.

The Opportunity

As a Blue Prism Developer, you’ll focus primarily on end‑to‑end automation delivery. Around 80% of your time will be spent building, enhancing, and maintaining Blue Prism solutions. You’ll join the process after analysis but will often contribute technical insight earlier on to shape the optimal solution design.

You’ll be at the heart of improving operational efficiency, applying continuous improvement principles, conducting impact analysis, and ensuring that automations are delivered to the highest standard.

What You’ll Be Doing

Optimise business processes and existing automations while following strict change‑control practices
Conduct impact analysis to understand how new automations affect wider operations
Work closely with Business Analysts and stakeholders to design future‑state automated solutions
Develop Blue Prism automations end‑to‑end in line with best practices
Deliver a minimum of 8 completed automation projects per year
Produce detailed SIT and UAT scripts and lead structured test cycles
Prepare deployment plans, schedules, environment readiness, and Hypercare documentation
Support production environments by assisting in triage and root cause analysis when requiredWhat You’ll Need

Technical Requirements

Recent (within the last 4 years) hands-on Blue Prism development experience - essential
Blue Prism Professional Developer accreditation - mandatory
Minimum 2+ years’ experience building automations with Blue Prism, including advanced concepts
Demonstrated history of delivering 8+ automation projects per year
Background in software development or system configuration (C#, C++, Java, or similar)
Experience integrating Blue Prism with RESTful APIs and web services
Solid understanding of Blue Prism architecture and infrastructure
Strong logical thinking and ability to interpret complex process mapsYOU MUST BE ELIGIBLE TO WORK IN THE UK, AND THE BELOW IS KEY:

Recent Blue Prism experience in the last 4 years
Demonstrated history of delivering 8+ automation projects per yearPlease get in touch asap if you’re interested -

Ideally you’re based in London, but the client will consider candidates elsewhere in the UK.

Modis International Ltd acts as an employment agency for permanent recruitment and an employment business for the supply of temporary workers in the UK. Modis Europe Ltd provide a variety of international solutions that connect clients to the best talent in the world. For all positions based in Switzerland, Modis Europe Ltd works with its licensed Swiss partner Accurity GmbH to ensure that candidate applications are handled in accordance with Swiss law.

Both Modis International Ltd and Modis Europe Ltd are Equal Opportunities Employers.

By applying for this role your details will be submitted to Modis International Ltd and/ or Modis Europe Ltd. Our Candidate Privacy Information Statement which explains how we will use your information is available on the Modis website

Business Report Writer
Cosworth Group Holdings Limited
Northampton
Hybrid
Junior - Mid
Private salary
RECENTLY POSTED

Job Description:

The role requires a Business Report Writer to support the group in Business Data Analysis by producing suitable reports from primary ERP and CRM systems on a unified and centralized platform.

The Role:

  • Drive Information Exploitation by extracting information from systems data and presenting it in meaningful reports.
  • Identify report requirements from business units and design suitable solutions to deliver required information.
  • Coordinate with senior management team to ensure accuracy and suitability of information supplied in reports.
  • Keep abreast of current trends and solutions in the data analysis space and introduce suitable solutions to improve reporting.
  • Communicate with Key Users to resolve data errors and issues identified in reports.
  • Perform additional IT related tasks as required based on training and experience.
  • Consider the health and safety, environmental and energy impact of all activities.
  • Support the Companys compliance with the UK General Data Protection Regulation (UK GDPR) and the Data Protection Act 2018 by following company policy and best practice.

Candidate Profile:

  • Degree in Business Information Technology preferred.
  • Microsoft Power BI skills essential.
  • Microsoft SQL Database skills essential.
  • Experience in SAP ECC6 and Microsoft Dynamics 365 preferred.
  • Strong analytical ability with understanding of data types and data joining required.
  • Excellent communications skills and ability to discuss requirements at all levels of the organization.
Data & Reporting Analyst
Harvey Nash
Edinburgh
Hybrid
Mid - Senior
Private salary
RECENTLY POSTED

6-month initial contract

Hybrid

Inside IR35

Harvey Nash’s public sector client is seeking an experienced Power BI Data & Reporting Analyst.

In this role, you’ll design and develop interactive dashboards, executive level reporting, and a suite of reusable Power BI templates to enhance future in house development.

Strong analytical skills, excellent communication, and the ability to work with complex datasets are essential.

Key Skills & Experience (Essential)

  • Advanced SQL, including complex queries and optimisation
  • Power BI dashboard and report development
  • Data modelling using DAX and Power Query
  • Executive dashboard creation for senior leadership
  • Strong stakeholder engagement and communication
  • Proven experience leading dashboard/reporting projects
  • Handling and transforming large datasets

Desirable Skills

  • Microsoft Fabric (lakehouse, pipelines)
  • Geospatial data experience
  • API integration
  • ETL/data preparation workflows
  • Familiarity with Azure or cloud platforms
  • Relevant Microsoft certifications (e.g., Data Analyst Associate)
  • Public sector exposure
  • Microsoft Fabric familiarity
Lead Data Engineer
Vallum Associates Limited
Sheffield
Remote or hybrid
Senior
Private salary
RECENTLY POSTED

We are seeking a Lead Data Engineering Consultant with proven experience in leading and developing data engineering platforms. The ideal candidate will possess hands-on expertise in the following areas: 1. Extensive enterprise experience withHadoop, Spark, and Splunk. 2. Proficiency in object-oriented and functional scripting, particularly inPython. 3. Skilled in handling raw, structured, semi-structured, and unstructured data (SQL and NoSQL). 4. Experience integrating large, disparate datasets using modern tools and frameworks. 5. Strong background in building and optimizingETL/ELT data pipelines. 6. Familiarity with source control and implementing Continuous Integration, Delivery, and Deployment via CI/CD pipelines. 7. Experience supporting and collaborating with BI and Analytics teamsin fast-paced environments. 8. Ability to pair program and work effectively with other engineers. 9. Excellent analytical and problem-solving abilities. 10. Knowledge of agile methodologies such as Scrum or Kanban is a plus. 11. Comfortable representing the team in standups and problem-solving sessions. 12. Capable of driving the creation of technical test plans and maintaining records, including unit and integration tests, within automated test environments to ensure high code quality. 13. Promote SRE (Site Reliability Engineering) culture by addressing challenges through data engineering. 14. Ensure service resilience, sustainability, and adherence to recovery time objectives for all delivered software solutions.

Digital Data Consultant, Data Engineering, Data Bricks, Part Remote
Carrington Recruitment Solutions Limited
Manchester
Fully remote
Senior - Leader
£90,000
RECENTLY POSTED

Digital Data Consultant, Data Architecture, Data Engineering, Azure, Fabric, Databricks, Manchester, Hybrid

Digital Data Consultant required to work for a highly ambitious and fast-growing Consulting function, based in Manchester on a hybrid basis. The expectation is to be in the office circa two days per week and the rest from home. Please read in full before applying

We need someone who is a seasoned Data Architecture and Engineering specialistnot someone who has done a bit of data. This requires someone who has operated at Senior Manager level (or Director level in some consultancies), someone who has the gravitas to face-off to senior stakeholders, shape work, originate opportunities and help take clients on a proper data journey.

You will be joining a rapidly maturing Digital Consulting team that works across the United Kingdom, where the work is genuinely varied, fast-paced and focused on helping clients use digital technology to create real business outcomes. You will report into a Partner and will play a major part in leading, growing, mentoring and shaping the team around you.

This is ideal for someone who is commercially minded, confident, curious, comfortable with ambiguity and genuinely enjoys solving complex business and data problemsnot just producing technical artefacts for the sake of it. You must enjoy working with people and influencing outcomes, not hiding behind documents or code. Read on for more details

Skills and experience required:

  • A strong professional network across the United Kingdom and a demonstrable track record of originating, shaping and converting consulting opportunities for Data, Analytics and Artificial Intelligence projects
  • Strong consulting experience that includes solution development, proposal creation, commercial negotiation and building trusted adviser relationships with senior-level clients
  • Proven ability to lead technical teams and data projects, with excellent coaching and mentoring skills
  • A collaborative, pragmatic and client-centred mindset, with the ability to translate business problems into compelling data-led solutions
  • A natural problem solver with intellectual curiosity and an agile, forward-thinking outlook
  • A strong understanding of the real challenges businesses face today, and how digital and data technologies can genuinely enable change and transformation
  • Significant experience in data architecture and data engineering, including building data platforms and working with cloud technologies such as Microsoft Azure
  • Good grounding in programming and data engineering languages and frameworks such as Python, SQL, Microsoft Fabric and Databricks
  • Certifications in relevant cloud and data technologies (Azure etc.) would be beneficial
  • Excellent communication skills and the ability to inspire confidence in both technical and non-technical audiences

This is a great opportunity and salary is dependent upon experience. Apply now for more details

Azure Data Engineer Microsoft Fabric
interAct Consulting Limited
Milton Keynes
Remote or hybrid
Mid - Senior
£50,000
RECENTLY POSTED

Were looking for a skilled Azure Data Engineer with hands-on experience in Microsoft Fabric to join our growing data team. If youre passionate about building scalable, modern data platforms in Microsoft Azure, wed love to hear from you.

What Youll Do

  • Design, build, and maintain scalable data pipelines using Azure services
  • Develop and optimize solutions in Microsoft Fabric (Data Factory, Lakehouse, Warehousing)
  • Implement ETL/ELT processes using tools such as Azure Data Factory
  • Work with large datasets in Azure Synapse Analytics and Azure Data Lake Storage
  • Collaborate with analysts and stakeholders to deliver high-quality, reliable data solutions
  • Ensure data governance, security, and performance best practices

What Were Looking For

  • Strong experience with Azure data services
  • Proven experience with Microsoft Fabric
  • Proficiency in SQL and Python
  • Experience designing data models and working with large-scale datasets
  • Understanding of CI/CD and DevOps practices

Excellent problem-solving and communication skills

Data Engineer - AWS
Coventry Building Society
Manchester
Hybrid
Mid - Senior
£50,000/day
RECENTLY POSTED

About the role

Working in our Data and Analytics Delivery department, the Data Engineer will join the group on a 12-month fixed term contract to focus on the migration and integration of data into our new ecosystem.

The Data Engineer will be designing, developing and testing quality data engineering solutions and will look to challenge and improve our processes, tools and approach. The person in post will undertake review and assurance activity, providing other team members with guidance on design, build and test activity.

Adhering to standard driven code development, the Data Engineer will deliver solutions that meet business needs in a timely manner and will take responsibility for the testing of their solution, including the analysis of requirement, designs of test cases & scripts, preparing test data and creating and executing tests to ensure effective and accurate deliverables.

We operate on a team ledhybrid approach with at least 1 days a week in the Coventry or Manchester office.

Our benefits include:

  • 28 days holiday a yearplus bank holidays and a holiday buy/sell scheme
  • Annual discretionary bonus scheme
  • Personal pension with matched contributions
  • Life assurance (6 times annual salary)

We reserve the right toclosethis advertearlyif we receive ahigh volumeof suitable applications

About you

Youll either have a Data Engineering related qualification and/or extensive Data Development experience in a commercial or Agile environment.

To be successful in this role its essential that you will:

  • Have experience of AWS, Python, SQL, Gitand PySpark

Desirable experience needed will be:

  • SISS or SAS experience
  • Quality Assurance and Test Automation experience
  • Experience of Database technologies
  • Experience in Financial Services organisation

About us

In 2025, Coventry Building Society purchased The Co-operative Bank. Bringing together our purpose-led building society with the UKs original ethical bank was the start of an exciting journey.

Trusted by over four million people, were a mutually owned business free from shareholders, and with our combined experience of almost 300 years, our ethics and dedication will continue to guide us. Together, we have shared values and an ethical approach towards our members, customers and colleagues.

Were officially recognised as a Great Place to Work and our benefits go beyond basic pay, with a discretionary bonus scheme, a culture of reward and recognition and comprehensive support for wellbeing.

Were serious about equality, of race, age, faith, disability, and sexual orientation and we celebrate diversity. By working together, we know youll build more than just a career with us.

Flexibility and why it matters
We understand the need for flexibility, so wherever possible, well consider alternative working patterns.Have a chat with us before you apply to see what the possibilities are for this role.
Proud to be a Disability Confident Committed Employer
Were proud to offer an interview or assessment to every disabled applicant who meet the minimum criteria for our vacancies. As part of the application process, disabled applicants can opt in for the Disability Confident Interview Scheme. If there are ever occasions where it is not practicable to interview all candidates that meet the essential criteria, such as when we receive a high number of applications, we commit to interviewing disabled candidates who best meet the minimum essential and desirable criteria.

Principal Data Scientist
Cambridge University Press & Assessment
Cambridge
Hybrid
Senior
£95,000
+1

Job Title:Principal Data Scientist

Salary:£74,200 - £99,250

Location:Cambridge/Hybrid with 2 day per week at the office

Contract:Permanent

Hours:Full time 35 hours per week

Are you excited by the challenge of applying data science and AI to problems that genuinely matter? At Cambridge Assessment, we are transforming how assessments are designed, delivered and marked worldwide. As a Principal Data Scientist, you will play a pivotal role at the heart of this transformation leading our data science capability for AI-enabled assessment products used by millions of learners globally.

We are Cambridge University Press & Assessment, a world-leading academic publisher and assessment organisation and a proud part of the University of Cambridge.

This is a senior, influentialrole where you will combine deep technical expertise with strategic leadership. You will shape our data strategy, lead and mentor a growing team, and work closely with researchers, engineers and product teams to turn complex data into insight, innovation and trusted solutions.

About the role

As PrincipalData Scientist, you will lead the operational data science and analytics capability within our Assessment & Research Capabilities (ARC) function. You will be the data leader for automarking, representing ARC’s data capability across Exam Technology and the wider organisation.

Youwill:

  • Set the direction for data science and analytics supporting automarking and AI-driven assessment
  • Lead and grow a small, high-impact team of data scientists and engineers
  • Curate high-quality data products used across research, machine learning and product teams
  • Act as a trusted partner to senior stakeholders, influencing product and research decisions with evidence and insight
  • Ensure sensitive exam and candidate data is handled responsibly and ethically

Additional responsibilities and accountabilities include:

  • Lead data science, data engineering and analytics activities within ARC
  • Define and own the data strategy for automarking and related AI capabilities
  • Design and oversee data warehouses, pipelines and integrations with the wider organisation
  • Translate complex business and research needs into robust data solutions
  • Provide expert input into product, research and architectural decisions, up to board level
  • Build strong relationships with internal teams and external research partners
  • Champion best practice in data quality, DataOps and analytics engineering

This position has been classified as a hybridrole, requiring the selected candidate to typically spend 40-60% of their time collaborating and connecting face-to-face at their dedicated location. Aside from our hybrid principles, other flexible working requests will be considered from the first day of employment, including other work arrangements should yourequireadjustments due to a disability or long-term health condition.

About You

To be successful in this role, you will bring:

  • Extensive experience in data science, analytics or analytics engineering in a complex environment
  • Advanced SQL skills, including writing, analysing and optimising large analytical queries
  • Strong experience with a data science programming language such as Python, R or Julia
  • Hands-on experience with data transformation tools such as dbt, Dataform or SQLMesh
  • Experience using BI and visualisation tools such as Metabase, Looker, Tableau or Power BI
  • A strong understanding of data warehousing principles (e.g. Kimball methodology)
  • Experience designing data models that enable self-service analytics
  • Proven ability to translate business or research questions into data-driven insights
  • Experience communicating complex technical concepts to non-technical and senior audiences
  • Leadership experience, including mentoring and guiding other data professionals

If you meet theaboveminimumrequirements, we encourage you to apply. Your application will be even stronger if you can alsodemonstratethefollowingdesirablecriteria:

  • Machine learning or AI product experience
  • Exposure to automarking, assessment, or high-stakes data environments
  • Skills in experimentation and statistical analysis (A/B testing, forecasting)
  • Familiarity with DataOps (CI/CD, testing, orchestration, observability)

For a detailed job description, please refer to the linkat the bottom of the advert on our careers site.

We are aDisability Confident (DC) employer that is committed to equality and inclusion ensuring our recruitment process is accessible to all. The DC scheme’sOffer of an Interviewcommitment applies toapplicants who opt in, anddisclosea disability or a long-term health condition, and best meet theminimumcriteria for the role. In instances where interviewing all qualifying candidates is notpracticable, we prioritise those who best meet theminimumcriteria, as we would for applicants who do not have a disability or long-term health condition.

Cambridge University Press & Assessment is an approved UK employer for the sponsorship of eligible roles and applicants under the Skilled Worker visa route. Please refer to thegov.ukwebsite for guidance to understand your own eligibility based on the role you are applying for.

Rewards and benefits

Wewill support you to be at your best in work and to live well outside of it. In addition to competitive salaries, we offer a world-class, flexiblerewards package, featuring family-friendly and planet-friendly benefits including:

  • 28 days annual leave plus bank holidays
  • Private medical and Permanent Health Insurance
  • Discretionary annual bonus
  • Group personal pension scheme
  • Life assurance up to 4 x annual salary
  • Green travel schemes

Ready to pursue your potential? Apply now.

We aim tosupport candidates by making our interview process clear and transparent. The closing date for all applications will be13thMarchWe will review applications on an ongoing basis, and shortlisted candidates can expect interviews to take place shortly after it closes.

As part of theapplication process, you can expect:

At application stage: four technical questions to answer when submitting your CV.

Stage 1: 30-minute screening call with the hiring manager.

Stage 2: 60-minute session includes questions about key skills as well as a code review or whiteboard exercise.

Stage 3: 90-minute system design exercise with an assignment provided at least three days before the interview. During the interview, is where the designs are explained and discussed.

Stage 4: Leadership and cultural 45-minute interview.

If you require any reasonable adjustments during the recruitment process due to a disability or a long-term health condition, there will be an opportunity for you to inform us via the online application form. We will do our best to accommodate your needs.

Please notethat successful applicants will be subject to satisfactory background checks including DBS due to working in a regulated industry.

We arecommitted toan equitablerecruitment process. As such, applications must besubmittedvia our official online application procedure. Please refrain from sending your CV directly to our recruiters. If you experience technical difficulties or requireadditionalsupport withsubmittingyour online application, contact the Recruiter.

Why join us

Joining us isyour opportunity to pursue potential.You willbelong to a collaborative teamthat isexploring new and better ways to serve students,teachersand researchers across the globe for the benefit of individuals,societyand the world. Sharing our mission will inspire your own growth,developmentand progress, in an environment which embraces difference, change and aspiration.

Cambridge University Press & Assessment is committed to being a place where anyone can enjoy a successful career, whereit issafe to speak up, and where we learn continuously to improve together. We welcome applications from all candidates, regardless of demographic characteristics (age, disability, educational attainment, ethnicity, gender, marital status, neurodiversity, religion, sex, genderidentityand sexual identity), cultural, or social class/background.

We believe better outcomes come throughdiversity of thought,backgroundand approach. We welcome applications from people from all backgrounds and communities, activelyseekingto employ people from a wide range of different communities.

Senior Clean Water Modeller
Orion Electrotech Sales
Brighton
Fully remote
Senior
£60,000

Job Title: Senior Clean Water Modeller

Salary: £55,000 - £65,000/year

Location: Fully remote

Contract Type: Permanent, Full Time

Hours: 37

About the role

We are looking for an experienced Senior Clean Water Modeller with expertise in InfoWorks WS Pro to support the development and application of clean water distribution models. You will play a key role in strategic planning, operational optimisation, leakage reduction and regulatory compliance across potable water networks.

What you will be responsible for:

  • Lead the development, maintenance and calibration of clean water hydraulic models using InfoWorks WS Pro.
  • Validate models against telemetry, logger and flow/pressure test data.
  • Conduct scenario modelling to assess network performance under normal and stress conditions.
  • Support operational teams with real-time and predictive modelling for pressure management and resilience.
  • Provide modelling for investment planning, including mains reinforcement, DMA creation and growth impact.
  • Simulate water quality parameters such as water age, chlorine decay and booster performance.
  • Mentor junior modellers and contribute to modelling standards, QA/QC and workflow automation (Python, SQL).
  • Prepare and present reports and visualisations for internal and external stakeholders.

What youll bring to the role:

Essential:

  • Understanding of water and wastewater engineering within the UK Water Industry.
  • Degree (MEng/BEng/BSc) or HNC in Engineering, Environmental Science or related field.
Senior Data Engineer, Vice President
State Street
London
Remote or hybrid
Senior
Private salary

This job is with State Street, an inclusive employer and a member of myGwork – the largest global platform for the LGBTQ+ business community. Please do not contact the recruiter directly.

Job Description

We are looking for a Senior hands-on Data Engineer for Cloud Data Lake design and development. The candidate should have Financial Services experience in design, architecture and development of large scale enterprise applications using Cloud based Data engineering platforms. This hands-on role will partner with senior-level development managers, architects and business leadership to develop and execute the technology product roadmap.

Main Duties and Responsibilities:

• End to end Cloud Data Lake design & development including data ingestion, data modeling and data distribution.

• Build data integrations, hand-offs between on-prem/cloud-based systems.

• Design and develop high volume data ingestion components and solutions to collect data from various sources.

• Manage and use appropriate tools in the cloud data lake development and deployment.

• Responsible for developing/implementing cloud infrastructure to support current and future business needs.

• Participating in technical design, application build, configuration, unit testing, and production deployment.

• Ensuring all cloud solutions exhibit higher level of cost efficiency, performance, security, scalability, and reliability

Required Skills:

• Development experience in designing, developing and deploying complex applications.

• Strong tech skillset/experience in PL/SQL, Java/J2EE, Python, Scala, PERL/scripting .

• Hands on experience with Cloud platforms, preferably using Databricks.

• Experience in building systems using modern, scalable, resilient, cloud native architectures.

• Experience in Data Modeling and database design with strong skills in performance tuning.

• Hands on experience in setting up data pipelines for ELT jobs across multiple data sources.

• Hands on experience in big-data processing, troubleshooting and resolving database performance issues.

• Strong knowledge of Cloud Security in AWS/Azure, specifically IAM Roles & Polices, Security Groups and Encryption keys.

• Experience with optimizing database performance, scalability, ensuring data security and compliance.

• Experience with event based, micro-batch and batched high volume and high velocity transaction and data processing system.

• Proficiency with CICD and DevOps.

Education & Qualifications

Bachelor’s/Master’s Degree in a Computer Science, Engineering or Math or equivalent experience

10+ years’ experience in professional software design and development.

Strong analytical skills, with ability to collect, absorb, and analyze information quickly and independently

Proven ability to develop and work with cross functional processes and project timelines

Excellent follow-through, attention to detail and time management skills

About State Street Across the globe, institutional investors rely on us to help them manage risk, respond to challenges, and drive performance and profitability. We keep our clients at the heart of everything we do, and smart, engaged employees are essential to our continued success.

We are committed to fostering an environment where every employee feels valued and empowered to reach their full potential. As an essential partner in our shared success, you’ll benefit from inclusive development opportunities, flexible work-life support, paid volunteer days, and vibrant employee networks that keep you connected to what matters most. Join us in shaping the future.

As an Equal Opportunity Employer, we consider all qualified applicants for all positions without regard to race, creed, color, religion, national origin, ancestry, ethnicity, age, disability, genetic information, sex, sexual orientation, gender identity or expression, citizenship, marital status, domestic partnership or civil union status, familial status, military and veteran status, and other characteristics protected by applicable law.

Discover more information on jobs at StateStreet.com/careers

Read our CEO Statement

]]>

Data Engineer (Online Monitoring)
Advertising Standard Authority
London
Hybrid
Junior - Mid
£42,000 - £52,000

28-35hrs per week- open to discuss flexible working of these hours Remote with some attendance at our London office in Shoreditch The ASA is the UK’s regulator of advertising across all media, including online. Our work includes taking proactive action against misleading, harmful, offensive or otherwise irresponsible ads and acting on complaints. In short, we make sure ads are legal, decent, honest and truthful. In this role you will join our Data Science team and work on our world-leading Active Ad Monitoring system, which uses AI to proactively monitor online advertising. In 2025 the system captured and processed 60 million ads across social media, search and programmatic display. The ASA uses this intelligence to help regulate ads across high-priority topics like injectable weight-loss medications, green claims companies make to consumers, disclosure of influencer marketing and many more. You will help develop and maintain the tools we use to capture, process, and apply AI models to large datasets of ads within the Active Ad Monitoring system. We’re looking for someone who wants to use their skills and expertise to help shape a safer advertising landscape. Our team mission is to protect UK consumers from adverts that are misleading, cause harm and target those within our society that are the most vulnerable. Working as part of our small agile team you will have the opportunity to own your work end-to-end, seeing directly how the code you write helps protect UK consumers. You will work in a cloud-based environment, primarily in Python, and with a range of industry standard tools such as Snowflake, Docker and Airflow. You will work primarily with unstructured data - namely ads in a variety of formats including images, videos and text from a range of online channels. About you \* You may not have been a Data Engineer before but you will have the ability to work with data in Python to a professional standard, and deliver high-quality code that works reliably in a production setting. \* You‘ll be working with people from both technical and non-technical backgrounds so you’ll need to be adept at being able to translate complex technical language to non-technical people. \* You’ll be impact focused- understanding the problems the ASA faces and prioritising technical solutions that will deliver real impact. \* You will need to be curious and ambitious, creatively solving problems that may arise whilst always having an eye on system/process improvements. \* You’ll enjoy working with others from different technical disciplines each using your unique expertise to further the work, whilst also developing your own technical knowledge and skills. We are committed to building a workforce that reflects the full diversity of the UK population. We believe that varied perspectives and experiences strengthen our organisation and help us deliver our work more effectively. We welcome applications from people of all backgrounds and identities, and we actively encourage candidates from minority or underrepresented groups to apply. Women are currently under‑represented within data engineering roles, and within our Data Science team. In line with our commitment to equality, diversity and inclusion, we particularly encourage applications from women and others who are under‑represented in this area. Our recruitment process ensures applications are absent of names or any identifiable information which supports our aim of finding the best person for the role based on their skills and experience only. How to apply: If you’re interested in applying for this role, please review the job description below and complete our online application process which includes answering some online questions regarding your motivation for applying for this role and your skills and experience. Closing date: 16th March 2026. Please note we will be reviewing applications as they come in and we reserve the right to close the advert early if we receive a significantly high number of applicants. Please feel free to use AI to enhance your application but not to write it for you. We’re interested to know your thoughts, experiences and ideas. You’ll need to stand up what you’ve told us in your application if you attend an interview, so please make sure we feel the person we’ve met on paper is the person we meet in the room

Data Engineer - Data Vault
Randstad Technologies Recruitment
Not Specified
Hybrid
Senior - Leader
£60/hour - £80/hour

Senior Data Engineer (Data Modernization)

We are looking for a proactive, goal-oriented Senior Data Engineer to build and scale high-performance big data pipelines. This role is ideal for a collaborative problem-solver who excels in distributed environments and values technical excellence through CI/CD and Agile.

The Essentials

  • Pipeline Tech: 5+ years of experience with Kafka, Spark, Hadoop, and DBT.
  • Modern Modeling: Expert skills in Data Vault Mandatory and Dimensional modeling.
  • Cloud & DevOps: Strong AWS experience with a focus on CI/CD and writing secure code.
  • Data Governance: Proven ability to embed quality, lineage, and monitoring into every pipeline.
  • Leadership: A passion for guiding and coaching fellow team members both technically and procedurally.

The Mission

You will lead data modernization efforts, ensuring large-scale systems remain compliant and secure while maintaining a “right tool for the job” mindset. You’ll bridge the gap between complex data engineering and actionable analytics/ML concepts.

Apply

If you have a passion for building well-governed, scalable systems and want to lead a high-impact team, please apply with your CV

Randstad Technologies is acting as an Employment Business in relation to this vacancy.

Data Automation Engineer
Panoramic Associates
Not Specified
Hybrid
Mid - Senior
£300/day - £400/day
TECH-AGNOSTIC ROLE

Automation / Data Engineer

Location: Hybrid working (Midlands)

Panoramic Associates are supporting a Local Authority through a digital transformation programme, modernising how services are delivered to residents. They are scaling AI assisted tools, intelligent automation, and data engineering capabilities to improve service quality and reduce operational costs.

There are roles available across all levels to join this programme and support the delivery of an organisation wide automation and data strategy. You will be an experienced automation or data engineer with a track record of delivering measurable transformation within a complex organisation, ideally in the public sector. Ability to work independently is key - you will be a trusted member on the team.

As an engineer you will:

  • Manage delivery of automation and data projects
  • Designing and implementing intelligent automation, integration solutions, and scalable data pipelines
  • Identifying opportunities council wide
  • Communicate technical concepts to stakeholders

I’m keen to speak with candidates with varied skillsets in this space, with a focus on the Microsoft stack, UI Path, Blue Prism, Power Automate, and alternative low/no code experience. Additionally, experience working across multiple service areas within a Local Authority will be prioritised!

Unfortunately we cannot offer sponsorship or fully remote at this time.

Pop through an application if the above role suits your experience!

Principal AI Platform Engineer
Harnham - Data & Analytics Recruitment
Yorkshire
Hybrid
Senior
£85,000 - £90,000

PRINCIPAL AI PLATFORM ENGINEER

Up to £90,000 + BENEFITS

SHEFFIELD (Hybrid)

This is a standout opportunity to shape and scale an AI function from the ground up. You will drive the build of production-grade AI platforms, develop agentic automation for complex workflows, and deliver real business impact in an environment where engineering decisions directly influence performance and efficiency.

THE COMPANY:

They are a technology-led insurance organisation. Their products are powered by a combination of smart technology and human expertise, enabling them to offer fast, tailored cover to customers with diverse needs. With strong investment behind AI, they are entering a new phase of growth and building their first dedicated AI engineering team. Joining at this stage gives you the chance to influence technical strategy, architecture, and best-practice from day one.

THE ROLE:

  • Build and operate production-ready AI agents on GCP
  • Design robust RAG pipelines covering ingestion, text processing, vector search and secure data handling.
  • Implement evaluation frameworks, monitoring, A/B testing and performance dashboards for latency, cost and accuracy.
  • Partner with product and operations teams to deploy AI capabilities into live environments and continually optimise performance.
  • Shape engineering standards, patterns and tooling as part of a new AI function.

YOUR SKILLS AND EXPERIENCE:

  • Strong commercial experience in Data Engineering, ML Engineering or Software Engineering with applied AI delivery.
  • Deep hands-on expertise with GCP services
  • Strong Python skills
  • Practical experience with LLMs, embeddings, RAG architectures and vector databases.
  • A track record of building production-grade AI systems, including observability, evaluation and automated testing.
  • DevOps capability across CI/CD, Docker and Kubernetes or equivalent tooling.

THE BENEFITS:

You will receive a salary, dependent on experience. Salary is up to £90,000 On top of the salary there are some fantastic extra benefits.

HOW TO APPLY

Please register your interest by sending your CV to Molly Bird via the apply link on this page.

Junior AI Data Engineer
hireful
London
Hybrid
Junior
£35,000 - £45,000

Take the next step in your data career & work with cutting-edge AI driven data migration projects! Small, but mighty data transformation company, operating in the financial services & banking arena are looking for a Data Analyst / Data Engineer to work on a freshly built AI data migration & pipeline application platform. A most excellent opportunity for an ambitious junior to move on in their career & work with agentic AI at the forefront of data manipulation. Job title: Data Engineer / Data Analyst. Location: We have a London office (Liverpool Street) but operate remotely across the UK. However, for this role, we d like someone commutable to London (London or home counties, maybe?) V flexible on office / home-based work though. Salary: £40K - £45K + Bens What you ll be doing: - Working with our newly built, in-house agentic AI data migration, transformation & schema building platform! - SQL / Python scripting: Prompt > test > validate > deliver. - Working closely with our Senior Data Engineer & Data Project delivery manager on client projects - Learning a great deal about complex financial data sets, migration, schemas & AI data platforms! What you ll need to bring: - SQL & Python coding knowledge. Working with complex financial data (migration, ETL, Schemas, etc) would be great, but any sphere is totally fine. - Data related, STEM, Computer science, etc type degree, or equivalent experience. - Inquisitive, questioning nature with oodles of critical thinking! That s it. We d love to hear form you, so please do hit the apply now button, or get in touch to be considered.

Data Architect- Insurance
McGregor Boyall
London
Remote or hybrid
Senior - Leader
£95,000 - £115,000

Data Architect, Data Lake, AWS, Azure, Insurance, Cloud

We are seeking an experienced and forward-thinking Data Architect to lead and optimise our data architecture initiatives, with a strong focus on the insurance sector. You will be responsible for designing, implementing, and governing scalable, high-performance data solutions that support both internal objectives and client-facing initiatives.

  • Build modern data infrastructure using technologies such as Databricks, Snowflake, Data Lakes, Data Warehouses, and Lakehouse architectures.
  • Promote and implement data mesh principles to enhance data accessibility across the global organisation.
  • Utilise deep expertise in SQL and database management to optimise performance and scalability.
  • Apply industry knowledge to support insurance-specific data needs, including operational efficiency and regulatory compliance.
  • Possess expert-level knowledge in AWS or Azure cloud technologies
  • Extensive experience as a Data Architect within large, complex organisations-ideally with deep specialisation in the insurance industry.
  • A strong track record of designing and implementing successful enterprise-level data strategies.
  • Strong cloud experience in wither AWS or Azure.
  • Expertise across SQL, data solutions, and solution architecture for data lakes, data warehouses, and modern data frameworks.
  • Exceptional leadership, communication, and stakeholder engagement skills.
  • Solid understanding of the insurance domain, with experience in the wealth sector or exposure to technologies such as Aladdin or Guidewire considered advantageous.
  • A Bachelor’s or Master’s degree in Computer Science, Information Technology, or a related field.

This opening can be based from multiple locations

Data Architect, Data Lake, AWS, Azure, Insurance, Cloud

McGregor Boyall is an equal opportunity employer and do not discriminate on any grounds.

Database Administrator
Logistex
Kettering
Remote or hybrid
Mid - Senior
Private salary
TECH-AGNOSTIC ROLE

Are you experienced in Postgres or Oracle databases? Do you enjoy solving complex technical problems and ensuring systems run smoothly? If so, you could be our next Database Administrator!

What is in it for you?

  • Become a member of an Employee-owned trust
  • Performance bonus
  • Cycle to work scheme
  • Option to buy additional leave
  • Private medical insurance

What will you be doing?

  • Manage, maintain and optimize Postgres and Oracle databases
  • Perform upgrades, patches, backups and recovery testing
  • Monitor performance and troubleshoot issues proactively
  • Ensure database security, compliance and documentation
  • Support CI/CD, DevOps and cross-functional teams

What are we looking for?

  • Proven experience as a DBA or similar role
  • Strong knowledge of Postgres and Oracle
  • Experience with performance tuning and troubleshooting
  • Understanding of database security best practices
  • Ability to work independently and within a team

Make you application today! We will be in touch for chat.

Data Engineer BI
Kiota Recruitment
Eastleigh
In office
Mid - Senior
£450/day
+1

We are working with a well-established engineering group operating at the heart of the UK water and infrastructure sector, delivering pumping and environmental solutions nationwide. As part of continued investment in technology and data capability, they are now seeking a Contract Data Engineer (BI) to join their team based in Chandlers Ford. This role is pivotal in designing, developing, and optimising a scalable cloud-based data platform that underpins strategic decision-making across the organisation. You will shape data strategy, enhance governance, and drive innovation in business intelligence and analytics. Responsibilities : Design and develop robust cloud-based data pipelines and scalable data architectures Build and optimise data solutions using Databricks, Synapse, Fabric or equivalent cloud technologies Develop Python-based data processing, automation, and packaging solutions Design and maintain high-performance data models and warehousing environments Implement governance frameworks ensuring data quality, security, and accessibility Engage with senior business and IT stakeholders to gather requirements and translate them into technical solutions Drive DevOps and CI/CD best practices across the data function Implement infrastructure as code using tools such as Bicep or Terraform Solve complex data challenges with a strategic and analytical mindset Support business intelligence initiatives ensuring data is reliable, accessible, and insight-driven Skills & Experience : Strong experience in a data engineering or cloud data architecture role delivering enterprise-grade solutions Deep expertise in modern cloud data processing platforms such as Databricks, Synapse or Fabric Advanced Python programming skills for scalable data processing and automation Extensive SQL experience across relational and non-relational databases Strong understanding of data modelling, warehousing, and governance principles Experience with containerisation and orchestration tools such as Docker or Kubernetes Proven background in DevOps and CI/CD methodologies Ability to communicate complex data concepts clearly to technical and non-technical stakeholders Willingness to travel occasionally across UK sites where required Summary : Position : Data Engineer (Business Intelligence) Location : Chandlers Ford Contract Rate : £450 £500 per day Duration : 3 month initial Contract This is a high-impact contract opportunity for a technically strong Data Engineer to influence data strategy and build scalable solutions that directly support business growth and performance. Apply Now ? TPBN1\_UKTJ

Trainee Data Analyst - Training Course
Netcom Training
Sheffield
Fully remote
Graduate - Junior
Private salary

Are you ready to launch a career in Data Analytics and Business Intelligence? Netcom Training s fully-funded Data course (NCFE Certificate in Data, Level 3) equips you with the technical skills employers are actively seeking.

From data sourcing, cleansing, and analysis to visualisation and reporting, you ll gain hands-on experience that prepares you for today s fast-growing data-driven roles.

Our learners have successfully moved into roles such as Junior Data Analyst, Operations Analyst, Business Intelligence Assistant, Database Administrator, and Pricing Analyst, working across tech, finance, healthcare, and the public sector. Complete the course and gain a guaranteed interview with a leading employer, helping you kickstart your career.

Course Details

  • Start Date: 16/03
  • Duration: 10 weeks
  • Days: Mon-Thu
  • Times: 6-9pm
  • Format: Online, practical workshops

What you ll learn

  • Data Management: Understand how to source, gather, and store data securely.
  • Data Cleansing: Learn to collate and format raw data for accurate processing.
  • Analysis & Insight: Analyse datasets to support key business decisions and outcomes.
  • Visualisation: Present and communicate insights clearly to stakeholders.
  • Tools & Tech: Gain exposure to professional tools commonly used in the industry (e.g., Excel concepts, Reporting tools).
  • Compliance: Understand secure data handling and GDPR principles.
  • Collaboration: Practice continuous professional development in a team setting.

Career Pathway

Successful participants are guaranteed an interview with our network of UK-wide partners working with leading brands.

  • Potential Roles: Junior Data Analyst, Reporting Assistant, Data Administrator, Business Analyst.

Starting Salaries: Typically £22,000 £28,000 (role dependent)

Eligibility

To apply, you must:

  • Live in South Yorkshire
  • Be aged 19 or over
  • Earn below the gross annual wage cap of £34,194
  • Not currently be undertaking other government-funded training
  • Not be in the UK on a student, graduate, postgraduate, or sponsored visa, or as a dependent
Senior Data Platform Engineer
Haystack - Partnerships
London
Hybrid
Senior
Private salary

Permanent | Hybrid Working | South East England We are partnering with a fast-paced, customer-focused organisation undertaking a significant data transformation programme. With major investment in a modern lakehouse platform and access to rich, high-volume datasets, this is an opportunity to help reshape how data is stored, analysed and leveraged across the business. As a Senior Platform Data Engineer, you will provide technical leadership within the Data Engineering team, working closely with Data Scientists, Machine Learning Engineers and business stakeholders to deliver scalable, high-value data solutions. Key Responsibilities - Design and build robust, scalable data pipelines to serve analytics and data science communities - Provide hands-on expertise across modern data engineering technologies (e.g. Databricks, Spark, Python, SQL, Scala) - Collaborate with data scientists and ML engineers to develop and deploy machine learning models addressing key business challenges - Coach and mentor engineers (including contractors), raising development standards and engineering maturity - Partner with Business Analysts to translate requirements into measurable business outcomes - Oversee code quality and project deliverables across releases - Establish and maintain documentation libraries and data catalogues for developed products - Contribute to platform evolution and continuous improvement of data engineering practices Core Skills & Experience Technical Capability - Significant experience designing and delivering data solutions on cloud-based, distributed big data platforms - Strong hands-on software engineering experience in Python, with knowledge of modern development practices (TDD, CI/CD, automated deployment pipelines) - Experience with automated testing of data transformation pipelines (e.g. Pytest, dbt unit testing frameworks) - Strong SQL skills, including performance tuning and debugging - Experience in data warehouse optimisation (schema evolution, indexing, partitioning) - Infrastructure as Code experience (e.g. Terraform or CloudFormation) - Strong knowledge of distributed data processing frameworks such as Apache Spark (or similar technologies such as Flink, Hadoop or Beam) - Familiarity with lakehouse architecture principles and modern data platforms - Experience implementing data quality, lineage and observability frameworks - Understanding of data governance, security and privacy principles, including handling of sensitive data within regulated environments Engineering & Collaboration - Comfortable working independently while aligning with overarching data strategy - Strong communication skills across technical and non-technical audiences - Structured, analytical problem-solver with a focus on outcomes and innovation - Passionate about modern data technologies and continuous learning Desirable Experience - Experience building real-time or event-driven data pipelines in commercial production environments (e.g. streaming architectures, Kafka, Spark Streaming, Beam) - Understanding of unbounded data processing and streaming design patterns - Familiarity with machine learning workflows and model lifecycle considerations - Experience supporting analytical visualisation tools (e.g. Tableau, Power BI or similar platforms) - Experience working within airline, ecommerce, retail or similarly data-rich industries - Experience within AWS cloud environments - Experience building transformation frameworks using dbt

Frequently asked questions
Typically, a Data Engineer should have a strong background in computer science or related fields, proficiency in programming languages like Python or Java, and experience with data warehousing, ETL processes, and big data technologies such as Hadoop or Spark.
Haystack features a wide range of Data Engineer positions, including roles in startups, large enterprises, and remote opportunities. You can find jobs specializing in cloud data engineering, real-time data processing, data pipeline development, and more.
To improve your chances, tailor your resume to highlight relevant skills and projects, gain hands-on experience with popular data tools, contribute to open-source projects, and stay updated with the latest trends in data engineering.
Yes, Haystack lists entry-level Data Engineer roles suitable for recent graduates or professionals transitioning into data engineering, as well as internships and junior positions to help you start your career.
Absolutely. Haystack offers many remote and flexible Data Engineer job listings to suit your preferred working style and location.