Data Engineer Jobs

Make yourself visible and let companies apply to you.

Roles

Data Engineer Jobs

Overview

Looking for top Data Engineer jobs? Explore the latest data engineering opportunities on Haystack, your go-to IT job board. Whether you're skilled in ETL, data pipelines, or big data technologies, find the perfect role to advance your career today. Start your search for Data Engineer positions now!

Filters applied

Data Engineer

Salary

Location

Remote preference

Role type

Seniority

Tech stack

Sectors

Contract type

Company size

Visa sponsorship

Spotlight

Principal AI Engineer

We’re looking for a Principal AI Engineer who combines deep technical expertise with the ability to set direction, influence stakeholders, and shape the future of AI engineering across the enterprise. Our AI Acceleration organisation is building high-impact AI-powered applications that deliver measurable business value at speed. As a Principal AI Engineer, you will serve as both a hands-on technical leader and a strategic partner driving architectural choices, aligning with business and technology stakeholders, and ensuring that our AI systems are secure, reliable, and scalable.

This is a role for leaders who thrive at the intersection of disciplined engineering, AI innovation, and organizational influence. You will work across teams and business units to align technical strategies, define reusable platforms, and raise the bar for how AI is built and operated at scale. You will shape the long-term roadmap for AI engineering while ensuring delivery on today’s most pressing priorities.

Job Responsibilities

Set Technical Direction: Define the long-term technical strategy for AI engineering across the enterprise, ensuring alignment with organizational priorities and technology roadmaps.

Architect for Scale: Drive architectural decisions for platforms and applications that leverage LLMs, retrieval-augmented generation, AI agents, and unstructured data processing at enterprise scale.

Influence & Align: Partner with senior engineering leaders, product managers, business stakeholders, and governance teams to align AI initiatives with business value, compliance, and responsible AI practices.

Cross-Org Leadership: Lead multi-team initiatives, ensuring delivery of AI platforms and applications that are reusable, discoverable, and secure.

Raise the Bar: Mentor senior and staff engineers, fostering technical excellence, operational rigour, and a culture of innovation and reuse.

**Future-Proof AI:**Evaluate emerging AI frameworks, protocols, and ecosystems, identifying opportunities to standardise, reduce duplication, and avoid vendor lock-in.

Operational Excellence: Establish engineering standards, metrics, and best practices for deploying and operating AI systems reliably in production.

Thought Leadership: Represent AI engineering in internal and external forums, shaping industry perspective and ensuring bp remains a leader in practical AI adoption.

About you:

12+ years of professional software engineering experience, with a track record of designing and delivering complex, production-grade systems.

Demonstrated experience leading cross-functional engineering initiatives at scale, with ability to influence without direct authority.

Expertise in modern software architecture, distributed systems, and cloud infrastructure (AWS, Azure, or GCP).

Deep hands-on experience integrating AI/ML systems into production environments, including LLMs, RAG, vector search, and AI agents.

Strong ability to communicate technical strategy to executives, engineers, and business partners alike.

Proven ability to set and enforce engineering standards for quality, security, and operational reliability.

Experience mentoring senior engineers and shaping the growth of engineering organisations.

Preferred:

Experience defining enterprise-level AI architectures, platforms, or internal developer tools.

Familiarity with AI orchestration frameworks (LlamaIndex, LangChain, Crew AI, AutoGen, etc.) and best practices for agentic systems.

Track record of contributions to open-source AI/ML communities or internal platform accelerators.

Background working in environments requiring compliance, security, and governance for AI applications.

Exposure to both traditional ML and modern GenAI systems, with ability to evaluate trade-offs and guide adoption.

Why join us?

At bp, we provide an excellent working environment and employee benefits! We offer an open and inclusive culture and a great work-life balance. Tremendous learning and development opportunities are available to craft a career path, life and health insurance, medical care package and many others!

We support our people to learn and grow in a diverse and exciting environment. We believe that our team is strengthened by diversity. We are committed to crafting an inclusive environment in which everyone is respected and treated fairly. We will ensure that individuals with disabilities are provided reasonable accommodation to participate in the job application or interview process, perform crucial job functions, and receive other benefits and privileges of employment.

Travel Requirement

Up to 10% travel should be expected with this roleThis role is not eligible for relocationThis position is a hybrid of office/remote workingAI Agents, Cloud Infrastructure, Commercial Acumen, Communication, Data Analysis, Data cleansing and transformation, Data domain knowledge, Data Integration, Data Management, Data Manipulation, Data Sourcing, Data strategy and governance, Data Structures and Algorithms (Inactive), Data visualization and interpretation, Digital Security, Extract, transform and load, Group Problem Solving, Software Engineering

Legal Disclaimer:

We are an equal opportunity employer and value diversity at our company. We do not discriminate on the basis of race, religion, color, national origin, sex, gender, gender expression, sexual orientation, age, marital status, socioeconomic status, neurodiversity/neurocognitive functioning, veteran status or disability status. Individuals with an accessibility need may request an adjustment/accommodation related to bp’s recruiting process (e.g., accessing the job application, completing required assessments, participating in telephone screenings or interviews, etc.). If you would like to request an adjustment/accommodation related to the recruitment process, please contact us.

If you are selected for a position and depending upon your role, your employment may be contingent upon adherence to local policy. This may include pre-placement drug screening, medical review of physical fitness for the role, and background checks.

12 months

Remote

470 per day inside IR35 - Umbrella only

Active SC clearance and eligible candidates will be considered

Project description

Our client playing a crucial role in the ESN project in 2025, which aims to modernize and enhance communication for frontline emergency services in the UK. This initiative will greatly enhance the capabilities of emergency services, allowing them to share vital data and information quickly and securely, improving response times and overall public safety.

Required Skills

Data Stage, RedShift, QuickSight, S3

data migration/ ETL both batch and real time

data warehouse development

GitHub/lab experience

Nice to have:

Data quality

xml

AWS Data Specialty certification

All profiles will be reviewed against the required skills and experience. Due to the high number of applications we will only be able to respond to successful applicants in the first instance. We thank you for your interest and the time taken to apply!

Job Title: Data Scientist (LLMs & ML) - UK Remote

A fast-growing healthcare organization is seeking a Data Scientist with strong experience in machine learning, deep learning, and Large Language Models (LLMs) to help drive innovation and automation in clinical services. This is a full-time, remote UK-based role.

Unfortunately we can’t consider candidates that require sponsorship

Key Responsibilities:

Research and deploy LLM-based solutions (e.g., LangChain, Mastra.ai, Pydantic) for document processing, summarization, and clinical Q&A systems.

Develop and optimize predictive models using scikit-learn, PyTorch, TensorFlow, and XGBoost.

Design robust data pipelines using tools like Spark and Kafka for real-time and batch processing.

Manage ML lifecycle with tools such as Databricks, MLflow, and cloud-native platforms (Azure preferred).

Collaborate with engineering teams to ensure scalable, secure ML infrastructure aligned with compliance standards (e.g., ISO27001).

Ensure data governance, particularly around sensitive healthcare data.

Share best practices and stay current with developments in AI, ML, and LLMs.

Requirements:

Proven experience with LLM frameworks and transformer-based architectures.

Strong Python skills and familiarity with key ML/DL libraries.

Experience with Azure (or similar cloud platforms), containerization (Docker/Kubernetes a plus), and MLOps tools.

Understanding of healthcare data privacy, compliance (e.g., ISO standards), and secure data handling.

Strong communication skills and ability to work cross-functionally in a collaborative environment

McGregor Boyall is an equal opportunity employer and do not discriminate on any grounds.

Contract Data Analyst

Spectrum IT Recruitment

Spectrum IT are working with a UK national client to recruit a Contract Data Analyst to support their reporting and data insight function. This role is fully remote and sits outside IR35. The successful candidate will be responsible for reviewing and enhancing existing reports, dashboards, and datasets, working closely with stakeholders to understand business needs and deliver accurate, meaningful insights.

Overview:

The Data Analyst will analyse current reports and dashboards to ensure they meet operational and strategic needs, identifying gaps and recommending improvements. They will then design and deliver data-driven reporting solutions using Power BI, SQL, Snowflake and potentially Tableau. Previous experience in the education/university sector is highly desirable, especially working with Ellucian Banner systems.

Key Responsibilities:

Review existing data, reports, and dashboards to assess accuracy, quality, and business relevance.

Collaborate with stakeholders to capture reporting requirements and translate into actionable solutions.

Develop, test, and deliver new data reports and dashboards using Power BI and Snowflake.

Write and optimise SQL queries for data extraction and transformation.

Provide insight and recommendations based on data trends and patterns.

Ensure data integrity and accuracy across multiple systems.

Support ad-hoc reporting needs as required.

Skills & Experience:

Proven experience as a Data Analyst or similar role.

Strong expertise in Power BI for data visualisation and reporting.

Proficiency in SQL for querying and analysis.

Hands-on experience with Snowflake (data warehouse) and ideally Tableau.

Strong analytical and problem-solving skills with the ability to interpret complex data.

Excellent communication and stakeholder engagement skills.

Education/university sector experience, including use of Ellucian Banner. This will be a key focus for our client in initial candidate review.

To submit your interest, please apply with an updated CV,

Spectrum IT Recruitment (South) Limited is acting as an Employment Business in relation to this vacancy.

Data Engineer

Harnham - Data & Analytics Recruitment

Leicester (Hybrid - 2 days/week in-office)

£45,000-£50,000

The Opportunity

A leading UK-based retailer is seeking a data-driven problem solver to join as a Data Engineer.

This role is ideal for a data analyst with strong data engineering skills, who is eager to work on meaningful projects that impact product visibility and sales across multiple international partner platforms.

What You’ll Be Doing

Become the subject matter expert for all third-party product and sales data

Develop tools and dashboards to communicate key partner data

Handle and scope new data requirements from external partners

Investigate and resolve data issues (e.g., product availability errors)

Build and manage ETL pipelines and APIs to improve data delivery and accuracy

Contribute to the overall data strategy alongside BI and analytics colleagues

Experience with web scraping or similar techniques would be a bonus.

Interview Process

Initial interview with the Data Manager

Technical discussion/assessment (you’ll walk through your approach to data problem-solving and tooling)

Security Cleared - AWS Data Engineer - Outside IR35

The contract market is gradually picking up again. This is an opportunity for an AWS Data Engineer to work on an exciting, public sector project alongside prominent Departments in the UK Central Government. This role is for a skilled technical Data Engineer looking to a more consultative, yet hands on position.

Please note: Active SC Clearance is Required

The challenge is representing complexities of business knowledge, rather than specific technical details therefore a strong consultant who is willing to engage with clients, learn domain knowledge, be proactive and curious in addition to standard tech would be ideal for the role.

Tech Stack:

AWS - S3 for storage, Lambda functions, Athena (thus strong SQL), Glue, Glue Data Catalog

Python

Current frontend is Tableau but experience with any of them will be interchangeable

DevOps experience a bonus e.g. Terraform, Drone, Kubernetes cluster management for microservice style API data consumption

Contract Summary:

Must have active SC Clearance

Outside IR35

6 Month Contract

Hybrid - Initially 2 Days a Week On Site

London Based

Government Public Sector

If your skills match the requirements of this role or you know someone who does, apply or feel free to get in touch with

Reasonable Adjustments:

Respect and equality are core values to us. We are proud of the diverse and inclusive community we have built, and we welcome applications from people of all backgrounds and perspectives. Our success is driven by our people, united by the spirit of partnership to deliver the best resourcing solutions for our clients.

If you need any help or adjustments during the recruitment process for any reason***,*** please let us know when you apply or talk to the recruiters directly so we can support you.

SAP Datasphere Consultant/Architect

Role: SAP Datasphere Consultant/Architect

Location: Remote

Length: 3 months initially - with a view to extend

Day Rate: Competitive Daily Rate

One of my market leading global clients is looking for a SAP Datasphere consultant based in Europe. They are looking for a datasphere expert and someone who has proven experience of setting up and taking ownership for the datasphere environment.

Key Requirements:

Proven experience working with SAP Datasphere

Strong experience with SAC

SAP BW Experience

Microsoft tools experience- Power BI, Azure, DataBricks etc

Global stakeholder engagement

If you are interested in this opportunity, please reply with your CV and I will be in touch ASAP.

Lawrence Harvey is acting as an Employment Business in regards to this position. Visit our website and follow us on Twitter for all live vacancies (lawharveyjobs)

Location: London, UK (3 days in the office)

SC Cleared: Required

Essential Skills & Experience:

10+ years of experience in data engineering, with at least 3+ years of hands-on experience with Azure Databricks.

Strong proficiency in Python and Spark (PySpark) or Scala.

Deep understanding of data warehousing principles, data modelling techniques, and data integration patterns.

Extensive experience with Azure data services, including Azure Data Factory, Azure Blob Storage, and Azure SQL Database.

Experience working with large datasets and complex data pipelines.

Experience with data architecture design and data pipeline optimization.

Proven expertise with Databricks, including hands-on implementation experience and certifications.

Experience with SQL and NoSQL databases.

Experience with data quality and data governance processes.

Experience with version control systems (e.g., Git).

Experience with Agile development methodologies.

Excellent communication, interpersonal, and problem-solving skills.

Experience with streaming data technologies (e.g., Kafka, Azure Event Hubs).

Experience with data visualisation tools (e.g., Tableau, Power BI).

Experience with DevOps tools and practices (e.g., Azure DevOps, Jenkins, Docker, Kubernetes).

Experience working in a financial services or economic data environment.

Azure certifications related to data engineering (e.g., Azure Data Engineer Associate).

Python Software Engineer Databricks

Python Software Engineer / Developer (Azure Databricks FastAPI) London to £90k

Are you a data centric Python Software Engineer?

You could be progressing your career in a senior, hands-on role at a fast growing, global Insurance Underwriting technology provider that focusses on developing a complex SaaS calculation platform for rapidly growing Cybersecurity insurance markets.

As a Python Software Engineer you will design and develop data centric backend services for the core platform with a focus on Python coding and building FastAPIs within an Azure environment with Databricks. You’ll participate in the design and implementation of advanced mechanisms for data ingestion, transformation, mass parallel orchestration of network IO and will model data for a variety of purposes.

You’ll also collaborate with the Infrastructure team to maintain Infrastructure as Code and develop new features on the engineering platform.

Location / WFH:

There’s a hybrid work from home model with three days a week in the high spec London, City office with rooftop bar.

About you:

You have strong Python software engineering skills

You have a good understanding of working with data at scale and strong SQL skills (PostgreSQL, SQL Server and Databricks)

You have experience of building FastAPIs

You have a thorough knowledge of Computer Science fundamentals including Data Structures, Design Patterns, OOP

You’re collaborative and pragmatic with great communication skills

What’s in it for you:

As a Python Software Engineer you will receive a competitive package:

Salary to £90k + bonus

25 days holiday

Private Medical Insurance (including dental and optical cashback)

Life Insurance, Income Protection

Pension

Subsidised gym membership

X4 paid volunteering days per year

Season ticket loan

Employee Assistance Programme

Impactful role with great career progression

Apply now to find out more about this Python Software Engineer / Developer opportunity.

At Client Server we believe in a diverse workplace that allows people to play to their strengths and continually learn. We’re an equal opportunities employer whose people come from all walks of life and will never discriminate based on race, colour, religion, sex, gender identity or expression, sexual orientation, national origin, genetics, disability, age, or veteran status. The clients we work with share our values.

Forward Deployed Engineer

Forward Deployed Engineer (Contract or Permanent)

Full Remote

Up to £90,000 p/a for permanent

Contract day rate is negotiable (Outside IR35)

We’re working with a fully remote, boutique AI consultancy and Palantir services partner. They help organisations in energy, healthcare, financial services, media, and recruitment use modern data and AI platforms to solve complex business challenges.

They are building a Palantir Foundry practice led by ex-Palantir leadership. Thanks to these relationships, they’re trusted with high-impact, mid-market projects with real business needs and quick delivery cycles.

This is a client-facing, hands-on engineering role where you’ll design and deliver solutions directly with clients. It’s a mix of consulting and coding, ideal for engineers who want to see their work make an immediate impact.

What You’ll Do

Work closely with clients to solve their toughest challenges using Palantir Foundry and modern AI/data tools.

Design and deploy scalable data pipelines, workflows, and applications.

Model complex datasets and create APIs that deliver real business value.

Collaborate with technical and non-technical stakeholders, shaping strategy as well as delivery.

Own projects end-to-end in a small, high-performing team.

What We’re Looking For

Hands-on Palantir Foundry expertise or transferable, client facing data engineering experience with large-scale data platforms such as:

Snowflake, Databricks, AWS Glue / Redshift, Google BigQuery

Software engineering skills in Python, Java, or TypeScript/React.

Strong data modelling, pipeline development, and API design experience.

Excellent problem-solving and communication skills.

Why This Role Stands Out

Impactful work at the intersection of AI, data, and business transformation.

Autonomy and visibility in a growing consultancy trusted by Palantir.

Flexible engagement: contract or permanent.

Small, pragmatic team with minimal bureaucracy.

Worth considering

For a contract position, you must have hands on commercial experience with Palantir Foundry

We’re open to the other mentioned platforms for permanent

We are prioritising those with shorter notice periods / availability to start due to projects kicking off

Apply now.

McGregor Boyall is an equal opportunity employer and do not discriminate on any grounds.

Data Architect

Xpertise Recruitment Ltd

Hiring: Data Architect - Leadership Cloud Data Strategy Hybrid: 3 Days/Week in London Up to £100,000 + 10% Bonus + Pension (up to 9%)

A leading organisation in the music licensing and rights management space is seeking a Data Architect to lead the design and evolution of its enterprise data systems. With a vast and complex dataset spanning over 17 million sound recordings, this is a high-impact role at the intersection of data architecture, analytics, and digital transformation.

This is a hands-on leadership role, managing a team of 5-6 Data Engineers, and collaborating across architecture, technology, and business functions to deliver scalable, modern data solutions.

What You’ll Do

Lead the technical design and delivery of the organisation’s analytic data platform

Define and own data architecture principles, modelling standards, and governance practices

Collaborate with architects, product owners, and external partners to shape scalable data solutions

Manage and mentor a high-performing team of Data Engineers

Support integration initiatives across cloud and legacy systems

Represent data architecture in governance forums and strategic planning

? What You’ll Bring

Proven experience designing and architecting complex, high-volume data systems

Strong hands-on knowledge of cloud platforms (AWS preferred), Snowflake, DBT, and data modelling tools

Experience with data integration, ETL, and API-based data exchange

Familiarity with Data Vault, dimensional modelling, and master data management

Excellent communication skills and ability to translate business needs into technical solutions

Prior experience managing data engineering teams

Background in music industry data or metadata (a plus)

Compensation & Benefits

Salary: Up to £100,000

Bonus: 10% annual performance bonus

Pension: Up to 9% employer contribution

Hybrid working: 3 days/week in London office, 2 days remote

Flexible hours and collaborative culture

This is a rare opportunity to shape the data architecture of a mission-driven organisation with global reach. If you’re passionate about data, leadership, and building systems that scale-this is your next move.

Job Title: Lead Data Engineer

Role Type: Permanent

Location: Birmingham (Hybrid)

Role Overview

As a Lead Data Engineer, you will be responsible for maintaining data infrastructure on Microsoft Azure and leveraging your expertise in Microsoft BI tools and cloud-based technologies to drive their data initiatives. You will play a critical role in the team optimising data infrastructure.

Key Responsibilities

Collaborate with cross-functional teams to achieve common business goals.

Develop and maintain curated business models to support accurate and insightful decision-making.

Utilise SSRS, SSAS, and SSIS to design, develop, and implement robust reporting and analytics solutions.

Conduct complex data analysis to identify trends, patterns, and insights that drive business improvement.

Demonstrate expertise in Azure Synapse and Azure Data Factory/Lakes for data integration, orchestration, and management.

Implement and optimise data pipelines for seamless and efficient data flow within the Azure ecosystem.

Extract data from Dynamics to build and enhance curated business models in Synapse/PowerBI.

Ensure data security, compliance, and best practices are followed in Azure cloud environments.

Build migration paths to transition from on-premises technologies to the cloud where appropriate.

Essential Skills

Proven experience as a Lead/Senior Data Engineer.

Expertise in the Microsoft BI stack, including SSRS, SSAS, and SSIS.

Hands-on experience with Azure Synapse, Azure Data Factory, and other Azure cloud services.

Strong analytical and problem-solving skills, with the ability to turn complex data into actionable insights.

Excellent communication and interpersonal skills, with the ability to collaborate effectively with diverse teams.

Demonstrated ability to design and implement curated business models for reporting and analysis.

If you are a skilled Lead/Senior Data Engineer, we would like to hear from you. Apply now!

We are searching for a Data Analyst / GIS Analyst for an extremely exciting technology and data focused business.

The role is offered on a hybrid basis - you will be required to attend meetings and work at the clients Exeter office as and when required. You will therefore need to live within a commutable distance of Exeter to be considered for this position.

Please note, this is NOT a remote role.

Is this position you are responsible for a set of datasets that underpin various digital products and services. You will ensure the quality of these datasets and provide support to the wider business.

You will be identifying and implementing data improvements whilst performing maintenance activities on the datasets - collaborating with colleagues and sharing ideas and experiences in vital to success!

Working as a Data Analyst / GIS Analyst you will need to be inquisitive with a desire to understand and resolve problems. You will also be a strong communicator with the ability to plan, allocate and manage workloads for yourself and other team members.

You will also have the following: -

A qualification in either a GIS or Data related discipline or equivalent professional experience.

Practical experience of working in a data analysis role, a data curation role or a data focused GIS role.

Experience of developing ETL/ELT processes with the ability to follow best data governance practises - you will be problem-solving and finding efficiencies in existing data pipelines using FME Form and FME Flow.

Knowledge and experience of languages such as SQL and Python (or similar) is required.

Practical experience of database technologies such as Oracle, SQL Server or PostgreSQL/GIS is a distinct bonus.

Experience in cloud-based data tooling/storage is a real bonus.

The role comes with the following benefits package: -

25 days holiday, with optional 5 days unpaid leave per year.

Free parking when at office.

Annual lifestyle allowance.

Cycle to Work Scheme

Gym Flex Scheme.

Internal coaching/mentoring system throughout your time here.

Focus on training and career progression.

Family friendly policies.

Flexible working.

Please note, to be considered for this opportunity you MUST have the Right to Work in the UK long-term without company sponsorship.

Please note that due to a high level of applications, we can only respond to applicants whose skills and qualifications are suitable for this position.

No terminology in this advert is intended to discriminate against any of the protected characteristics that fall under the Equality Act 2010.

Bowerford Associates Ltd is acting as an Employment Agency in relation to this vacancy.

Senior/Lead Data Engineer

Aurora Energy Research

Based in Oxford, you will be joining the growing business data team within Internal Technology. Working to the Head of Architecture and Engineering you will take primary ownership of delivering the business data solution with the agreed technology stack, Microsoft Fabric. You will liaise with senior business stakeholders to define functional specifications for business intelligence reports that deliver to agreed technology standards. You will represent these functional specs through Technical Design Authority and take a hands-on role in delivering the required data infrastructure with the rest of the team to enable the reporting insights. As the practice senior you will also be involved in defining processes and practices to ensure they are scalable, secure and robust.

The successful applicant will have a passion for solving business problems with technology and combine exceptional technical data capabilities with great communication skills and understanding of how the business operates.

The successful candidate will work in a creative, intellectually stimulating environment. You will enjoy autonomy, and the opportunity to have a significant impact on Aurora’s data strategy, ensuring that our business intelligence can draw on all our enterprise effectively and meet the needs of this very fast growing, data heavy business.

Key Responsibilities

Work as the data lead within the Architecture and Engineering function to build a centrally managed, governed, data layer to provide insight across our enterprise software systems, including Microsoft Dynamics 365 F&O, Salesforce, SharePoint, SAP SuccesFactors (HRMS), and new systems that are needed as the company grows.

Steer key decisions on how they integrate and how data flows between the systems to ensure we have an extensible, well managed eco-system which enables the business to work efficiently and effectively as it grows and does not obstruct data insights being leveraged cross-system.

Work with internal teams to understand what challenges they face, particularly in their reporting requirements, where technology can have an impact.

Put in place policies and practices to ensure our business data layer is scalable, secure and robust.

Guide junior members of the team in how to deliver technically and effectively.

What we are looking for

Required attributes:

Minimum of 2 years’ experience delivering data solutions to organisations including:

Extraction of data from traditional database systems and online systems via API

Transformation of data to support tactical and broad business insight requirements

Dimensional modelling

Data governance

Demonstrable experience with

Microsoft Fabric

Python/PySpark Notebooks

SQL

SaaS and API based data extraction

Experience in analysing and manipulating numerical and business data; a high level of numerical & analytical competence

Excellent time management, organisational skills and an attention to detail

Strong communication and interpersonal skills

Flexible approach to work, positive, can-do attitude, and a team player

Ability to work independently, to deadlines, managing priorities

Confidence working with varied business stakeholders; excellent interpersonal skills with ability to build relationships at all levels

Delivery oriented and happy to role-up your sleeves to get things done

Exceptional problem-solving skills

A passion for technology and how to use it to solve real problems

Desirable attributes:

Experience with reporting from any of our existing Tier 1 systems

Dynamics 365 Finance and Operations

Salesforce CRM

SAP SuccessFactors

Entra ID

Experience with delivering Direct Lake data architectures with Microsoft Fabric

Experience with utilising CI/CD patterns and DevOps tooling to orchestrate configuration across environments

Experience working with Power BI including Power Query and DAX

Experience working with Logic Apps

Experience with Power Platform

What we offer

Some of the benefits we include are:

Private Medical Insurance

Dental Insurance

Parental Support

Salary-Exchange Pension

Employee Assistance Programme (EAP)

Local Oxford Discounts

Cycle-to-work Scheme

Flu Jabs

At AER, we are committed to offering flexibility in the way we work. Most of our roles are hybrid with a mix of in-office/home working and potentially adjustable working hours. Let’s discuss what works for you and AER during the interview process.

The Company is committed to the principle that no employee or job applicant shall receive unfavourable treatment on grounds of age, disability, gender reassignment, race, religion or belief, sex, sexual orientation, marriage or civil partnership, pregnancy, and maternity.

To apply, please submit your Résumé / CV, a personal summary, your salary expectations and please inform us of your notice period.

BI Developer & Report Writer

Surrey County Council

This role has a starting salary of 33,552 per annum, based on a 36 hour working week.

We’re looking for a talented and detail-oriented BI Developer and Report Writer to join Surrey Adult Learning. If you’re passionate about transforming data into actionable insights and want to make a difference in adult education, this is the role for you.

The team is based at the Woking Adult Learning Centre but there is the option to work flexibly from another location or home for part of the week.

Rewards and Benefits

26 days’ holiday (prorated for part time staff), rising to 28 days after 2 years’ service and 31 days after 5 years’ service

Option to buy up to 10 days of additional annual leave

An extensive Employee Assistance Programme (EAP) to support health and wellbeing

Up to 5 days of carer’s leave per year

Paternity, adoption and dependents leave

A generous local government salary related pension

Lifestyle discounts including gym, travel, shopping and many more

2 paid volunteering days per year

Learning and development hub where you can access a wealth of resources

About the Team

Surrey Adult Learning is a leading provider of diverse daytime, evening and Saturday courses and learning opportunities for adults. We offer a wide range of qualification courses, including English for Speakers of Other Languages (ESOL), maths and digital skills. Our courses also cater to individuals with learning disabilities, mental health conditions and parents/carers seeking to upskill to support their children. Additionally, we provide courses for personal development in various subjects such as arts and crafts, languages and exercise. Our outreach provision is designed to assist those currently facing life challenges.

About the Role

You will play an important role in providing high quality, accurate and accessible management information to support strategic and operational planning and decision making. You will be responsible for the development of a monthly reporting pack for the senior management team, supporting the Business Finance and IT manager to ensure the service meets reporting obligations attached to Government funding and design and implement new reporting and business intelligence solutions for the service. You will also assist in the collation and analysis of learner data to monitor KPIs and inform marketing needs.

Shortlisting Criteria

To be considered for shortlisting for this position, your application will clearly evidence the following:

Prior experience working with the SQL Server technology stack for the interpretation and analysis of large and highly complex data sets.

In-depth knowledge and experience using SSRS, SSDT and MS Report Builder

Proven analytical skills including presenting data to non-technical staff.

Excellent written and verbal communication skills with the ability to analyse large, highly complex data and to communicate trends and key observations therein using clear, simple terms to a variety of audiences.

Knowledge and experience working with ODBC, XML, HTML, REST APIs and web-based data dashboard technologies.

Awareness of the principles of information governance; data security and the GDPR.

We are committed to safeguarding and promoting the welfare of our learners and expect all staff to share this commitment. A DBS ‘Disclosure and Barring Service’ check is required for this role and will be discussed further at interview. Online searches may be carried out on applicants who are shortlisted for interview.

The job advert closes at 23:59 on 9th October 2025 with interviews to follow.

Local Government Reorganisation

Surrey County Council is preparing for Local Government Reorganisation which will allow us to implement the Government led policy of devolution, which is all about giving more powers to local areas.

Currently, Surrey has a two-tier council system, with 11 district and borough councils and a county council, all responsible for different services. All these councils will be reorganised into a smaller number of new unitary councils which will come into effect in April 2027. At this point, this role will be transferred, with all existing terms and conditions intact into one of the new unitary councils.

Join our dynamic team and shape the future of local government. Make a lasting impact with innovative solutions and improved services for our community. Help us build a brighter future for our residents!

Our Commitment

Surrey County Council is proud to be a Disability Confident Employer. A guaranteed interview will be offered to all disabled applicants where:

The candidate has evidenced the minimum criteria for the role through their application

The candidate has chosen to share that they have a disability on the application form

Our application form and onboarding process will provide an opportunity to request any reasonable adjustments for the interview and/or the role. We want to be an inclusive and diverse employer reflecting the community we serve and particularly welcome applications from all underrepresented groups.

Snowflake Data Engineer

Location: Remote (Mostly remote with some occasional travel to Hemel Hempstead)

Contract: Outside IR35

Day rate: Up to £550 per day

Duration: 6 months

Start date: ASAP

Key skills: Snowflake, DBT, SQL, Python, AWS and Kimball

The Client who are in the process of migrating to SnowFlake therefore require extra support. As a result, they require someone from a strong SQL & Python development background with excellent working knowledge of Data Build Tool (DBT).

You will be undertaking aspects of the development lifecycle and be experienced in data modeling, process design, development, and testing. And whilst this company is going through a large-scale migration, this will present you with an opportunity to be at the cutting edge of data engineering.

YOUR SKILLS AND EXPERIENCE

A successful Senior Data Engineer here will have experience in the following:

Advanced SQL knowledge

SnowFlake (ideally certified)

Python development

AWS cloud experience essential, relating to data tooling and development

Working knowledge of Data Build Tool (DBT).

o Develop staging, intermediate and marts in DBT to achieve analytics requirements

o Optimize existing models to make it more reusable by following DBT best practices

o Spot opportunities for the models to be incremental over full refresh

o Organize sources and document sources in DBT

o Develop DBT macros for most frequently repeated tasks

Knowledge of Continuous Integration and Continuous Deployment (CI/CD)

Development experience in one or more object-oriented programming languages (e.g. Python)

Ability to work with senior stakeholders across multiple verticals

Data Analyst (Power BI, Azure) - Near Edinburgh Hybrid

Having placed a number of people into their teams ourselves, Lorien’s long standing client based near Edinburgh - a leader in their industry with a growing and consistently award-winning product line - have asked us to help them in their searches for a Data Analyst to join their team on a permanent basis.

This key individual will take in information from a variety of sources, and help to translate this in order to identify product efficacy, performance, areas for improvement and wider business intelligence to direct the teams’ next steps.

What’s more, the products you’ll work on improve the lives of millions of people across the globe, and so this is truly a rewarding opportunity, and everyone in the team feels part of that journey.

Here’s a snapshot of the duties involved:

Developing/maintaining metrics & reporting, analysing data and relaying relevant information collected

Modernising the business’ reporting processes and implementing automation to reduce manual reliance wherever possible while monitoring, auditing and improving data quality

Offering Power BI training to internal users and supporting any issues which may arise

Liaise with relevant stakeholders to gather business requirements, prioritise their places in the queue, craft relevant solutions and train them on how to use them

Collaborate with the wider IT function to ensure reports are in line with necessary data infrastructure in place from Databases to Data Lakes/Factory/and more

The kind of skills they’re looking for:

Strong Power BI skills with the ability to train others to use it who may be less familiar

Programming with Python and/or R

Excel (ideally VBA)

Background involving as many of the following as possible:

SQL

Azure (Key Vault/Data Factory/Data Lakes)

Power Apps

CRMs (ideally D365)

Ideally existing/ eagerness to gain knowledge across Machine Learning/NLP

Solid analytical mindset as well as communication skills to be able to work with people at all levels

Ability to work as part of a team, sharing knowledge and using your expertise to help others and improve current and future offerings

If you like what you’ve read so far, apply now with your latest CV for immediate consideration and let’s have a chat!

Carbon60, Lorien & SRG - The Impellam Group STEM Portfolio are acting as an Employment Business in relation to this vacancy.

Data Analyst

Tenth Revolution Group

Data Analyst - Manchester - Hybrid Working - Up to 47,000

A leading public sector organisation is seeking a Transport Modelling & Data Analytics Analyst to join a dynamic team shaping the future of transport across the North of England. This role sits within a specialist technical function focused on data analytics, modelling, and economic planning, supporting nationally significant programmes and regional investment strategies.

As part of a multi-disciplinary team, you’ll contribute to the development and application of transport models, undertake geo-spatial and statistical analysis, and support evidence-based decision-making. You’ll play a key role in delivering analytical services to support strategic transport planning, including the Department for Transport’s Integrated Rail Plan.

Responsibilities:

Deliver technical services and manage analytical workstreams to meet stakeholder needs.

Develop and apply strategic transport models, including variable demand modelling.

Conduct statistical modelling, trend analysis, and bespoke data analytics.

Analyse survey data and integrate diverse datasets to generate actionable insights.

Use GIS software for spatial analysis and visualisation.

Create repeatable scripting and batching processes to streamline data workflows.

Produce high-quality reports and deliver technical presentations.

Collaborate with internal teams and external partners across government and local authorities.

Monitor project-specific budgets and ensure compliance with organisational policies.

Requirements:

Proven experience in developing and applying transport models in line with industry guidance.

Strong statistical modelling and data analysis capabilities.

Proficiency in GIS software and scripting languages (e.g., Python, R).

Ability to work with noisy or complex datasets and conduct trend-based analysis.

Skilled in survey data interpretation and geographic data integration.

Experience in managing projects and prioritising workloads effectively.

Excellent communication skills, with the ability to present complex findings clearly.

Strong stakeholder engagement, including working with senior/executive-level contacts.

Please Note: This is a permanent role for UK residents only. This role does not offer Sponsorship. You must have the right to work in the UK with no restrictions. Some of our roles may be subject to successful background checks including a DBS and Credit Check.

Contact me: (url removed)

Databricks Data Engineer - Newcastle (hybrid) - £450/pd

Tenth Revolution Group

Databricks Data Engineer - Newcastle (hybrid) - 450/pd

Please note - this role will require you to attend the Newcastle-upon-tyne based office 2-3 days per week. To be eligible for this role you must have the unrestricted right to work in the UK - this organisation is not able to offer sponsorship.

A leading construction organisation is seeking an experienced Azure Databricks Data Engineer to support the ongoing development and optimisation of their cloud data platform.

Key Responsibilities:

Enhance and scale the existing Azure Databricks environment.

Collaborate with data architects and analysts to deliver robust data pipelines.

Implement best practices for data engineering, performance tuning, and security.

Work closely with stakeholders to understand data requirements and deliver solutions.

Required experience:

Strong hands-on experience with Azure Databricks and Spark.

Solid understanding of Azure Data Lake, Data Factory, and Synapse.

Proven track record in building scalable data pipelines and ETL processes.

Experience working in hybrid environments and cross-functional teams.

Logistical Info:

Fast-paced, high-impact project within a major enterprise.

Flexible hybrid working (2-3 days onsite in Newcastle).

Competitive day rate outside IR35.

Quick turnaround - interviews this week, start ASAP.

To apply for this role please submit your CV or contact David Airey on (phone number removed) or at (url removed).

Tenth Revolution Group are the go-to recruiter for Data & AI roles in the UK offering more opportunities across the country than any other recruitment agency. We’re the proud sponsor and supporter of SQLBits, Power Platform World Tour, and the London Fabric User Group. We are the global leaders in Data & AI recruitment.

Flight Data Analyst

CBSbutler Holdings Limited trading as CBSbutler

Role Title: Flight Data Analyst

Rate: 170 per day inside ir35

Duration: 2 years

Location: RAF Brize Norton, Oxfordshire

On site 5 days/Shift pattern (weekends, evenings, and bank holidays) remote work is not possible for this role

Job Description:

Support A400M maintenance by capturing and transferring maintenance information into the Maintenance Data System (MDS) generated by Part 145 during missions. This includes the period before aircraft departure until its return to the base, with weekly reports produced and sent to Part 145 to ensure all maintenance activities meet airworthiness standards.

Key Responsibilities:

Enter retrospective data on MDS, including:

Closing work orders

Entering SRPs date and time as signed off by engineers

Creating and closing logbook entries

Opening ADFs and/or OOPs

Inputting flight ground test data

Deferring logbook entry work orders

Introducing servicing reports into MDS system

Performing equipment transactions

Send weekly reports to Part 145 with the maintenance plan

Support essential maintenance activities for live flight events, including on-call responsibilities during evenings, weekends, and bank holidays, in a 24/7 rolling rota.

Essential Skills and Qualifications

Proficient in Microsoft Office

Methodical attention to detail

Teamwork skills

Ability to work under pressure

Quick learner

Administrative/technical background desirable

Must hold a driving license

Good report writing skills

Desirable Skills and Qualifications

Experience with MDS

Aircraft maintenance experience, including Part 145 and Part M, is advantageous

Experience with information or data management software tools

Training Provided

Comprehensive training will be provided on the use of the Maintenance Data System (MDS)

On-the-job training and shadowing experienced team members

We re looking for a Data Engineer with strong Python skills and experience in event-driven systems to join our growing data team. This isn t your typical pipelines-for-analysts role -you ll be building real-time systems that power applications, tooling, and commercial products across the business.

What you ll be doing:

-Build and maintain event-driven data pipelines that power Citywire s Catalyst platform.

-Design resilient, fault-tolerant workflows using AWS services such as Lambda, Kinesis, SQS, DynamoDB Streams, and EventBridge.

-Implement processors that ensure data consistency across DynamoDB, PostgreSQL (Aurora), OpenSearch, and BigQuery.

-Modernise legacy batch processes into stream-first architectures.

-Build and integrate APIs to enable smooth publishing and consumption of events across systems.

-Collaborate with engineers on greenfield and existing projects, balancing speed with resilience.

-Take ownership of key pipelines and services, ensuring reliability, performance, and scalability.

-Share best practices and mentor others in event-driven data engineering.

What we re looking for:

-Technical Skills: Proven experience in data engineering or backend development, with solid Python skills and hands-on use of AWS event-driven services.

-Event-Driven Knowledge: Understanding of DLQs, retries, buffering, idempotency, and resilient design patterns.

-Cloud & CI/CD Experience: Familiarity with Terraform, Git-based workflows, and cloud-native deployments.

-Database Skills: Experience with SQL and NoSQL databases such as PostgreSQL, DynamoDB, or OpenSearch.

-Problem-Solver: Comfortable working in Linux environments and confident debugging logs, scripts, and production issues.

-Additional Skills: Exposure to Kafka, Spark, or dbt Core, with an interest in domain-driven data contracts.

Meet Citywire

We cover - and connect - all sides of the $100 trillion global asset management industry - through our news, events and insights.

At Citywire, we uphold a culture rooted in honesty, integrity, and fairness, where every voice is valued and heard. Our culture promotes constructive dialogue and collaboration on a global scale.

Join the team at the Heart of Wealth.

Our perks:

-Generous holiday entitlement: Start with 25 days per annum, increasing to 28 days after three years’ service, and 30 days after five years’ service, in addition to bank holidays.

-Flexible working options.

-£480 annual allowance for well-being activities or gym memberships, with assistance available for monthly or annual costs.

-Eye-test and glasses allowance.

-Competitive private pension scheme.

-Critical illness cover and group life assurance from day one of employment.

-Well-being support: Access to an independent Employee Assistance Programme, available 24/7.

-Cycle to work scheme and annual travel card loans.

-Techscheme: Purchase the latest tech through our employer scheme, spreading the cost over 12 months with National Insurance savings.

-After two years of continuous service, access group income protection, private medical, and dental insurance.

Citywire is an equal opportunities employer.

Page 18 of 25

Frequently asked questions

What qualifications do I need to become a Data Engineer?

Typically, a Data Engineer should have a strong background in computer science or related fields, proficiency in programming languages like Python or Java, and experience with data warehousing, ETL processes, and big data technologies such as Hadoop or Spark.

What types of Data Engineer jobs can I find on Haystack?

Haystack features a wide range of Data Engineer positions, including roles in startups, large enterprises, and remote opportunities. You can find jobs specializing in cloud data engineering, real-time data processing, data pipeline development, and more.

How can I improve my chances of getting hired as a Data Engineer?

To improve your chances, tailor your resume to highlight relevant skills and projects, gain hands-on experience with popular data tools, contribute to open-source projects, and stay updated with the latest trends in data engineering.

Are entry-level Data Engineer jobs available on Haystack?

Yes, Haystack lists entry-level Data Engineer roles suitable for recent graduates or professionals transitioning into data engineering, as well as internships and junior positions to help you start your career.

Can I find remote Data Engineer positions on Haystack?

Absolutely. Haystack offers many remote and flexible Data Engineer job listings to suit your preferred working style and location.

Terms

Feedback

Contact

Careers