This job is with State Street, an inclusive employer and a member of myGwork – the largest global platform for the LGBTQ+ business community. Please do not contact the recruiter directly.

Job Description

We are looking for a Senior hands-on Data Engineer for Cloud Data Lake design and development. The candidate should have Financial Services experience in design, architecture and development of large scale enterprise applications using Cloud based Data engineering platforms. This hands-on role will partner with senior-level development managers, architects and business leadership to develop and execute the technology product roadmap.

Main Duties and Responsibilities:

• End to end Cloud Data Lake design & development including data ingestion, data modeling and data distribution.

• Build data integrations, hand-offs between on-prem/cloud-based systems.

• Design and develop high volume data ingestion components and solutions to collect data from various sources.

• Manage and use appropriate tools in the cloud data lake development and deployment.

• Responsible for developing/implementing cloud infrastructure to support current and future business needs.

• Participating in technical design, application build, configuration, unit testing, and production deployment.

• Ensuring all cloud solutions exhibit higher level of cost efficiency, performance, security, scalability, and reliability

Required Skills:

• Development experience in designing, developing and deploying complex applications.

• Strong tech skillset/experience in PL/SQL, Java/J2EE, Python, Scala, PERL/scripting .

• Hands on experience with Cloud platforms, preferably using Databricks.

• Experience in building systems using modern, scalable, resilient, cloud native architectures.

• Experience in Data Modeling and database design with strong skills in performance tuning.

• Hands on experience in setting up data pipelines for ELT jobs across multiple data sources.

• Hands on experience in big-data processing, troubleshooting and resolving database performance issues.

• Strong knowledge of Cloud Security in AWS/Azure, specifically IAM Roles & Polices, Security Groups and Encryption keys.

• Experience with optimizing database performance, scalability, ensuring data security and compliance.

• Experience with event based, micro-batch and batched high volume and high velocity transaction and data processing system.

• Proficiency with CICD and DevOps.

Education & Qualifications

Bachelor’s/Master’s Degree in a Computer Science, Engineering or Math or equivalent experience

10+ years’ experience in professional software design and development.

Strong analytical skills, with ability to collect, absorb, and analyze information quickly and independently

Proven ability to develop and work with cross functional processes and project timelines

Excellent follow-through, attention to detail and time management skills

About State Street Across the globe, institutional investors rely on us to help them manage risk, respond to challenges, and drive performance and profitability. We keep our clients at the heart of everything we do, and smart, engaged employees are essential to our continued success.

We are committed to fostering an environment where every employee feels valued and empowered to reach their full potential. As an essential partner in our shared success, you’ll benefit from inclusive development opportunities, flexible work-life support, paid volunteer days, and vibrant employee networks that keep you connected to what matters most. Join us in shaping the future.

As an Equal Opportunity Employer, we consider all qualified applicants for all positions without regard to race, creed, color, religion, national origin, ancestry, ethnicity, age, disability, genetic information, sex, sexual orientation, gender identity or expression, citizenship, marital status, domestic partnership or civil union status, familial status, military and veteran status, and other characteristics protected by applicable law.

Discover more information on jobs at StateStreet.com/careers

Read our CEO Statement

]]>

Job Title: Senior Clean Water Modeller

Salary: £55,000 - £65,000/year

Location: Fully remote

Contract Type: Permanent, Full Time

Hours: 37

About the role

We are looking for an experienced Senior Clean Water Modeller with expertise in InfoWorks WS Pro to support the development and application of clean water distribution models. You will play a key role in strategic planning, operational optimisation, leakage reduction and regulatory compliance across potable water networks.

What you will be responsible for:

• Lead the development, maintenance and calibration of clean water hydraulic models using InfoWorks WS Pro.
• Validate models against telemetry, logger and flow/pressure test data.
• Conduct scenario modelling to assess network performance under normal and stress conditions.
• Support operational teams with real-time and predictive modelling for pressure management and resilience.
• Provide modelling for investment planning, including mains reinforcement, DMA creation and growth impact.
• Simulate water quality parameters such as water age, chlorine decay and booster performance.
• Mentor junior modellers and contribute to modelling standards, QA/QC and workflow automation (Python, SQL).
• Prepare and present reports and visualisations for internal and external stakeholders.

What youll bring to the role:

Essential:

• Understanding of water and wastewater engineering within the UK Water Industry.
• Degree (MEng/BEng/BSc) or HNC in Engineering, Environmental Science or related field.

We are looking for a strong Data Engineering Architect with 1216 years of experience in building and architecting modern data platforms on Microsoft Azure. The ideal candidate will have deep hands-on expertise in Azure Data Factory (ADF) pipeline engineering, SQL performance tuning, and end-to-end data integration architecture, along with a strong analytical mindset to troubleshoot complex data issues. You will lead solution architecture, define best practices, and mentor teams to build scalable, secure, and reliable data solutions.

Key Responsibilities

Azure Data Engineering & Architecture

• Architect and design end-to-end Azure data engineering solutions (batch + near real-time) aligned to enterprise standards.
• Define target state architecture for data ingestion, transformation, orchestration, and serving layers.
• Lead architectural decisions around scalability, resiliency, performance, security, governance, and cost optimization.

Azure Data Factory (ADF) Pipeline Engineering (Core)

• Design, develop, test, and deploy Azure Data Factory pipelines following best practices (modular design, parameterization, reusability, CI/CD readiness).

• Build robust ingestion and orchestration workflows using:

• Linked Services, Datasets, Pipelines, Triggers

• Mapping Data Flows / Wrangling Data Flows (where applicable)

• Integration Runtime strategies (Self-hosted / Azure IR)

Implement operational excellence: logging, alerting, retry patterns, failure handling, and idempotent design.

SQL Development & Optimization

• Develop and optimize SQL queries and stored procedures to support ADF pipeline operations and downstream transformations.
• Conduct query plan analysis and performance tuning (indexes, partitioning strategies, statistics, query rewrites).
• Establish SQL coding standards and reusable patterns for transformation logic.

Troubleshooting & Analytical Problem Solving

• Apply a strong analytical mindset to diagnose and resolve complex data integration issues across ingestion, transformation, orchestration, and storage layers.
• Perform root cause analysis (RCA) for pipeline failures, performance degradation, data quality issues, and environment instability.
• Design proactive monitoring dashboards and alerts for pipeline SLAs and data freshness.

Engineering Standards, DevOps & Governance

• Define and enforce best practices for:

• CI/CD for ADF (Azure DevOps / Git-based workflows)

• Infrastructure-as-Code (ARM/Bicep/Terraformpreferred)

• Version control, code review, release management

Implement data governance patterns: metadata management, lineage, auditing, encryption, RBAC, key management, PII controls.Collaborate with security/compliance teams to ensure enterprise adherence.

Leadership & Stakeholder Management

• Act as a technical leader for data engineering squads; mentor and guide engineers on design patterns and implementation.
• Translate business requirements into technical architecture and delivery plans.
• Work closely with Product Owners, Data Analysts, Data Scientists, and Platform teams to ensure alignment.

Required Skills & Qualifications

Must-Have (Strong)

• 1216 years of overall IT experience with significant data engineering & architecture exposure.

• Strong Azure Cloud Data Engineering and associated services architecture knowledge

• Deep hands-on experience with:

• Azure Data Factory (ADF) pipeline design, orchestration, integration runtime strategy

• SQL advanced querying, stored procedures, performance tuning

Strong troubleshooting skills for complex multi-system data issues.Strong understanding of data architecture concepts:

• Data lakes/lakehouse/warehouse, dimensional modeling, ELT/ETL patterns
• Batch orchestration, dependency management, SCD handling, incremental loads

Azure Ecosystem (Preferred / Good to Have)

• Azure data services experience in one or more:

• Azure Synapse Analytics / Dedicated SQL Pools

• Azure Databricks / Spark

• ADLS Gen2, Azure SQL DB, Managed Instance

• Event Hub / Kafka, Stream Analytics (if real-time involved)

Monitoring & observability:

• Azure Monitor, Log Analytics, Application Insights

Security & identity:

• Azure AD, Managed Identity, Key Vault, RBAC

Engineering Practices

• CI/CD practices for data pipelines; Git branching strategies and release governance.
• Strong documentation skills: architecture diagrams, solution designs, operational runbooks.

Behavioral / Soft Skills

• Excellent analytical thinking and structured problem-solving.
• Strong communication and stakeholder management skills.
• Ownership mindset, ability to drive standards and influence cross-team adoption.
• Proven mentoring/coaching ability.

Education

• Bachelors/Masters degree in Computer Science, Information Systems, or related field (or equivalent experience).

Nice-to-Have Certifications

• Microsoft Certified: Azure Data Engineer Associate
• Microsoft Certified: Azure Solutions Architect Expert
• DP-203 / AZ-305 (or equivalent)

Job Title: Solutions Architect (AI and Automation)
Location: Remote (occasional travel to London required)
Salary: £75,000 - £85,000 (Depending on location)

Would you like to work for an organisation plays a pivotal role in safeguarding and improving the quality of health and social care services across England. My client plays a vital role in improving outcomes across health and social care by using data, technology, and insight to drive meaningful change. With a strong focus on innovation and digital transformation, they are investing in modern cloud platforms, artificial intelligence, and advanced analytics to become a truly intelligence-led regulator.

Solutions Architect Responsibilities

• Design scalable, secure, and ethical AI and data solutions using Microsoft Azure technologies.
• Translate business requirements into end-to-end solution architecture across AI, machine learning, and data platforms.
• Maintain architectural blueprints ensuring interoperability, resilience, governance, and regulatory compliance.
• Lead architecture design reviews and provide technical leadership to delivery teams using Agile, DevOps, and CI/CD practices.
• Mentor technical teams and promote responsible AI practices, including transparency, fairness, and security.

Solutions Architect Requirements

• Extensive experience delivering solutions on the Microsoft Azure Data Platform (Synapse Analytics, Data Lake, Databricks, Azure ML, Power BI).
• Expertise in modern data engineering approaches such as ETL/ELT pipelines, streaming, APIs, and event-driven architecture.
• Experience with cloud-native architectures, microservices, and SaaS integrations.
• Knowledge of data governance, information security, and AI ethics within regulated industries.
• Excellent stakeholder engagement and leadership skills.

We are an equal opportunities employer and welcome applications from all suitably qualified persons regardless of their race, sex, disability, religion/belief, sexual orientation or age.

Senior Data Engineer (Data Modernization)

We are looking for a proactive, goal-oriented Senior Data Engineer to build and scale high-performance big data pipelines. This role is ideal for a collaborative problem-solver who excels in distributed environments and values technical excellence through CI/CD and Agile.

The Essentials

• Modern Modeling: Expert skills in Data Vault Mandatory and Dimensional modeling.
• Cloud & DevOps: Strong AWS experience with a focus on CI/CD and writing secure code.
• Data Governance: Proven ability to embed quality, lineage, and monitoring into every pipeline.
• Leadership: A passion for guiding and coaching fellow team members both technically and procedurally.

The Mission

You will lead data modernization efforts, ensuring large-scale systems remain compliant and secure while maintaining a “right tool for the job” mindset. You’ll bridge the gap between complex data engineering and actionable analytics/ML concepts.

Apply

If you have a passion for building well-governed, scalable systems and want to lead a high-impact team, please apply with your CV

Randstad Technologies is acting as an Employment Business in relation to this vacancy.

We are seeking an experienced AI Engineer to develop and implement innovative AI solutions within the industrial and manufacturing sector. The role focuses on leveraging data analytics to optimise processes and drive efficiency.

Client Details

A well know manufacturing company with a global presence

Description

• Design and develop AI models to optimise manufacturing processes and workflows.
• Collaborate with cross-functional teams to identify and solve key operational challenges using analytics.
• Implement machine learning algorithms and predictive analytics to improve process efficiency.
• Analyse large datasets to extract actionable insights and present findings to stakeholders.
• Monitor and maintain AI models to ensure optimal performance and accuracy over time.
• Contribute to the development of data pipelines and infrastructure to support AI initiatives.
• Ensure compliance with industry standards and best practices in AI and data analytics.
• Document processes, methodologies, and project outcomes for internal knowledge sharing.

Profile

A successful AI Engineer should have:

• Proven experience in developing and implementing AI and machine learning models.
• Proficiency in programming languages such as Python, R, or similar tools.
• Machine Vision experience is beneficial
• Previously worked in manufacturing business with multiple sites

Job Offer

Day rate of (Apply online only) per day (outside IR35)

3 month contract with potential extension

Remote role, with occasional travel to site

Senior Data & Analytics Consultant - Fully Remote - Microsoft partner

60,000 - 70,000 + Bonus and the chance to have shares in the business as they move to an employee owned model.

A well established MS partner who are experiencing growth through a very strong project pipeline are looking to add a Senior Data & Analytics Consultant to their team.

The Senior Data & Analytics Consultant will play a key role in helping their customers turn data into meaningful insight and measurable impact.

In this role, you will design and deliver robust data and analytics solutions that strengthen data foundations, enable AI-driven initiatives, and support better operational and strategic decision-making.

You will design and deliver data solutions within the Microsoft ecosystem, including Azure Data Services, Microsoft Dataverse, Power BI, and Dynamics 365 integrations.

Main Duties and Responsibilities:

Data Strategy & Advisory
Data Governance & Quality
Data Analytics & Insights
Data Management & Warehousing
ETL & Data Integration
Data Architecture & Engineering

Knowledge and Experience

5+ years’ strong experience in data analytics, engineering, or business intelligence
within a consultancy or technology services environment
Proven expertise in data modelling, warehousing, and relational database design
Experience designing and delivering cloud-based data solutions, particularly within
Microsoft Azure
Knowledge of ETL processes and data integration across multiple systems
Experience integrating Microsoft technologies (e.g., Dynamics 365, Azure Data
Services, Power BI) with third-party platforms
Understanding of data governance, security, and compliance principles
Hands-on experience with SQL and one or more data programming languages
Strong understanding of Microsoft Dataverse data structures and integration patterns
Experience delivering complex data projects in customer environments
Experience working with and understanding public sector data, security and
governance

Technical Abilities

Proficiency in Microsoft Power BI, SQL, and Azure Data Services
Experience with data integration tools, APIs, and middleware
Knowledge of ETL tools such as Azure Data Factory, SSIS, or similar
Experience with data warehouses, data lakes, and modern data platforms
Familiarity with advanced analytics or machine learning concepts
Experience with Microsoft Power Platform for process automation
Understanding of statistical analysis, reporting, and visualisation techniques

This role will be fully remote with the occasional travel to client site.

You must be eligible for SC clearance due to the nature of their clients so you will need to be a UK national who includes a minimum of 5 years consecutive UK residency.

Please reach out to me on (phone number removed) or (url removed) to find out more about the Senior Data & Analytics Consultant position and get your application moving!

Ready to start your career as a Data Analyst?

The demand for skilled data professionals in the UK is booming - and organisations are searching for people who can turn raw data into meaningful insight. If you’re looking for a career with purpose and strong growth, our Data Analyst Career Programme is built for you, with a job guarantee on completion.

Why this programme matters

We focus on equipping you with both the tools and the real-world experience you need to hit the ground running. With industry-recognised certifications, live instruction and project work you’ll be ready for business challenges from day one.

What you’ll get:

• Seven training modules, covering Excel, SQL, Python, Tableau, Power BI and more.
• Three official certifications: Microsoft Azure Data Fundamentals, Microsoft Power BI Data Analyst Associate and Microsoft Azure AI Fundamentals.
• Real-world project work to enhance your CV and show our end employers you can deliver.
• Job guarantee: If you complete the programme and don’t receive a job offer, we’ll refund 100% of your course fee.

Your investment:

• Course cost: £2,795
• Payment plan: From £232.91 per month (interest-free)

No prior tech-job experience? No problem.

You don’t need to come from a data background. If you bring curiosity, communication skills, and a willingness to learn, this programme will equip you for a transition into a demanding and rewarding role.

Take the next step now.

Click ‘Apply Now’ and embark on a career where data drives decisions, and you drive your future.

This is a strategic, hands on, standalone role that blends market data vendor management, technical capability, and business engagement.

I need someone with Financial Service experience ideally Wealth Manager, below are the key components of the role

Market Data Vendor Oversight

• Identify and catalogue current market data feeds managed by business teams
• Engage business stakeholders to understand data needs.
• Assess overlapping vendor feeds
• Drive cost savings, synergies, and vendor consolidation where possible.
• Support decommissioning or renegotiation of feeds.

Procurement & Contractual Understanding

• Work closely with procurement teams.
• Understand contract obligations and typical market data vendor operating models.

1. Technical & Data Capability

The role sits in the data department, so the candidate must be technically capable:

• Understand data architecture and how feeds land in Snowflake.
• Ability to run SQL queries, investigate data, and compare feeds.
• Familiarity with concepts like EDP, data lakes, ingestion of PDFs, etc.
• Should be able to use AI/tools to automate comparisons.
• Not reliant on data engineers/analysts for basic tasks.

Data Modeller

Remote- Warwick based business
£40,000 - £45,000

A growing engineering consultancy working within the UK water and utilities sector is looking to hire Junior Hydraulic Modellers to join their expanding team.

This is a great opportunity for someone early in their career to develop their experience in hydraulic modelling and water network analysis, working on projects across regulated utilities.

The Role
As a Junior Hydraulic Modeller, you will support the delivery of hydraulic modelling and analysis across water and wastewater networks, working alongside experienced engineers on a range of infrastructure projects.

Key responsibilities include:
Supporting hydraulic modelling of water and wastewater networks
Developing and maintaining hydraulic models
Analysing network performance and system behaviour
Assisting with data analysis and modelling activities
Supporting project delivery and technical reporting

Requirements
We are keen to speak with candidates who have:
Experience or exposure to hydraulic modelling or water network analysis
A background within water utilities, engineering consultancies, or infrastructure environments
Knowledge of modelling tools such as InfoWorks, EPANET, or similar software
Strong analytical and problem-solving skills

What’s On Offer
Salary of £40,000 - £45,000
Remote working
Opportunity to work on projects within the UK water sector
Strong development opportunities within a growing team

Lead Data Platform Engineer - Databricks - IAC - Terraform - Azure Data Factory - Data Lakehouse

The Data Platform Engineer designs, develops, automates, and maintains secure, scalable, and compliant data platforms that enable the firm to efficiently manage, analyse, and utilise data. The role ensures that data solutions are robust and reliable while meeting regulatory obligations and safeguarding client confidentiality.

Key Responsibilities

• Design and architect scalable, secure, and compliant data platforms and solutions, producing technical documentation and securing approvals through governance bodies such as Architecture Review Boards.
• Build and deliver robust data solutions using Databricks, PySpark, Spark SQL, Azure Data Factory, and Azure services.
• Develop APIs and write efficient Python, PySpark, and SQL code to support data integration, processing, and automation.
• Implement and manage CI/CD pipelines and automated deployments using Azure DevOps to enable reliable releases across environments.
• Develop and maintain infrastructure-as-code (eg, Terraform, ARM) to provision and manage cloud resources, including ADF pipelines, Databricks assets, and Unity Catalog components.
• Monitor, troubleshoot, and optimise data platform performance, reliability, and costs, identifying bottlenecks and recommending improvements.
• Create dashboards and observability tools to report on platform performance, usage, incidents, and operational KPIs.

Knowledge, Skills & Experience

• Degree in Computer Science, Data Engineering, or a related field.
• Proven experience designing and building cloud-based data platforms, ideally within Azure.
• Strong hands-on expertise with Databricks, PySpark, Spark SQL, and Azure Data Factory.
• Solid understanding of Data Lakehouse architecture and modern data platform design.
• Proficiency in Python for data engineering, automation, and data processing.
• Experience developing and integrating REST APIs for data services.
• Strong DevOps experience, including CI/CD, automated testing, and release management for data platforms.
• Experience with Infrastructure as Code tools such as Terraform or ARM templates.
• Knowledge of data modelling, ETL/ELT pipelines, and data warehousing concepts.
• Familiarity with monitoring, logging, and alerting tools (eg, Azure Monitor).

Desirable

• Experience with additional Azure services (eg, Fabric, Azure Functions, Logic Apps).
• Knowledge of cloud cost optimisation for data platforms.
• Understanding of data governance and regulatory compliance (eg, GDPR).
• Experience working in regulated or professional services environments.

We’re looking for an experienced Senior Data Engineer to join a growing team building a modern Microsoft Fabric data platform. This is a hands-on role designing and delivering scalable data pipelines, Lakehouse solutions, and analytics models within the Azure ecosystem.

What You’ll Do:

• Build and maintain ETL/ELT pipelines and data models in Fabric (Data Factory, Notebooks, Spark)
• Write high-performance Spark SQL, T-SQL, Python/PySpark
• Manage ingestion, transformation, and loading from multiple sources
• Translate stakeholder requirements into scalable technical solutions
• Mentor team members and establish engineering standards, security, and governance
• Leverage AI-assisted development tools like GitHub Copilot, ChatGPT, and Fabric Copilot

Essential Experience:

• Microsoft Fabric & Azure Data ecosystem
• Lakehouse architectures & Data Factory
• Python, PySpark, Spark SQL
• Proven hands-on delivery in this stack

What’s on Offer:

• Salary: 70,000
• Excellent benefits & annual leave package
• Strong progression & development opportunities
• Opportunity to work on a modern, AI-enabled data platform
• Real ownership and influence in a growing, forward-thinking data team

If you’re an experienced Data Engineer with solidMicrosoft Fabric and Azure experience, we’d love to hear from you!

PySpark Engineer Lead

As the Technical Lead, you will drive the high-stakes migration of legacy SAS analytics to a modern, cloud-native PySpark ecosystem on AWS. This isn’t just a lift and shift you will refactor complex procedural logic into scalable, production-ready distributed pipelines for a Tier-1 financial services environment.

Core Responsibilities

• Engineering Leadership: Design and develop complex ETL/ELT pipelines and Data Marts using PySpark, EMR, and Glue.
• Legacy Modernisation: Architect the conversion of SAS Base/Macros into modular, testable Python code using SAS2PY and manual refactoring.
• Performance Tuning: Optimise Spark execution (partitioning, shuffling, caching) to ensure cost-efficient processing of massive financial datasets.
• Quality & Governance: Implement rigorous CI/CD, unit testing, and data reconciliation frameworks to ensure “penny-perfect” accuracy.

Technical Stack

• Engine: PySpark (Expert), Python (Clean Code/SOLID principles).
• AWS: EMR, Glue, S3, Athena, IAM, Lambda.
• Data Modeling: SCD Type 2, Fact/Dimension tables, Data Vault/Star Schema.
• Legacy: Proficiency in reading/debugging SAS (Base, Macros, DI Studio).
• DevOps: Git-based workflows, Jenkins/GitLab CI, Terraform.

Randstad Technologies is acting as an Employment Business in relation to this vacancy.

We are looking for a skilled and motivated Business Intelligence Developer to join a data and analytics team. This role is ideal for someone with strong technical expertise in Power BI, Microsoft Business Intelligence tools, SQL, and DAX, who is passionate about transforming data into actionable insights.

As a BI Developer, you will be responsible for developing, maintaining, and enhancing business intelligence systems that support data-driven decision-making across the organisation. You will work closely with stakeholders to understand business requirements and deliver scalable, high-quality reporting and analytics solutions.

Key Responsibilities

• Design, develop, and maintain Business Intelligence solutions and reporting systems.
• Build interactive dashboards and reports using Power BI.
• Develop robust data models to support analytics and reporting requirements.
• Write efficient queries and stored procedures using SQL.
• Develop calculations and measures using DAX to support advanced analytics.
• Integrate data from multiple sources using Microsoft Business Intelligence tools.
• Ensure data accuracy, performance optimisation, and governance of BI solutions.
• Collaborate with business stakeholders to gather requirements and translate them into technical solutions.
• Support and enhance existing BI systems, ensuring reliability and scalability.

Key Skills & Experience

• Proven experience as a Business Intelligence Developer or similar BI/analytics role.
• Strong expertise in Power BI, including dashboard and report development.
• Extensive experience with SQL for querying, transformation, and optimisation.
• Strong knowledge of DAX for building complex calculations and measures.
• Experience with Microsoft Business Intelligence stack (e.g., SSIS, SSAS, SSRS).
• Solid understanding of data modelling, including star and snowflake schemas.
• Ability to translate business requirements into technical BI solutions.
• Strong analytical thinking and problem-solving skills.

Desirable Skills

• Experience working with data warehouses or data lake architectures.
• Knowledge of ETL processes and data integration.
• Experience with Azure data services or cloud-based BI platforms.
• Understanding of data governance and best practices in data management.

Company Overview

We are working with an innovative organisation that recognises the increasing complexity of project delivery. Since 2013, our client has been helping companies of all sizes improve the way projects are delivered.

Their mission is to become the number one provider of innovative project solutions, driven by a community of experienced, caring, and passionate professionals who are committed to improving project delivery.

Why Join Our Client?

Our client is currently in an exciting phase of growth, making this an excellent time to join their journey.

They are building something special-scaling the business while maintaining a strong people-first approach. Investment in their teams is a key priority, creating an environment where development is encouraged and individuals are supported to grow with the organisation.

Their culture sets them apart from other consulting practices, and they are looking to build a team that is equally ambitious.

Position Overview

Our client is seeking a Senior Data Engineer who thrives on building scalable, cloud-first data systems.

In this role, you will design and manage data pipelines that support analytics, AI, and automation across complex infrastructure programmes. Your work will play a key part in enabling data-driven transformation across critical UK industries.

Core Responsibilities

Design, build, and optimise data pipelines using Azure Data Factory, Synapse, and Databricks
Develop and maintain ETL/ELT workflows to ensure high data quality and reliability
Collaborate with analysts and AI engineers to deliver robust and reusable data products
Manage data lakes and warehouses using formats such as Delta Lake and Parquet
Implement best practices for data governance, performance, and security
Continuously evaluate and adopt new technologies to evolve the organisation’s data platform
Provide technical guidance to junior engineers and contribute to team capability building

Technical Stack

Core:

Azure Data Factory
Azure Synapse Analytics
Azure Data Lake Storage Gen2
SQL Server
Databricks

Enhancements:

Python (PySpark, Pandas)
CI/CD (Azure DevOps)
Infrastructure as Code (Terraform, Bicep)
REST APIs
GitHub
ActionsDesirable:

Microsoft Fabric
Delta Live Tables
Power BI dataset automation
DataOps practices

What You’ll Bring

Professional experience in data engineering or cloud data development
Strong understanding of data architecture, APIs, and modern data pipeline design
Hands-on experience within Microsoft’s Azure ecosystem, with an interest in emerging technologies such as Fabric, AI-enhanced ETL, and real-time data streaming
Proven ability to lead technical workstreams and mentor junior team members
A strong alignment with the organisation’s IDEAL values: Integrity, Drive, Empathy, Adaptability, and Loyalty

Ready to Apply?

This is a fantastic opportunity to join a forward-thinking organisation at a key stage of growth, working on impactful projects across critical industries.

If you’re looking to take the next step in your career within a collaborative and innovative environment, we’d love to hear from you

We’re looking for an experienced Senior Data Engineer to join a growing team building a modern Microsoft Fabric data platform. This is a hands-on role designing and delivering scalable data pipelines, Lakehouse solutions, and analytics models within the Azure ecosystem.

What You’ll Do:

Build and maintain ETL/ELT pipelines and data models in Fabric (Data Factory, Notebooks, Spark)

Write high-performance Spark SQL, T-SQL, Python/PySpark

Manage ingestion, transformation, and loading from multiple sources

Translate stakeholder requirements into scalable technical solutions

Mentor team members and establish engineering standards, security, and governance

Leverage AI-assisted development tools like GitHub Copilot, ChatGPT, and Fabric Copilot

Essential Experience:

Microsoft Fabric & Azure Data ecosystem

Lakehouse architectures & Data Factory

Python, PySpark, Spark SQL

Proven hands-on delivery in this stack

What’s on Offer:

Salary: £70,000

Excellent benefits & annual leave package

Strong progression & development opportunities
Opportunity to work on a modern, AI-enabled data platform

Real ownership and influence in a growing, forward-thinking data team

If you’re an experienced Data Engineer with solid Microsoft Fabric and Azure experience, we’d love to hear from you

Your new company Working for a globally renowned financial organisation Your new role We are hiring two Senior Data Engineers to support the ongoing development and modernisation of a large‑scale financial data platform. The environment blends long‑established enterprise systems and legacy components with modern cloud services hosted on AWS. The platform processes high‑volume structured datasets and powers a mix of internal business systems and customer‑facing financial products. A major part of the estate consists of large SQL Server environments; therefore, advanced SQL Server expertise is essential. You will take a leading role in modernising core components, improving platform performance and resilience, and building scalable backend and data services as the platform evolves. This role suits engineers who are confident working across legacy and modern stacks, and who bring strong experience in programming/ designing and delivering robust data services and APIs. What you'll need to succeed Expert‑level SQL Server development and optimisation experience. Experience working in environments with significant legacy components. Strong AWS knowledge (Lambda, Amazon S3, API Gateway; certifications beneficial). Experienced with programming languages such as Python or C#. Background in financial services or data‑heavy platforms with experience with legacy/ modern platforms. Solid mathematical or quantitative background would be beneficial for analytics‑focused work. What you'll get in return Flexible working options available. What you need to do now If you're interested in this role, click 'apply now' to forward an up-to-date copy of your CV, or call us now. Hays Specialist Recruitment Limited acts as an employment agency for permanent recruitment and employment business for the supply of temporary workers. By applying for this job you accept the T&C's, Privacy Policy and Disclaimers which can be found at (url removed)

Your new company Working for a globally renowned financial organisation Your new role We're looking for a Senior Software/ Data Platform Engineer to help evolve a large‑scale financial data platform. The environment includes both long‑standing enterprise systems and modern AWS cloud services. The platform handles high‑volume structured data and supports internal systems and customer‑facing products. A big part of the role involves working with large SQL Server environments, so strong SQL skills are essential. You'll help modernise core systems, improve performance and reliability, and build scalable backend and data services. This role suits engineers who are comfortable working across legacy and modern architectures and who have strong experience designing and building reliable APIs and data services. What you'll need to succeed Great professional experience as a Senior Software/ Data Platform Engineer in financial services. Strong SQL Server expertise (queries, stored procedures, indexing, performance tuning) Experience with large relational datasets Backend development experience in Python or C# Some experience with designing API's Experience working in AWS environments Experience with complex enterprise or legacy systems Strong analytical and problem-solving skillsDesirable: You've modernising legacy systems Building data pipelines or ETL processes Using AI-assisted development tools Experience in financial or market data environments What you'll get in return Flexible working options available. What you need to do now If you're interested in this role, click 'apply now' to forward an up-to-date copy of your CV, or call us now. Hays Specialist Recruitment Limited acts as an employment agency for permanent recruitment and employment business for the supply of temporary workers. By applying for this job you accept the T&C's, Privacy Policy and Disclaimers which can be found at (url removed)

ML & AI Engineer – Python, LLM, RAG, GCP We are seeking a Machine Learning / AI Engineer to help build and deploy production-grade generative AI and LLM systems powering next-generation conversational digital experiences. This role focuses on designing and engineering LLM applications, RAG pipelines and scalable AI infrastructure using Python and Google Cloud (GCP). You will work on cutting-edge agentic AI and conversational AI platforms, building services that support intelligent assistants and automated customer interactions. Key Responsibilities \* Build and deploy LLM-based applications and generative AI solutions \* Develop RAG (Retrieval Augmented Generation) pipelines \* Engineer scalable microservices-based AI platforms \* Design and maintain data pipelines using Python and Spark \* Implement CI/CD pipelines for machine learning and AI systems \* Work with GCP services including Vertex AI, BigQuery, Dataflow, Spanner and Firestore \* Contribute to prompt engineering, LLM evaluation and monitoring \* Build integrations between AI agents and enterprise systems Required Skills \* Strong Python development experience \* Experience building LLM or generative AI applications \* Knowledge of RAG pipelines and prompt engineering \* Experience with microservices architecture and CI/CD \* Hands-on experience with Google Cloud Platform (GCP) \* Familiarity with Spark or large-scale data pipelines Nice to Have \* Experience with LangChain, LangGraph or agentic AI frameworks \* Knowledge of multi-agent architectures or AI orchestration \* Experience building production AI platforms This is an opportunity to work on large-scale AI engineering challenges, delivering production AI systems and intelligent digital assistants using modern LLM, generative AI and cloud-native technologies

DigitalGenius is a venture-backed artificial intelligence company bringing practical applications of deep learning and AI to some of the largest ecommerce customer service operations in the world, as well as high-growth companies. We’re a dedicated team of thoughtful and hard-working people committed to transforming customer service through the application of artificial intelligence. Role The continuous improvement of our products and the range of innovation projects we are committed to require us to scale our Machine Learning team. We are searching for a Machine Learning Engineer to join our core AI Team. This is a highly technical role for an outstanding individual who can take ownership of projects and start new initiatives. As a Machine Learning Engineer at DigitalGenius, you will be responsible for building and improving our Natural Language Processing, Image Recognition, and Recommendation solutions to maximise the product’s performance for our customers. Your time will be divided between improving the core product, researching and developing new ML applications and working closely with our clients. This is an excellent opportunity for those with strong programming capabilities and a deep understanding of AI. We are looking for someone with complementary skills that extend beyond NLP, preferably somebody with experience in ecommerce. The AI team at DigitalGenius owns all ML-related research, implementation and maintenance. In practice, this means keeping up to date with the SOTA research, data analysis, and developing scalable production services and infrastructure. Responsibilities - Proactive approach with team members and clients - Continuous improvement of core AI services - Take ownership of the services within your expertise - Contribute to the ongoing innovation R&D projects - Implement and maintain ML Infrastructure - Requirements - Degree in relevant field with 3+ years of industry experience - Strong Technical Skills: Python, Production APIs, Infrastructure as Code, - AWS or other Cloud provider - Deep understanding of Natural Language Processing / Generative AI / - Image Recognition - Extensive experience with machine learning techniques and algorithms such as supervised and unsupervised learning techniques, predictive modelling and statistics. - Experience with MLOps - Excellent organisation skills, working independently and ability to deliver results for deadlines. - A proactive, innovative, pragmatic approach to problem-solving and an ability to think critically and objectively. - Good customer-facing skills and ability to communicate technical concepts to technical and non-technical audiences. - Experience in ecommerce space Benefits - Competitive Salary - Generous vacation time (25 days of annual leave) - Yearly "Reset Week" in addition to annual leave allowance - Freedom to experiment with your own ideas - Environment to develop your skills without bureaucracy or red tape - Monthly fitness stipend of $210 or fully paid Third Space Membership We are an equal opportunity employer and value diversity at our company. We do not discriminate based on race, religion, colour, national origin, gender, sexual orientation, age, marital status, veteran status, or disability status.

Your new company An established and fast‑growing technology organisation is on a mission to transform digital connectivity across the UK. With a focus on building and operating high‑speed fibre networks, the business is committed to delivering world‑class broadband services to communities and supporting a data‑driven future. You'll be joining a forward‑thinking environment that values innovation, collaboration, and continuous improvement. Your new role As a Senior Data Engineer, you will play a pivotal role in shaping and enhancing the organisation's enterprise data platform. Working within a specialist Data Analytics & AI team, you'll be responsible for designing, building, and maintaining scalable data pipelines and models within Snowflake to support analytics, reporting, and data‑led decision‑making across the business.You will translate data architecture strategies into high‑quality technical solutions, optimise performance and cost, and ensure the data platform is reliable, secure, and well‑structured. This includes developing ELT/ETL pipelines using tools such as dbt and Argo Workflows, implementing data quality and governance practices, and leveraging advanced Snowflake features to drive automation and efficiency.Collaboration is key-you'll work closely with analysts, data consumers, and business stakeholders, enabling them through well‑designed data models and providing technical support where needed. You'll also contribute to monitoring, CI/CD processes, and ongoing improvements to engineering standards across the team. What you'll need to succeed Proven experience delivering cloud‑based data engineering solutions, ideally centred around Snowflake Strong skills in SQL, Python, and dbt for data modelling and transformation Experience with Snowflake RBAC and performance optimisation Familiarity with ingestion/replication tools such as Airbyte, Fivetran, Hevo, or similar Understanding of cloud technologies (AWS preferred) Knowledge of data modelling, governance principles, and best‑practice engineering standards Experience supporting BI/reporting tools such as Power BI Solid grounding in version‑controlled development and CI/CD practices (git)Desirable: Exposure to enterprise systems like Salesforce, BSS/OSS, telephony, or call‑centre data Experience in data platform migrations, data validation, and quality assurance Background in enabling business teams through training, documentation, or adoption support Familiarity with Terraform or Infrastructure‑as‑Code A mindset for continuous learning and staying up to date with modern data stack tooling What you need to do now If you're interested in this role, click 'apply now' to forward an up-to-date copy of your CV, or call us now. If this job isn't quite right for you, but you are looking for a new position, please contact us for a confidential discussion about your career. Hays Specialist Recruitment Limited acts as an employment agency for permanent recruitment and employment business for the supply of temporary workers. By applying for this job you accept the T&C's, Privacy Policy and Disclaimers which can be found at (url removed)