Make yourself visible and let companies apply to you.
Role title
Roles
Apache Kafka Jobs
Trending Apache Kafka jobs
Get notified about new jobs that match this search?
Data Engineer - HealthTech
Chapman Tate Associates
Manchester
Hybrid
Mid - Senior
£500/day - £550/day
RECENTLY POSTED

Job Title: Data Engineer (HealthTech) Location: Manchester (Hybrid/Remote options available) Day Rate: £500–£550 per day (Outside IR35) Contract Length: 6 months initial (extensions likely) Overview Chapman Tate Associates are seeking an experienced Contract Data Engineer to join an innovative HealthTech organisation delivering data-driven solutions that improve patient outcomes and healthcare services. This is an exciting opportunity to work on meaningful projects, building scalable data platforms that support clinical insights, product development, and operational efficiency. Key Responsibilities \* Design, build, and maintain robust data pipelines and ETL/ELT processes \* Integrate data from a variety of sources including clinical systems, APIs, and third-party providers \* Collaborate with data scientists, analysts, and product teams to deliver high-quality datasets \* Ensure data quality, security, and compliance with healthcare regulations (e.g. GDPR) \* Support the development of data platforms in cloud environments \* Optimise data workflows for performance, scalability, and reliability Required Skills & Experience \* Proven experience as a Data Engineer in a fast-paced environment (HealthTech, MedTech, or related sectors preferred) \* Strong SQL and Python (or similar programming languages) \* Hands-on experience with modern data platforms (e.g. Snowflake, Databricks, BigQuery, Redshift) \* Experience working with cloud technologies (AWS, Azure, or GCP) \* Solid understanding of data modelling, warehousing, and pipeline development \* Experience handling sensitive or regulated data Desirable Experience \* Experience working with healthcare data standards (e.g. FHIR, HL7) \* Exposure to real-time data processing or streaming tools (e.g. Kafka) \* Familiarity with data governance, security, and compliance frameworks in healthcare \* Experience supporting analytics or machine learning workloads Apply Now If you’re a contract Data Engineer looking to work on meaningful HealthTech projects, apply now with your latest CV

Data Engineer (Banking Experience)
Chapman Tate Associates
London
Hybrid
Mid - Senior
£500/day - £600/day
RECENTLY POSTED

Job Title: Contract Data Engineer (Banking Experience Required) Location: London (Hybrid) Day Rate: £550–£600 per day (Outside IR35 – subject to assessment) Contract Length: 6 months initial (extensions likely) Overview Chapman Tate are looking for an experienced Contract Data Engineer with a strong background in banking or financial services to support a range of high-priority data initiatives. You will play a key role in delivering scalable data solutions, enabling regulatory reporting, and improving data architecture across the organisation. Key Responsibilities \* Design, build, and optimise scalable data pipelines and ETL/ELT processes \* Integrate and transform large volumes of financial data from multiple sources \* Work closely with stakeholders across technology, risk, and business teams \* Ensure high standards of data quality, governance, and compliance \* Contribute to data platform enhancements and cloud migration projects \* Troubleshoot and resolve data-related issues in a fast-paced environment Required Skills & Experience \* Proven track record as a Data Engineer within banking or financial services (essential) \* Strong SQL and Python (or equivalent) development skills \* Hands-on experience with modern data platforms (e.g. Snowflake, Databricks, Redshift, BigQuery) \* Cloud experience (AWS, Azure, or GCP) \* Solid understanding of data modelling, warehousing, and pipeline design \* Experience supporting regulatory or risk-related data workflows Desirable Experience \* Exposure to real-time/streaming technologies (e.g. Kafka) \* Experience in large-scale data transformation or migration programmes \* Familiarity with CI/CD, DataOps, or DevOps practices If you’re a contract Data Engineer with banking experience available in the next two weeks, please apply with your latest CV

Lead Integration Engineer & Developer
Ashdown Group
Liverpool
Hybrid
Senior
£100,000
RECENTLY POSTED
+6

A fast-growing Legal and Financial Services company based in Liverpool is requires a hands-on Lead Integration Engineer & Developer to take ownership of their growing integration platform connecting core internal systems with external partners and services. This is a high-impact role combining deep technical delivery with architectural leadership. Youll spend a significant portion of your time building production systems, while also shaping the future of their integration ecosystem.

The platform is built around HubSpot and a modern event-driven architecture in AWS, and youll play a key role in defining how they design APIs, process events, and scale integrations across the business.

The role is paying £90,000-£100,000 plus good benefits and is a hybrid role (3 days in the office 2 working from home), but with attendance in the central Liverpool office encouraged given the nature of the role and the team management aspect.

Technology Environment

Core Stack

  • AWS (Lambda, API Gateway, EventBridge, SQS, SNS)
  • Node.js / TypeScript and Python

Data & Infrastructure

  • DynamoDB, RDS
  • Infrastructure as Code (Terraform, CDK, CloudFormation)
  • CloudWatch and observability tooling

Integrations

  • HubSpot (CRM)
  • Internal microservices and external APIs

Required Experience

  • Significant experience in backend or platform engineering
  • Strong hands-on AWS experience (serverless preferred)
  • Proven experience with distributed, event-driven systems
  • Experience integrating with third-party APIs
  • End-to-end ownership of systems (design/build/operate)

Technical Expertise

  • Event-driven architecture (EventBridge, SQS, SNS, Kafka)
  • Reliability patterns (retries, idempotency, DLQs)
  • Observability and debugging in distributed systems
  • Data modelling and schema evolution

Leadership & Collaboration

  • Ability to lead technical design and influence architecture
  • Experience mentoring engineers
  • Strong communication across technical and non-technical teams
  • Comfortable in a fast-paced, evolving environment

Desirable

  • Experience with HubSpot or CRM integrations
  • Ownership of internal integration platforms
  • High-volume event ingestion or real-time pipelines
  • Containerisation (Docker, ECS, Kubernetes)
  • Observability tools (Datadog, OpenTelemetry)
Graduate Software Engineer
Spectrum It Recruitment Limited
City of London
Hybrid
Graduate
£50,000
RECENTLY POSTED
+2

We're working with a forward-thinking technology company looking to hire a Graduate / Junior Software Engineer to join their growing team. This is a fantastic opportunity for someone early in their career to gain hands-on experience across a modern infrastructure stack, working on systems that are scalable, secure, and highly available. This is a hybrid role with the requirement to be in the London office 2 days per week. Our client offers good salaries and a comprehensive benefits package. The Role You'll support the reliability and performance of core systems, with responsibilities including: Automating and improving DevOps workflows Monitoring systems and responding to incidents Troubleshooting infrastructure issues and performing root cause analysis Supporting secure, scalable deployments Collaborating with developers to enhance the deployment process Documenting systems and processes About You Strong academic background (Computer Science or similar preferred) - Ideally from Russell Group University Experience with Python or another object-oriented language Good Linux/UNIX knowledge and interest in infrastructure Curious, proactive, and a strong problem solver Able to work both independently and as part of a team Tech Stack Ubuntu, Python, Ansible, Docker, Kubernetes, Kafka, LXC/LXD, Grafana, Prometheus Spectrum IT Recruitment (South) Limited is acting as an Employment Agency in relation to this vacancy. TPBN1\_UKTJ

Lead Java Developer
Meraki Talent
Glasgow
Hybrid
Senior
Private salary
RECENTLY POSTED
+4

Lead Java Developer | 12 month Inside IR35 Contract (Umbrella) | Glasgow Hybrid

Meraki Talent are partnering with a Financial Services business that we have worked with very successfully over the years. They are looking for a Lead Java Developer to join them on a 12 month contract in their Glasgow site.

The role is embedded in a globally distributed team with the remit being the delivery of a new state of the art platforms for a specific business area. The technical stack includes Java, Oracle, Spring, Apache Flink, Apache Kafka, Apache Ignite, Angular

You will proactively influence design whilst also being Development Lead, promoting the highest software development standards.

Experience

  • Extensive Java experience in a complex software development environment.
  • Spring Framework experience.
  • Specialisation in any of the following: messaging middleware, databases, such as Oracle, Flink, Ignite, Kafka, or Kubernetes.
  • SDLC Automation tools such as Jira, Bitbucket, Artifactory, or Jenkins.
  • Experience working in a global team, aiding others through pair programming and knowledge sharing to help the team improve their development practices.
  • Coaching and mentoring experience.

Please note: You must be able to commit to onsite working in Glasgow. This is a Hybrid role which is 50/50 onsite and remote.

Senior Software Engineer - (Java / AWS)
Ocho
Belfast
Hybrid
Senior
£70,000 - £70,000
+7

Senior Software Engineer - (Java / AWS) Belfast | Hybrid | Full-Time At a glance Senior backend role with real ownership Java and Kotlin microservices in a cloud native environment Hybrid working in Belfast Salary up to £70k plus bonus The Role As a Senior Software Engineer, you'll play a key role in designing, developing and owning modern backend solutions while contributing to the evolution of monolithic systems into cloud-native microservices architecture. You will work closely with the Engineering team across Belfast and the wider global engineering organisation, contributing to large scale distributed systems. This role offers a strong mix of hands-on development, architectural decision making and mentorship. What you will be doing Design, build and deliver high-quality backend solutions Advocate for TDD / BDD and engineering best practice Decompose complex monolith applications into scalable microservices Develop secure, resilient RESTful APIs (security-first mindset) Collaborate with Senior, Staff and Principal Engineers globally Contribute to monitoring, alerting and production stability Participate in on-call rotation Coach and mentor junior engineers Drive engineering standards and continuous improvement What you'll need: 5+ years' backend engineering experience Strong Java or Kotlin expertise Experience building scalable microservices in cloud-native environments REST API development experience Solid understanding of SOLID principles and design patterns Experience with relational databases (e.g. MySQL) CI/CD experience (Jenkins or similar) Experience working in Agile/Scrum teams Strong communication and problem-solving skills Nice to Have Experience with NoSQL (DynamoDB, Elasticsearch, MongoDB) Event-driven architecture (Kafka, RabbitMQ) Infrastructure as Code (Terraform, CloudFormation, SAM) Scripting (Bash) level and above Excellent problem solving and communication skills What's on offer Competitive salary up to £70k plus bonus Generous benefits package Hybrid working with a modern Belfast office Clear progression opportunities within a global engineering function For more information on this opportunity, connect with Neill Ferguson on LinkedIn or submit your CV via the link below. Skills: java kotlin aws senior developer engineer Benefits: Work From Home

Devops Systems Engineer
Matchtech
Wiltshire
Hybrid
Mid - Senior
Private salary
+12

Our client, a prominent entity within the Defence & Security sector, is currently searching for a dedicated and skilled DevOps Systems Engineer (Systems Solutions Engineer) to join their team in Wiltshire.

This is more than a job - it’s a mission. You will be part of a high-impact, collaborative environment, contributing to the vision of designing, delivering, and transforming collective training for the UK forces.

Key Responsibilities:

  • Designing, deploying, and supporting integrated system and application solutions across physical, virtual, and cloud environments through CI/CD pipelines
  • Translating operational and technical requirements into implementable system architectures and solution designs
  • Supporting the deployment, configuration, and integration of systems and applications within development and operational environments
  • Ensuring system solutions meet performance, reliability, security, and interoperability requirements across platforms and environments
  • Acting as the technical liaison between engineering teams and supply chain partners
  • Reviewing technical proposals and assisting with integration planning
  • Coordinating with engineering and supply chain teams to ensure delivered components and systems meet required technical and operational specifications
  • Supporting system testing, validation, and troubleshooting to ensure successful deployment and operational readiness
  • Collaborating with cross-functional teams including software engineers, network engineers, architects, and programme teams
  • Integrating third-party technologies and vendor solutions into the broader systems architecture
  • Developing and maintaining technical documentation
  • Maintaining awareness of emerging technologies and tools

Job Requirements:

We are looking for individuals who have a mission focus and the enthusiasm and drive to ‘get things done’. You should be able to collaborate effectively with defence organisations. The ideal candidate will possess the following skills and experience:

  • Engineering background with a degree in a relevant discipline or equivalent professional experience
  • Proven experience designing, deploying, and supporting integrated systems and application solutions across hybrid environments (cloud and on-premise)
  • Strong understanding of systems integration principles across software, infrastructure, and networking layers
  • Ability to translate operational and technical requirements into practical system architectures and deployment plans
  • Experience supporting technical deployments within structured delivery environments (e.g. Agile or SAFe)
  • Strong analytical and problem-solving capability with experience diagnosing complex system issues
  • Understanding of system security principles and governance requirements
  • Experience designing and deploying containerised solutions using orchestration technologies (e.g. Docker, Kubernetes)
  • Experience implementing CI/CD pipelines and DevOps tooling (e.g. GitHub, ArgoCD, Helm, Maven, SonarQube, Quay or equivalent)
  • Experience using monitoring and observability platforms (e.g. Prometheus, Fluentd, ELK stack, Grafana)
  • Experience integrating and supporting database solutions (e.g. MongoDB, PostgreSQL, MSSQL)
  • Experience deploying and operating systems within cloud platforms such as Azure or AWS
  • Experience supporting system testing, validation, and troubleshooting during deployment and operational phases

Desirable Skills and Experience:

  • Experience working with Red Hat OpenShift and Ceph storage platforms
  • Programming experience (e.g. Python, JavaScript)
  • Experience working with event streaming and data pipeline technologies (e.g. Kafka, Apache NiFi, Apache Spark)
  • Experience delivering multi-system integration projects within defence, government, or highly regulated environments
  • Experience implementing and configuring training simulation technologies across Live, Virtual, and Constructive (LVC) environments
  • Experience working with external suppliers and vendors to deliver integrated technical solutions
  • Experience supporting procurement or supply chain teams by translating technical specifications and integration requirements
  • Understanding of interoperability standards or integration frameworks used within enterprise or defence systems

Benefits:

  • Competitive salaries
  • 25 days holiday + statutory public holidays, with an option to buy and sell up to 5 days
  • Contributory Pension Scheme (up to 10.5% company contribution)
  • Company bonus scheme (discretionary)
  • 6 times salary ‘Life Assurance’ with pension
  • Flexible Benefits scheme including Health Cashplan, Dental, and Cycle to Work amongst others
  • Enhanced sick pay
  • Enhanced family friendly policies including enhanced maternity, paternity & shared parental leave
  • Car / Car allowance (dependant on grade/ role)
  • Private Medical Insurance (dependant on grade)

Work Culture:

  • 37hr working week, although hours may vary depending on role or job requirement
  • Early finish on Fridays, starting the weekend at 1.30pm
  • Remote, hybrid, and site-based working opportunities
  • A flexible working culture that is output focussed
  • Up to 5 paid days volunteering each year

If you are a capable and committed DevOps Systems Engineer (Systems Solutions Engineer) looking for a new opportunity to develop your career within the Defence & Security sector, we would love to hear from you. Apply now to join our client’s dynamic and talented team in Wiltshire.

Java Engineer
Profile 29
London
Hybrid
Mid - Senior
£50,000
+6

Salary to £45k + Company Options Scheme Hybrid working between your home, their offices (London Vauxhall) & client sites. NB: Please only apply if you are a UK National and able to achieve SC (ideally DV) clearance i.e. you have at least 5 years residency in the UK with no more than a 3 month break outside the UK. This company is a Workflow & AI Orchestration Specialist. They're on a mission to modernise how public sector organisations manage casework, derive insight from data and deliver citizen services. Theyre growing fast and looking for bright, dynamic people to help build their business. Role Theyre looking for aJava Engineer to join their implementation team. Youll work across Camunda BPMN/DMN process automation, API integration, and microservice orchestration helping their public-sector clients build secure, scalable, and resilient digital services. Youll collaborate with solution architects, business analysts, and designers to translate workflows into elegant, maintainable code. Youll play a key part in defining technical standards, optimising runtime performance, and mentoring less- experienced engineers in workflow-centric delivery. This is an ideal role for someone who enjoys solving complex process problems through clean code, automation, and modern engineering practices. The role involves visiting client sites; the company will cover travel expenses. Frequency is uncertain but candidates should be comfortable with that being 2-3 days per week. Client sites could be anywhere but will most likely be in & around London. Responsibilities Design, develop, and deploy Camunda-based process and decision automation solutions Implement and integrate Java-based microservices, APIs, and connectors within orchestration flows Translate BPMN and DMN models into executable workflows and reusable components Collaborate closely with analysts and service designers to refine and iterate business processes Develop and maintain automated test suites, CI/CD pipelines, and containerised deployments Optimise Camunda engine performance and monitor workflow metrics for production environments Participate in code reviews, peer testing, and technical design discussions Contribute to their internal best-practice frameworks and automation accelerators Essential Eligible (have resided in the UK for the past 5 years) and prepared to go through UK SC Security Clearance Experience in Java software engineering and object-oriented design Spring (Boot) experience Experience with REST APIs, and microservice architectures Knowledge of Docker and Kubernetes for containerisation and orchestration Proficiency in Git, CI/CD pipelines, and automated testing frameworks Understanding of event-driven design and message brokers (e.g. Kafka, RabbitMQ) Good knowledge of security, authentication, and integration patterns for enterprise systems Experience working in agile teams within digital transformation or automation programmes A willingness to learn BPMN and Camunda tooling Some exposure to process automation or microservice orchestration Desirable Experience with Camunda 8 (Zeebe) clusters and Operate/Tasklist components Experience implementing solutions using Camunda 7 or 8 (BPMN/DMN) Familiarity with Camunda connectors, external task workers, and scripting extensions Exposure to cloud platforms (AWS, Azure, GCP) and infrastructure-as-code (Terraform, Helm) Experience integrating process automation with case-management or service-orchestration platforms Understanding of agentic AI capabilities and how they can complement workflow automation Experience mentoring developers or contributing to open-source Camunda extensions Already holding UK security clearance (SC, DV, eDV) Other Stuff NB: Please only apply if you are a UK National and able to achieve SC or DV clearance. i.e. you have at least 5 years residency in the UK with no more than a 3 month break outside the UK. NB: for non-UK Citizens; we cannot accept applications from anyone requiring sponsorship (now or in the future) for UK permanent employment status. If you are utilising a work visa this must allow you to work in the UK unrestricted for at least the next 5 years. Profile 29 recruitment keywords: Java software engineer object-oriented design OOD Camunda BPMN DMN Spring Boot REST API microservice architecture Docker Kubernetes containerisation orchestration Git CI/CD pipelines automated testing frameworks Kafka RabbitMQ Security authentication integration patterns enterprise systems agile digital transformation automation Java developer Camunda developer Zeebe Cloud AWS Azure GCP Terraform Helm process automation agentic AI artificial intelligence security clearance SC DV eDV London home based hybrid junior jnr

Full Stack Software Engineer
Zenovo
Not Specified
Fully remote
Mid - Senior
£80,000 - £90,000

Job Title: Full Stack Software Engineer (Robotic Systems) Salary Expectation: £80,000 - £90,000 (Depending on Experience) Location: UK (Remote) Note: Only candidates with permanent, unrestricted UK working rights will be considered, as visa sponsorship is not offered for this position. Overview: Zenovo is partnering with an innovative company developing advanced autonomous robotic systems to find a Full-Stack Software Engineer. This is a fully remote opportunity within the UK. You will play a key role in building the software that powers intelligent machines and their user experiences, working across web, mobile, HMIs, and internal tools that support system control and operations. This position suits an engineer who enjoys working across the full stack in a fast-paced environment and has a strong interest in autonomy, robotics, and AI. Job Responsibilities: Design and build responsive web and mobile experiences for end users. Develop intuitive interfaces for operators and remote supervision, integrating teleoperation, navigation data, and safety features. Create and maintain dashboards and front-end systems that support operational workflows and data-driven decision-making. Develop and manage scalable backend services, including APIs, databases, and real-time data pipelines. Collaborate with AI and autonomy teams to embed advanced models into user-facing products and tools. Work closely with cross-functional teams and take ownership of features from concept through to deployment. Required Skills & Experience: 5+ Years Full-Stack experience  across modern front-end frameworks (React, Vue, Svelte, etc.) and backend technologies (Node.js, Python/FastAPI, Go, microservices, SQL/NoSQL). A strong portfolio of shipped products demonstrating high-quality UI/UX, performance, and maintainable code (GitHub or demos encouraged). Experience with AI-assisted development tools such as Claude Code, OpenAI Codex, CodeRabbit, Aikido, v0, or similar, along with familiarity using AI-enhanced IDEs (e.g. VS Code with Copilot, Cursor, Antigravity) and an openness to adopting new productivity tools. Experience designing and consuming REST/GraphQL APIs, working with real-time data systems (WebSockets, Kafka, MQTT), and deploying applications to cloud infrastructure. Ability to write clean, testable, and maintainable code within a collaborative environment, with a solid understanding of CI/CD and DevOps practices. Strong problem-solving skills, self-direction, and enthusiasm for learning about robotics, autonomous systems, and heavy equipment domains. To find out more, please apply with your latest CV

Senior Java Developer
Ncounter Limited
London
In office
Senior
£85,000 - £95,000

Senior Java Developers with a passion for cutting-edge technology and a desire to work on a flagship platform rebuild, look no further for your next role! We have an exceptional opportunity with a leading financial services technology vendor based in the heart of London.

As a Senior Java Developer within this team, you will play a crucial role in the next phase of their growth, working on autonomous software at the core of their processes. You will have the opportunity to bring the most cutting-edge technology to their global client pool, with a focus on low-latent messaging solutions and highly available event-driven services.

Must have experience:

  • 5+ years experience in JVM, we use both Kotlin and Java
  • Multi-threading, concurrency and Low-latency experience
  • Exposure to Kotlin as well as Strings, Memory Management and associated problems a plus
  • Automated test experience, Unit testing and Integration testing
  • An understanding of message-driven programming and messaging systems
  • Experience with FIX and Kafka a huge plus

To excel in this role, you will need a minimum of 7 years’ experience in JVM, with proficiency in both Kotlin and Java. Experience in multi-threading, concurrency, and low-latency is essential, as well as exposure to Kotlin, Strings, Memory Management, and associated problems. Automated test experience, including unit testing and integration testing, is also required.

An understanding of message-driven programming and messaging systems, along with experience in FIX and Kafka, would be highly advantageous. If you are ready to take the next step in your career and make a significant impact in the world of financial technology, apply now and join the team.

Java Developer
BrightBox Group
Not Specified
Fully remote
Mid
£500/day - £530/day
+6

Active SC clearance required
Inside IR35
Location: Remote UK

Role Overview
We are seeking a skilled SC Cleared Java Developer to join our team. The ideal candidate will have a strong background in software development, specifically in Java and related technologies. You will be responsible for designing, developing, and maintaining robust applications that meet our business needs while collaborating with cross-functional teams in an agile environment.

Responsibilities

  • Develop and maintain high-quality Java applications using Spring Boot.
  • Design and manage databases, preferably using Postgres or other relational SQL databases.
  • Utilise Docker for containerization and deployment of applications.
  • Implement test-driven development practises using Junit, Mockito, or similar testing libraries.
  • Participate in CI/CD processes using Jenkins or similar pipeline tooling to ensure smooth integration and deployment.
  • Work collaboratively within agile teams, contributing to discussions and decision-making processes.
  • Collaborate with colleagues from various disciplines to deliver comprehensive solutions.

Qualifications
Essential Skills/Experience:

  • Proficiency in Java, particularly with Spring Boot framework.
  • Experience with Postgres or other relational SQL databases.
  • Familiarity with Docker for application deployment.
  • Strong understanding of test-driven development and experience with Junit and Mockito or similar libraries.
  • Experience with CI/CD practises, particularly using Jenkins or similar tools.
  • Ability to work effectively in agile teams and collaborate with cross-functional colleagues.

Desirable Skills:

  • Knowledge of API Specification using Swagger OpenAPI.
  • Experience with Gradle for project management.
  • Familiarity with Liquibase for database version control.
  • Understanding of Kafka for messaging services.
  • Experience with front-end technologies such as React and Typescript.
Data Engineer
Experis
Bath
Hybrid
Mid - Senior
£500/day - £550/day
+1

12 months Bath - x3 days onsite £550 Outside ir35 Active DV clearance (SC Considered) required Role Overview We are seeking an experienced DV (SC Considered) Cleared Data Engineer to support a high‑profile, mission‑critical programme within a secure government environment. The role will focus on designing, building and maintaining robust data pipelines and platforms that support advanced analytics, intelligence, and operational decision‑making. Key Responsibilities Design, build and maintain scalable data pipelines (batch and/or streaming) within secure environments Develop and optimise ETL / ELT processes for high‑volume, structured and semi‑structured datasets Work with stakeholders to translate complex requirements into technical data solutions Ensure data platforms meet security, accreditation, and information assurance standards Support data quality, lineage, monitoring, and performance optimisation Contribute to data architecture and platform evolution, including cloud and on‑prem solutions Collaborate in Agile delivery teams (Scrum / SAFe environments)Required Skills & Experience Proven experience as a Data Engineer in secure or government environments Strong skills in Python, SQL, and data pipeline development Experience with data integration tools (e.g. Airflow, NiFi, Azure Data Factory, AWS Glue, or similar) Hands‑on experience with cloud platforms (AWS, Azure, or GCP - secure tenants preferred) Knowledge of data modelling, data warehousing, and big data technologies Familiarity with DevOps / CI‑CD practices within restricted environments Strong understanding of data security, governance, and access controlsDesirable Experience Experience working within UK defence, intelligence, or national security programmes Exposure to Apache Kafka, Spark, Hadoop, or similar technologies Experience supporting data science or advanced analytics use cases Background working with classified datasets Contract DetailsApply now to be part of this impactful opportunity

Data Engineer (Big Data/ Hadoop/ Spark Dev)
Hays Technology
London
Remote or hybrid
Mid - Senior
£550/day - £700/day
+2

Your new company Working for a renowned financial services organisation Your new role We're looking for a Data Engineer to design and deliver scalable on prem, high‑quality data solutions for low/ high-level data platforms that power analytical and business insights. This is a hands‑on role suited to someone with strong data engineering and big data expertise, ideally gained within financial services. Using , Big Data tools and Spark development you will ensure data quality through automated validation, monitoring, and testing. You will also enable seamless integration across data warehouses and data lakes, contributing to a robust, scalable, and resilient enterprise data ecosystem. What you'll need to succeed Strong Data Engineering expertise with Big Data technologies. Experience designing and building on‑prem data platforms, from high‑level architecture to detailed technical design. Strong Spark development experience. Hands‑on experience with Hadoop - configuring multi‑node Hadoop clusters, including resource management, security, and performance tuning. Strong Big Data engineering background using Apache Airflow, Spark, dbt, Kafka, and Hadoop ecosystem tools. Knowledge of RDBMS systems (PostgreSQL, SQL Server) and familiarity with NoSQL/distributed databases such as MongoDB. Proven delivery of streaming pipelines and real‑time data processing solutions. Delivered streaming pipelines and real‑time data processing solutions. What you'll get in return Flexible working options available. What you need to do now If you're interested in this role, click 'apply now' to forward an up-to-date copy of your CV, or call us now. Hays Specialist Recruitment Limited acts as an employment agency for permanent recruitment and employment business for the supply of temporary workers. By applying for this job you accept the T&C's, Privacy Policy and Disclaimers which can be found at (url removed)

Senior Data Engineer
ISR RECRUITMENT LIMITED
Manchester
Hybrid
Senior
£60,000 - £75,000
+4

\* Leading Digital Transformation Consultancy \* Hybrid-working (Manchester + Home-based) \* c£60,000 to £75,000 per year (DOE) \* Plus an excellent company benefits package (including Private Healthcare, Bonuses, Professional Accreditations and Subscriptions, 25 days Annual Leave + Bank Holidays, etc.) The Opportunity: We are supporting a leading IT Consultancy operating at the forefront of digital services and transformation across the UK public sector are seeking an experienced Senior Data Engineer to play a key role in designing and delivering modern, scalable data platforms that support critical national services. Working within collaborative, multi-disciplinary teams, you will take ownership of end-to-end data engineering delivery across greenfield and transformation initiatives. You will influence technical direction, guide engineering best practice, and support the development of high-quality, robust data services that operate at enterprise scale. You will be consulting across modern cloud ecosystems and data technologies, with opportunities to deepen expertise in Python, SQL, cloud-native data tooling, orchestration platforms and streaming technologies across AWS, Azure and GCP. Skills and Experience: \* Proven experience delivering production-grade data engineering solutions within complex environments \* Strong Python skills for building, testing and operating scalable data pipelines \* Experience working with at least one major cloud platform (AWS, Azure or GCP) \* Strong SQL expertise and experience working with relational databases such as PostgreSQL or Microsoft SQL Server \* Experience working with NoSQL technologies such as DynamoDB, MongoDB or similar \* Hands‑on Kafka (or equivalent streaming) and workflow orchestration (Airflow) experience \* Strong understanding of data architecture patterns including data lakes, warehouses and event-driven architectures \* Experience of consulting across Agile delivery environments, implementing data quality, validation and monitoring frameworks Role and Responsibilities: \* Lead the design, build and delivery of data platforms and services across the full engineering lifecycle \* Own technical delivery of data pipelines, models and platform components, ensuring solutions are robust, scalable and maintainable \* Design, develop and deploy ETL/ELT pipelines to ingest, transform and optimise large-scale datasets \* Build and operate event‑driven architectures (Kafka) and orchestrate workflows (Airflow) \* Apply strong data architecture principles across data lakes, warehouses and event-driven solutions \* Develop and maintain streaming pipelines using technologies such as Kafka \* Implement monitoring and observability solutions using tooling such as Prometheus and Grafana \* Ensure data quality, validation and governance processes are built into engineering workflows \* Act as a trusted technical advisor to clients and stakeholders (client-facing), translating business requirements into robust engineering solutions \* Support delivery planning activities, including estimation, risk identification and dependency management \* Mentor and support other engineers, contributing to a culture of continuous improvement and engineering excellence Applications: Please contact Edward Laing here at ISR to learn more about our client and how they are leading the way in developing the next generation of technical solutions through innovation and transformational technology?

Page 5 of 5