Apache Kafka Jobs

Make yourself visible and let companies apply to you.

Roles

Apache Kafka Jobs

Overview

Discover top Apache Kafka jobs on Haystack, your go-to IT job board for expert roles in data streaming and real-time processing. Explore the latest Apache Kafka developer, engineer, and architect positions to advance your career in this high-demand technology. Start your search now and connect with leading employers looking for skilled Apache Kafka professionals!

Filters applied

Apache Kafka

Salary

Location

Remote preference

Role type

Seniority

Tech stack

Sectors

Contract type

Company size

Visa sponsorship

Technical Architect

Stott & May Professional Search Limited

Are you someone with a passion for transforming legacy systems into modern, scalable solutions? Join us as a Technical Architect and lead the way in redefining banking integration platforms and data warehouses. Based in London, you’ll be at the forefront of innovative architectures, collaborating with top-tier professionals to deliver future-proof, high-performance systems that meet stringent regulatory standards.Required Skills:

Over 10 years of experience in application architecture and design, with deep expertise in .NET/C#, SQL Server, and integration technologies

Proven track record of modernising legacy monolithic systems to microservices or service-oriented architectures

Strong knowledge of containerisation tools such as Docker and Kubernetes

Hands-on experience with cloud platforms like Azure, AWS, and Databricks

Familiarity with messaging protocols (MQ, Kafka), API design, and secure integration patterns

Ability to define observability metrics and guide testing and monitoring efforts

Excellent documentation, communication, and stakeholder engagement skills

Nice to Have Skills:

Experience with regulatory compliance standards such as BCBS239 and DORA

Background in working with near real-time trading platform integrations

Certification in TOGAF, AWS/Azure Architecture, or similar credentials

Preferred Education and Experience:

Bachelor’s degree or higher in Computer Science, Engineering, or a related field

Significant experience leading complex architecture projects within the banking or financial services industry

Other Requirements:

Must be based in the UK, specifically London

Ability to visit client sites once or twice a week

Knowledge of regulatory and compliance requirements in banking preferred

Take the next step in your career and become a pivotal part of a dynamic team that values innovation and technical excellence. Apply now to contribute to cutting-edge banking solutions and shape the future of financial technology!

Java Developer

Hyperloop Recruitment

Senior Java Developer £65,000 (DOE) North East Wales (hybrid)Hyperloop Recruitment are working with a fast-growth tech firm based in North East Wales, looking to bring a Senior Java Developer into their team.Working in a team of specialists, the successful candidate will be responsible for creating new solutions to business problems, creating new products whilst helping build and support our clients’ core software and services.The role would suit a talented Java Developer with at least 5 years’ commercial experience working with AWS and Java-based technologies, looking for an exciting new challenge. You will have broad fundamental knowledge across multiple domains and have the ability to adapt to new technologies if required.Tech stack:

Java 8+

Spring Boot

AWS

Database technologies (PostgreSQL, Redis, Elastic Search)

It would be a bonus if you’ve worked with any of the following:

The role is paying up to £65,000 (DOE) plus benefits and will be a hybrid working model of 2 days p/w in the office (location upon request). The role is commutable from the likes of Birkenhead, Chester, Conwy, Deeside, Llandudno, Runcorn, Warrington, Wirral and Wrexham. To apply, click here!

Postgres Data Architect

Stackstudio Digital Ltd.

Job DetailsRole / Job Title:Postgres Data Architect with CDC SkillsWork Location:250 Bishopsgate, London, UKOffice Presence (Hybrid):2 days per weekThe RolePostgreSQL Data Architect with strong hands-on experience in Change Data Capture (CDC). The candidate will design and implement robust data migration strategies, ensuring seamless integration between legacy systems and modern cloud-based architectures.Responsibilities

Architect CDC Pipelines: Design and optimize Change Data Capture workflows (IBM CDC or equivalent), including subscription design, bookmarks, resync, and replay strategies

Cloud Migration & Hosting: Lead PostgreSQL migration from on-premises/mainframe to cloud platforms (AWS Aurora preferred), ensuring performance, security, and scalability

Integration & ETL Pipelines: Build robust pipelines using CDC Kafka/S3 Aurora with UPSERT/MERGE patterns; guarantee idempotency, ordering, and reliable delivery

Data Encoding & Validation: Manage EBCDIC UTF-8 conversions, packed decimal/binary numeric, and validate transformations with automated test suites

Cutover & Governance: Execute dual-run validations, reconciliation (counts, checksums), rollback strategies, and ensure compliance with masking, encryption, and IAM policies

Performance & Observability: Monitor lag, throughput, and error rates; develop dashboards (CloudWatch/Grafana) and operational runbooks for proactive alerting

Automation & Tooling: Utilize schema conversion tools, IaC (Terraform), CI/CD pipelines (GitLab), and AWS services (Glue, Athena, Redshift) for downstream analytics

Data Modelling & Conversion (Good to have): Transform Db2 schemas to Aurora PostgreSQL; design logical/physical models, enforce referential integrity, and apply best practices for normalization/denormalization

Your ProfileEssential Skills / Knowledge / Experience

Strong hands-on experience with PostgreSQL (Aurora preferred) and advanced data modelling

Expertise in CDC tools (IBM CDC or similar) and data migration strategies

Proven experience in PostgreSQL cloud hosting and migration

Proficiency in ETL/ELT pipelines, Kafka, and AWS ecosystem

Solid understanding of data encoding, transformation, and validation techniques

Familiarity with IaC, CI/CD, and observability frameworks

Excellent problem-solving and communication skills

Desirable Skills / Knowledge / Experience

Mainframe Modernization

Senior Java Engineer (Smart Contract)

Job Title: Senior Java Engineer (Smart Contract) Location: London Contract: 12 MonthsAre you a passionate Senior Java Developer looking to make a significant impact in an innovative environment? Our client is seeking a talented individual to join their dynamic team in London, where you’ll design and develop cutting-edge microservices for a next-generation loans processing application. If you thrive in a fast-paced atmosphere and enjoy collaborating with cross-functional teams, this opportunity is for you!What We’re Looking For:

Strong expertise in Java and Spring/Spring boot.

Hands on Smart Contract (Solidity) experience in essential

Experienced in financial services , Ideally Commercial Lons.

Experience in developing and deploying microservices architectures using Spring Boot, Spring Batch, and Spring Data

In-depth knowledge of REST API principles and HTTP protocols.

Proficiency in Git, CI/CD, and Agile methodologies.

Familiarity with JIRA, JUnit, and Apache Kafka is preferred.

Experience with NoSQL databases such as CosmosDB and MongoDB.

Exposure to Ethereum, Hyperledger Besu, and EVM-based platforms is a plus.

What You’ll Be Doing:

Collaborate with product owners, business analysts, scrum masters, and fellow developers to create robust solutions.

Design, develop, and implement microservices using Java Spring Boot, ensuring modular, testable, and reusable code.

Craft responsive and intuitive user interfaces with Angular and TypeScript/Java to enhance user experience.

Create RESTful APIs (gRPC) to facilitate smooth communication between microservices and external systems.

Conduct regular code reviews, unit testing, and CI to maintain high standards of code quality.

Develop and present high-level design proposals to stakeholders, showcasing your creativity and vision.

Manage project flow, help refine backlogs, and foster a culture of collaboration among team members.

Support your team in overcoming challenges and ensuring alignment with the project’s overall vision.

Why Join Us?

Exciting Projects: Work on impactful projects that shape the future of loans processing.

Collaborative Culture: Be part of a supportive team that values your input and encourages knowledge sharing.

Growth Opportunities: Expand your knowledge and skills in a fast-evolving tech landscape.

If you’re ready to take your career to the next level and make a real difference, we want to hear from you! Apply now and join our client’s team for an exciting journey in the world of microservices and innovative technology.Don’t miss out on this fantastic opportunity!Pontoon is an employment consultancy. We put expertise, energy, and enthusiasm into improving everyone’s chance of being part of the workplace. We respect and appreciate people of all ethnicities, generations, religious beliefs, sexual orientations, gender identities, and more. We do this by showcasing their talents, skills, and unique experience in an inclusive environment that helps them thrive. If you require reasonable adjustments at any stage, please let us know and we will be happy to support you.

Senior Solution Engineer

Stackstudio Digital Ltd.

Senior Solution Engineer Role Details

Role: Senior Solution Engineer

Job Type: Contracting

Location: Manchester (Onsite, hybrid, with a minimum of 2 days in the office)

The Role

If are eager to embark on a journey along with an organization to becoming the best tech, modern luxury, and sustainable mobility company in the world.

The Enterprise API portfolio is here to enable seamless new customer experiences across all our iconic brands. We are scaling our API operations and looking for the best talent to join us as Senior Solution Engineer.

Key Responsibilities

Work closely as part of our teams and provide technical leadership in designing evolvable systems that can scale to meet our customer needs.

Help guide development using JLR API patterns and practices.

As part of the team, you will collaboratively be designing, implementing, and run API technology solutions on our platform.

Drive the strategic alignment of our products with our business models, with radical focus on delivering value to our business.

Ensure quality attributes such as security, reliability, performance, etc. are always under consideration and the trade-offs understood.

Your Profile Key Skills / Knowledge / Experience

Expert experience in Java & Spring Boot and/or similar languages (Go, Java Script).

Expert experience with API First approach and API standards (REST, JSON, patterns & practices, RESTful API design).

Expert experience with API technology (API gateways) and API security (authentication / authorisation / identity providers).

Excellent communication skills and the ability to explain technical subjects on multiple levels.

Experience working in cloud providers such as GCP, AWS, or Azure, and familiarity with CI/CD pipelines and Terraform.

Familiarity with Docker and Kubernetes.

Experience working in a genuine agile environment-Scrum, Kanban, or anything in between.

Worked in a true DevSecOps culture with:

Owning and feeling responsible for your code in production

Inclusion of monitoring and observability with tools such as Prometheus and Grafana

Incident management with tools such as PagerDuty

A deep understanding of enterprise integration patterns and event-driven architecture.

Experience working with messaging systems (RabbitMQ, Kafka, etc.).

Good to Have

Genuine advocate for modern high-quality software engineering practices.

Customer-focused, driven to deliver experiences users will love, and keen to collaborate with product stakeholders across the business.

Resilient, energetic, and enthusiastic, able to deliver results in a complex environment while responding constructively to innovative ideas and inputs.

Comfortable challenging existing thinking in a positive way, while building credibility and trust through experience and personal style, bringing diverse new ways of thinking and perspectives to the team.

Snowflake Data Engineer

Tenth Revolution Group

Senior Snowflake Data Engineer - Hybrid - £85k-£100k About the Role I am looking for an experienced Senior Snowflake Data Engineer to join a dynamic team working on cutting-edge data solutions. This is an exciting opportunity to design, build, and optimise high-performance data pipelines using Snowflake, dbt, and modern engineering practices. If you are passionate about data engineering, test-driven development, and cloud technologies, we’d love to hear from you. Key Responsibilities Design, develop, and optimise scalable data pipelines in Snowflake. Build and maintain dbt models with robust testing and documentation. Apply test-driven development principles for data quality and schema validation. Optimise pipelines to reduce processing time and compute costs. Develop modular, reusable transformations using SQL and Python. Implement CI/CD pipelines and manage deployments via Git. Automate workflows using orchestration tools such as Airflow or dbt Cloud. Configure and optimise Snowflake warehouses for performance and cost efficiency. Required Skills & Experience 7+ years in data engineering roles. 3+ years hands-on experience with Snowflake. 2+ years production experience with DBT (mandatory). Advanced SQL and strong Python programming skills. Experience with Git, CI/CD, and DevOps practices. Familiarity with ETL/ELT tools and cloud platforms (AWS, Azure). Knowledge of Snowflake features such as Snowpipe, streams, tasks, and query optimisation. Preferred Qualifications Snowflake certifications (SnowPro Core or Advanced). Experience with DBT Cloud and custom macros. Exposure to real-time streaming (Kafka, Kinesis). Familiarity with data observability tools and BI integrations (Tableau, Power BI). On offer Opportunity to work with modern data technologies and large-scale architectures. Professional development and certification support. Collaborative, engineering-focused culture. Competitive salary and benefits package. Interested? Apply now with your CV highlighting your Snowflake, DBT and DevOps experience

£40K -60kUK - Fully RemoteExcited by the challenge of working at a fast-moving cybersecurity startup? We’re looking for a Full Stack Engineer to join their team on a fully remote bases in the UK, where you’ll have a real impact working with cutting-edge technology to help organisations tackle security threats in real time. This is a fully remote role with a starting salary between £40k -£60k. For this role you MUST be resident and eligible to work in the UK, unsupported by a visa.What You’ll Do:

Build and scale customer-facing applications that make a difference.

Lead integration projects and develop efficient data workflows.

Solve complex problems involving large datasets and data control.

What We’re Looking For:Tech Stack:

Backend: TypeScript, NestJS, Sequelize ORM, GraphQL, REST APIs, MySQL, NoSQL, Kafka

Frontend: React.js, Next.js, TypeScript, Chakra UI, React Query, GraphQL

Figma (understanding design and business logic)

Ideal Experience:

Strong NestJS and TypeScript skills

Developing full-stack SaaS platforms.

Creating dashboards and working with relational/NoSQL databases.

Strong NestJS and TypeScript skills

Debugging and troubleshooting complex applications.

Bonus Skills:

AWS, Kubernetes, workflow engines (Xstate, Argo Workflows).

Knowledge of networking and infrastructure.

Startup experience and a collaborative mindset.

Why Join?

Work on high-impact projects in an innovative, growing company.

Take ownership and drive real change in the cybersecurity space.

Join a supportive, highly motivated team where your work truly matters.

If you are interested in the above role - Click the ‘Apply Now’ button now for immediate reviewFull Stack Engineer, Full Stack Developer, Full Stack Engineer, Full Stack Developer, Full Stack Engineer, Full Stack Developer,REACT, REACTJS, NESTJS, NEST, TYPESCRIPT, SAAS, REACT.JS, NEXT.JS, NEST.JS, SEQUELIZECircle Recruitment is acting as an Employment Agency in relation to this vacancy. Earn yourself a referral bonus if you refer somebody else who fills the role! We also offer an iPad if you refer a new client to us and we recruit for them. Follow us on Facebook - Circle Recruitment , Twitter - @Circle_Rec and LinkedIn - Circle Recruitment.

Customer Support Engineer - GridOS

Stackstudio Digital Ltd.

Role:Customer Support Engineer - GridOS (Kubernetes + Kafka) Experience with GridOS or other grid data management platforms. Knowledge of utility operations, grid modeling, and distributed energy resource management. Familiarity with real-time data streaming and IoT integration. Key Responsibilities: Design and implement GridOS Data Fabric solutions to streamline data access and management for utilities. Develop data integration pipelines that unify operational (OT), informational (IT), and external data sources (e.g., weather, traffic). Configure and manage metadata catalogs to ensure effective data governance, security, and compliance. Collaborate with business and IT teams to enhance data discovery, quality, and utilization across the enterprise. Support real-time and batch data processing using big data technologies and cloud platforms. Optimize data workflows to enable AI, machine learning, and advanced analytics applications. Provide technical support and troubleshooting for GridOS Data Fabric deployments. Stay up to date with advancements in grid modernization, data management, and energy analytics. Required Qualifications: Bachelor’s or Master’s degree in Computer Science, Data Science, Engineering, or a related field. 3+ years of experience in data management, integration, or analytics for utilities or energy sectors. Strong knowledge of data fabric architectures, metadata management, and data governance principles. Experience with SQL, ETL tools, and big data technologies (e.g., Hadoop, Spark, Kafka). Familiarity with cloud platforms (AWS, Azure, or Google Cloud) and data integration frameworks. Strong problem-solving skills and ability to work in a cross-functional environment.

Data Engineer Location: Hampshire / Hybrid Salary: £40k-60k per annum (DOE) + benefitsWe’re seeking a talented Data Engineer to design, build, and optimize robust analytics pipelines supporting sophisticated, mission-critical systems in the national security sector. You’ll work on real-time and batch data processing, transforming, filtering, and routing complex data streams, and deploying containerized applications to Kubernetes clusters.Key Responsibilities:Develop, maintain, and optimize analytics pipelines using Go or Python .Process streaming and batch data to deliver actionable insights.Deploy containerized applications via Docker , Helm , and CI/CD pipelines.Monitor, troubleshoot, and improve deployed data systems.Break down requirements into actionable tasks in an Agile Scrum team .Follow test-driven development and write secure, maintainable code.Must-have Skills:Go or Python programmingData analytics / real-time processing experienceKubernetes & HelmDocker & container orchestrationAWS (EKS, EC2, S3)Agile development experienceNice-to-have:AI/ML fundamentalsRedis, Rust, or Robot FrameworkMessaging systems (Kafka, NATS, Qpid)Linux networking knowledgeTPBN1_UKTJ

C++ Developer - Linux, Kafka, Cloud, Financial Markets

Client is looking for a Senior C++ Developer to enhance their software platforms. This will be a solution focusing on trade for a wide ranger of financial services.Key skills:

C++

Cloud experience (AWS preferable)

Linux/Unix

Kafka

SQL experience

Contract/London/HybridBy applying to this job you are sending us your CV, which may contain personal information. Please refer to our Privacy Notice to understand how we process this information. In short, in order to supply you with work finding services, we will hold and process your personal data, and only with your express permission we will share this personal data with a client (or a third party working on behalf of the client) by email or by upload to the Client/third parties vendor management system. By giving us permission to send your CV to a client, this constitutes permission to share the personal data that would be necessary to consider your application, interview you (Phone/video/face to face) and if successful hire you. Scope AT acts as an employment agency for Permanent Recruitment and an employment business for the supply of temporary workers. By applying for this job you accept the Terms and Conditions, Data Protection Policy, Privacy Notice and Disclaimers which can be found at our website

Snowflake Senior Developer

Location: London (Hybrid) Employment Type: Full-time Seniority: Senior Individual Contributor Reports to: Data Engineering Lead / ManagerSummary of roleWe are seeking a Snowflake Senior Developer to design, develop, and optimise data solutions on our cloud data platform. You will work closely with data engineers, analysts, and architects to deliver high-quality, scalable data pipelines and models. Strong expertise in Snowflake, ETL/ELT, data modelling, and data warehousing is essential.Responsibilities

Snowflake Development: Build and optimise Snowflake objects (databases, schemas, tables, views, tasks, streams, resource monitors).

ETL/ELT Pipelines: Develop and maintain robust data pipelines using tools like dbt, Airflow, Azure Data Factory, or similar.

Data Modelling: Implement dimensional models (star/snowflake schemas), handle SCDs, and design efficient structures for analytics.

Performance Tuning: Optimise queries, manage clustering, caching, and warehouse sizing for cost and speed.

Data Quality: Implement testing frameworks (dbt tests, Great Expectations) and ensure data accuracy and freshness.

Security & Governance: Apply RBAC, masking policies, and comply with data governance standards.

Collaboration: Work with BI teams to ensure semantic alignment and support self-service analytics.

Documentation: Maintain clear technical documentation for pipelines, models, and processes.

Qualifications

Matric and a Degree in IT

Strong SQL skills (complex queries, performance tuning) and proficiency in Python for data processing.

Experience with ETL/ELT tools (dbt, Airflow, ADF, Informatica, Matillion).

Solid understanding of data warehousing concepts (Kimball, Data Vault, normalization).

Familiarity with cloud platforms (Azure preferred; AWS/GCP acceptable).

Knowledge of data governance, security, and compliance (GDPR).

Excellent problem-solving and communication skills.

Skills

Experience with Snowpark, UDFs, dynamic tables, and external tables.

Exposure to streaming/CDC (Kafka, Fivetran, Debezium).

BI tool integration (Power BI, Tableau, Looker).

Certifications: SnowPro Core or Advanced.

Lead Data Engineer - £70-80k + bonus + benefits - Basingstoke 3 days a weekThe Opportunity: We are looking for a Lead Data Engineer with strong Databricks experience to join a Basingstoke based organisation who are investing heavily in their Digital Transformation Programme.The Role: You’ll play a proactive role in the delivery of next-generation data platforms, will manage / mentor the existing person and drive the design, development and governance of the data pipelines. You’ll be working really closely with stakeholders across the technology function and within the business and will the availability, integrity and compliance of the systems. You’ll play a key role in the ownership of the core architecture / engineering across the new Azure Databricks ecosystem.You’ll ensure that the data platform architecture supports availability and growth targets and that the platforms leverage advances in AI and Machine Learning capability.They are currently working with a 3rd Party Data Partner who have recommended a number of improvements - you’ll work closely with them selecting, implementing and managing technology so it’s a great opportunity to really make a difference.The Person: Key to this is proactivity - they’re really looking for someone who is always looking at “what’s next” - are there new tools or functionality that will help the business move forward. Other key background / attributes include:

In depth experience of modern data solution architecture design and delivery in a hybrid cloud environment but predominantly Azure / Databricks

Experience of pipeline orchestration management

Strong exprerience with Databricks

Experience of implementing machine learning and AI

Tooling such as Purview and Unity Catalog as well as the use of observability tools such as Monte Carlo, Fabric Monitoring and Log Analytics

Mentoring / Leading / Management experience initially with a small team but with a view that this will grow

Ideally skills in Delta Live Tables, Kafka, Azure Stream Analytics, Azure ML, PowerBI and Financial Modelling experience.

London, UK 6 Month ContractAn incredible opportunity for an experienced Senior Go Developer with strong backend engineering skills to join a prestigious tech client on a contract basis. Known for its high bar for engineering quality, this isn’t your typical banking or fintech gig - contractors here are genuinely embedded, involved, and making meaningful impact from day one.As a Senior Go Developer, you’ll play a key role in building mission-critical, data-driven services that power core parts of the platform. You’ll take ownership across the full development lifecycle, from system design and implementation to optimisation and release.You’ll be working in an open, fast-moving environment where ideas get tested quickly and good engineering practices are taken seriously. If you like seeing your work go live within days - not weeks - you’ll fit right in. Contractors are treated as part of the team, contributing to technical decisions, stand-ups, and everything in between.Reporting into an Engineering Manager, you’ll be hands-on with technologies like AWS, Kubernetes, Docker, and Kafka, and will collaborate closely with product and infrastructure teams to ship well-architected, scalable microservices.This is a team that values clean systems, clear thinking, and code that lasts. You’ll have the freedom to shape how things are built and the trust to get on with it - whether that’s improving infrastructure, shipping new features, or quietly refactoring something that needs it.Senior Go Developer - Key Requirements:

Significant professional experience in software development, with a strong focus on backend systems

Proficiency in Go / Golang and proven expertise in AWS, Kubernetes, and Docker

Experience with end-to-end software engineering, including system design and architecture

Hands-on experience working on complex, data-intensive applications

A product-focused mindset and familiarity with working in technology-driven organisations or start-ups

Experience with Kafka, Cassandra, gRPC, and microservices architecture will also be beneficial, as well as experience contributing to open-source projects

If you’re a Senior Go Developer looking for a fast-paced, collaborative contract role where your work will ship quickly and matter to real users - apply now. Our client is ready to move quickly for the right person.We are an equal opportunities employer and welcome applications from all suitably qualified persons regardless of their race, sex, disability, religion/belief, sexual orientation, or age.

Senior Software Engineer

Do you want to be a valued part of the critical infrastructure that serves communities across Europe and beyond? Are you looking for a position in which you can set direction and help shape our company? If so, then you could be the newest addition to our team as a Senior Software Engineer. Be part of the movement - and play your part. About the role In this role, you’ll play a key part in designing, building, and delivering scalable software solutions across a modern technology stack. You’ll collaborate closely with a cross-functional Agile SCRUM team, contribute to architectural decisions, and ensure high-quality engineering practices are upheld. Alongside development work, you’ll support critical systems, maintain deployment pipelines, and help drive best practices across the team. This role requires you to work Monday - Friday, 09:00 - 17:00 (with the option to work from home 2 days a week. You will be responsible for Developing, enhancing, and deploying software solutions using C#.NET, AWS, Kafka, Docker, OpenTelemetry, and RDS databases (MSSQL, PostgreSQL, MySQL). Maintaining and optimising CI/CD pipelines within Azure DevOps to ensure efficient and reliable software delivery. Managing and updating Infrastructure as Code using Terraform and Terragrunt, supporting consistent and scalable environments. Contributing to architectural discussions, providing technical input and aligning solutions with system-wide design principles. Mentoring team members through code reviews, knowledge sharing, and adherence to coding standards and performance expectations. About you You’re an experienced software engineer with a solid academic foundation in Computer Science or an equivalent blend of qualifications and hands-on expertise. With 6+ years of professional engineering experience, you’re confident working across modern architectures, event-driven systems, and cloud-native environments. You communicate complex technical concepts with clarity and adapt your message to suit any audience, whether collaborating across multiple teams or influencing key technical decisions. You have a deep understanding of software engineering principles - OOP, DDD, and proven design patterns - and bring practical experience with C#.NET, OpenTelemetry, Kafka, Grafana, and containerised workloads. You’re comfortable working with both SQL and NoSQL databases and have hands-on experience with AWS cloud services. You’re also well-versed in developer operational processes such as CI/CD, Infrastructure as Code, and version control, and you thrive in dynamic, event-driven domains where scalability, reliability, and quality matter. We think the strongest teams are built on diversity and inclusivity. Contrasting opinions, varied skills and strong characters bring out the best in us all. And we cannot wait for you to join. Working at DFDS Join the movement and grow with us. Now about what we can give you. You’ll be able to access some fantastic benefits such as: Life assurance cover Contributory company pension scheme Holiday Purchase Scheme Free ferry travel for up to 4 guests between Dover and Calais / Newcastle and Amsterdam with no limit on trips Full employee assistance programme including: Proactive financial, emotional, mental, and physical health care support including face to face counselling, fast 24/7 access to a GP, a second medical opinion and legal support for colleagues and their family. Huge range of retail discounts from high street and online retailers Cashback on health care including dental, optical, physiotherapy, prescriptions, specialist consultations and much more. Access to myStrength, our Wellbeing platform, which has plenty of content to support and improve your mental wellness needs. Access to mental health first aid and opportunity to join support webinars with a focus on all areas of positive wellbeing. While you’re with us, we want you to develop. At DFDS, we believe that development happens first and foremost through activities in the workplace. We will also offer training courses that can support you in your role, if needed. Are we a match? Then what are you waiting for? Apply Now. If you think your personality, skills, experience, and desire match this role, we’d love to hear from you. Please send us your CV as soon as possible, as we’re keen to meet potential candidates on an ongoing basis. We look forward to hearing from you

Data Engineer Manager

Young's Employment Services Ltd

Hybrid - London with 2/3 days WFH Circ £85,000 - £95,000 + Attractive Bonus & Benefits Hands On Data Engineer Manager required for this exciting newly created position with a prestigious and rapidly expanding business in West London. It would suit someone with official management experience, or potentially a Lead / Senior Engineer looking to take on more managerial responsibility. The Data Engineer Manager will play a pivotal role at the heart of our client’s data & analytics operation. Having implemented a new MS Fabric based Data platform, the need now is to scale up and meet the demand to deliver data driven insights and strategies right across the business globally. There’ll be a hands-on element to the role as you’ll be troubleshooting, reviewing code, steering the team through deployments and acting as the escalation point for data engineering. Our client can offer an excellent career development opportunity and a vibrant, creative and collaborative work environment. This is a hybrid role based in Central / West London with the flexibility to work from home 2 or 3 days per week. Key Responsibilities include; Define and take ownership of the roadmap for the ongoing development and enhancement of the Data Platform. Design, implement, and oversee scalable data pipelines and ETL/ELT processes within MS Fabric, leveraging expertise in Azure Data Factory, Databricks, and other Azure services. Advocate for engineering best practices and ensure long-term sustainability of systems. Integrate principles of data quality, observability, and governance throughout all processes. Participate in recruiting, mentoring, and developing a high-performing data organization. Demonstrate pragmatic leadership by aligning multiple product workstreams to achieve a unified, robust, and trustworthy data platform that supports production services such as dashboards, new product launches, analytics, and data science initiatives. Develop and maintain comprehensive data models, data lakes, and data warehouses (e.g., utilizing Azure Synapse). Collaborate with data analysts, Analytics Engineers, and various stakeholders to fulfil business requirements. Key Experience, Skills and Knowledge: Experience leading data or platform teams in a production environment as a Senior Data Engineer, Tech Lead, Data Engineering Manager etc. Proven success with modern data infrastructure: distributed systems, batch and streaming pipelines Hands-on knowledge of tools such as Apache Spark, Kafka, Databricks, DBT or similar Experience building, defining, and owning data models, data lakes, and data warehouses Programming proficiency in the likes of Python, Pyspark, SQL, Scala or Java. Experience operating in a cloud-native environment such as Azure, AWS, GCP etc ( Fabric experience would be beneficial but is not essential). Excellent stakeholder management and communication skills. A strategic mindset, with a practical approach to delivery and prioritisation. Proven success with modern data infrastructure: distributed systems, batch and streaming pipelines. Experience building, defining, and owning data models, data lakes, and data warehouses. Exposure to data science concepts and techniques is highly desirable. Strong problem-solving skills and attention to detail. Salary is dependent on experience and expected to be in the region of £85,000 - £95,000 + an attractive bonus scheme and benefits package. For further information, please send your CV to Wayne Young at Young’s Employment Services Ltd. YES are operating as both a recruitment Agency and Recruitment Business. TPBN1_UKTJ

Developer (Java) - eDV cleared

Sanderson Government & Defence

Role: Developer (Java)Location: Cheltenham or LondonContract duration: 6-12 monthsClearance level: eDVWe provide talent solutions for the UK government and their critical supply chains. We currently are on the look out for eDV cleared software professionals to join our National Security sector.Key skills:

Experience of working in an Agile delivery team

Java development using Spring Boot

JavaScript frameworks - React, Angular, Vue etc.

Cloud services (AWS or Azure)

Experience building enterprise level web applications or services

Docker/Kubernetes containerisation and orchestration

Unit and automation testing

Familiarity with Data visualisation techniques and tools

Familiarity with structured and unstructured storage of Data

Use of Code repositories, familiarity with branching strategies, pull requests and merge processes.

MongoDB

Apache Kafka

Infrastructure as Code (eg Terraform, Ansible)

If you think you would be a good fit please apply with your most recent CVReasonable Adjustments:Respect and equality are core values to us. We are proud of the diverse and inclusive community we have built, and we welcome applications from people of all backgrounds and perspectives. Our success is driven by our people, united by the spirit of partnership to deliver the best resourcing solutions for our clients.If you need any help or adjustments during the recruitment process for any reason, please let us know when you apply or talk to the recruiters directly so we can support you.

Lead Software Engineer

Role - Technical Lead Duration - 12 months Rate - £750p/d (inside IR35) I’m partnering with a major UK Government programme that is quietly redefining how public services are delivered at national scale. They are looking for exceptional Technical Leads who want their work to have real, measurable impact on services used by millions of people every day. This is a role for someone who thrives on challenge and complexity. The organisation is undergoing a significant period of technical transformation - standardising ways of working, modernising technology stacks, building shared platforms, and breaking down legacy monolithic systems into scalable, resilient microservices aligned to a clear technical strategy. You’ll be a hands-on Technical Lead, responsible for guiding one of several multidisciplinary engineering teams. Depending on your background, you’ll either lead teams building large-scale citizen- or agent-facing digital services, or teams delivering shared capabilities that enable secure build, deployment, assurance and operation across the wider estate. You’ll set technical direction, influence strategy, and ensure work aligns with standards, best practice, and security expectations. Alongside engineering, you’ll mentor and coach other engineers, champion continuous improvement, and maintain a clear outward-facing view of how your service fits into a complex ecosystem. Key technical skills and experience include: Significant experience in modern software engineering for digital products, including: Java and microservice-based architectures Event-driven systems (e.g. Kafka) Modern data stores (e.g. MongoDB) Well-structured approaches such as Hexagonal architecture OR Significant experience in modern cloud infrastructure and DevOps, including: AWS cloud platforms Infrastructure as Code (e.g. Terraform) CI/CD pipelines (e.g. GitLab CI, Jenkins) Strong grounding in engineering best practice, including version control, secure-by-design principles, and technical assuranceThis role will suit someone adaptable, quality-driven, collaborative, and strategic - motivated by ownership, innovation, and the opportunity to help shape the future of UK public services. If interested please reach out to Fintan at TEC Partners

Lead Data Scientist, Telematics and Insurance London. Hybrid 1 to 2 days onsite Salary up to £110,000 plus bonus and benefits Working exclusively with my client, this role exists due to business expansion. The data science function launched in early 2023 and focuses on pricing and telematics driven products. The team already delivered over 20 percent profitability uplift across core insurance products using price optimisation models. The role owns data structure and value extraction from large scale telematics data. The focus sits on turning driving behaviour into clear pricing and operational decisions for insurance products. The business operates a champion challenger framework. The team delivers frequent model improvements through strong code standards and repeatable processes. Work happens at pace and at scale. What you will do: You will lead technical delivery across telematics data science. You will shape how data turns into pricing value and operational insight across the wider business. Day to day responsibilities * Design and deliver analytical solutions using telematics data * Lead development of scoring and pricing algorithms * Own end to end machine learning pipelines from data through production * Work hands on with Python and Databricks * Build repeatable and product agnostic training and serving frameworks * Translate model outputs into clear guidance for pricing, operations, and finance * Provide technical leadership and mentoring * Challenge existing approaches within insurance pricing * Take full ownership of delivery approach and outcomes Technology environment * Python * Databricks * Large scale and streaming data * Spark or Kafka style processing * Tree based models and deep neural networks * Production grade machine learning systems What my client look for Essential experience * Senior level data science delivery * Large scale or time series data * End to end machine learning delivery in production * Strong Python engineering * Solid statistical foundations * Proven commercial impact from models delivered Desirable experience * Telematics or sensor based data * Insurance or pricing domain exposure * Experience leading small teams * Evidence of idea generation and product thinking What you will work on over the next 6 to 12 months * Core telematics pricing models * Expansion into fleet and taxi products * New data driven insurance propositions * Shaping long term data science strategy * Building a team around this capability Why join This role offers full ownership of a high growth data product. The business doubled in size recently and plans further growth. You influence tooling, platforms, and technical direction. You build long term capability and there is an opportunity to grow a team further down the line. Please apply for more information if this sounds like a role for you

Senior Software Engineer - active eDV required

Active eDV required!! Our client, a prestigious organisation within the Defence and Security sector, is seeking a Senior Software Engineer with eDV clearance to join their team in Gloucester, Manchester, or London. This is a permanent role, requiring full-time onsite presence at one of the specified locations. Key Responsibilities: Designing and building software using industry best practices Collaborating with stakeholders and other engineers Contributing to the completion of project milestones Driving continuous improvement within the team Providing technical direction and collaboration with peers Job Requirements: Experience working in Agile delivery teams Proficiency in Java development using Spring Boot Knowledge of JavaScript frameworks such as React, Angular, or Vue Experience with cloud services like AWS or Azure Experience in building enterprise-level web applications or services Competence in Docker/Kubernetes containerisation and orchestration Skills in unit and automation testing Familiarity with data visualisation techniques and tools Understanding of structured and unstructured storage of data Experience with code repositories, branching strategies, pull requests, and merge processes Knowledge of MongoDB and Apache Kafka Experience with Infrastructure as Code (e.g., Terraform, Ansible) Benefits: Competitive salaries 25 days holiday plus statutory public holidays, with the option to buy and sell up to 5 days Contributory Pension Scheme up to 10.5% company contribution Discretionary company bonus scheme Life Assurance scheme valued at 6 times the salary with pension Flexible Benefits scheme including Health Cashplan, Dental, and Cycle to Work Enhanced sick pay Enhanced family-friendly policies including maternity, paternity, and shared parental leave If you are a driven and qualified Senior Software Engineer who holds an eDV clearance, we would love to hear from you. Apply now to join our client’s dynamic and innovative team within the Defence and Security sector in Gloucester, Manchester, or London

Spotlight

Software Developer - Consultant (Contract)

Check out this brand new role!Ready for a new challenge?Are you looking for contract work that makes a difference?If so, Opencast could be the place for you. We’re a growing tech consultancy that creates user-centred solutions for our clients in government and business.The roleWe’re looking for Contractors in Software Development (consultant level) to help our major clients transform.Software developers at Opencast care about building products right and combine their own experience and approach with our company values. They are tech agnostic, have expertise in agile methodologies, extreme programming practices and use industry-leading programming languages to deliver agile transformation.Our approach to software development is collaborative, focused on keeping things simple, and we use test driven development and pair programming as best practice.Working with clients and key stakeholders is a crucial part of a consultancy role. Our developers are inclusive team players that listen, collaborate, can positively challenge and manage expectations when needed but most of all are always willing to teach and help others. Leaving a client with improved ways of working, working technology and a good experience from discovery through to live is the priority.Contractors at Opencast follow the same principles as permanent consultants. The roles are varied, technical, and never confined to any one provider or solution.UK Security Clearance (existing SC clearance or eligibility) is a requirement for our contracting opportunities.Experience in delivering digital services for the UK government is highly valuable for many of our projects. Therefore, familiarity with the GDS toolkit will be essential.Technical Skills

Expertise in Java and/or Scala is preferred

Experience with Springboot, Javascript, Typescript, Kotlin, Python or Ruby is also valuable

Understanding of Object Oriented Programming

In depth knowledge of concepts and uses of testing

Knowledge or experience of delivering complex services to Government Digital Service (GDS) standards is required

Being comfortable with new technology, t-shaped and comfortable with ongoing learning and development is key to success

Experience with agile methodology

A contractor in software development at Opencast is responsible for:

Delivering in the upkeep of their team’s backlog

Collaborating with the teams testing effort

Leading on the implementation of user stories

Embracing mobbing and pairing

Working with others in a collaborative, multi-disciplinary environment

SalaryUp to £450 per day (working inside IR35)Where you’ll workOur hybrid model means everyone at Opencast splits their time between multiple locations, including from our HQ and hub locations, client site or home. Travel is part of life at Opencast, and considers requirements of your work, our clients and your team.We include youWe welcome candidates from all identities, attributes, ways of thinking and backgrounds to thrive in a career at Opencast. Our aim is for the diversity of our people to be reflected in the solutions we deliver, to help create a fairer society for all.InterviewJob interviews are on Microsoft Teams. We’ll make any adjustments to help you. The recruitment process for this role includes pair programming and a technical interview.Want to know more?Visit our website or email careers@opencastsoftware.com.

Spotlight

Software Developer - Senior Consultant (Contractor)

+11

Check out this brand new role!Ready for a new challenge?Are you looking for work that makes a difference? Do you want to work with people who learn and grow together?If so, Opencast could be the place for you. We’re a growing tech consultancy that creates user-centred solutions for our clients in government and business.The roleWe’re looking for Contractors in Software Development (Senior level or Technical Lead) to help our major clients transform.Software developers at Opencast care about building products right and combine their own experience and approach with our company values. They are tech agnostic, have expertise in agile methodologies, eXtreme programming practices and use industry-leading programming languages to deliver agile transformation.Our approach to software development is collaborative, focused on keeping things simple, and we use test driven development and pair programming as best practice.Working with clients and key stakeholders is a crucial part of a consultancy role. Our developers are inclusive team players that listen, collaborate, can positively challenge and manage expectations when needed but most of all are always willing to teach and help others. Leaving a client with improved ways of working, working technology and a good experience from discovery through to live is the priority.Contractors at Opencast follow the same principles as permanent consultants. The roles are varied, technical, never confined to any one provider or solution.UK Security Clearance (existing SC clearance or eligibility) is a requirement for our contracting opportunities.Experience in delivering digital services for the UK government is highly valuable for many of our projects. Therefore, familiarity with the GDS toolkit will be essential.Technical Skills

Expertise in Java and/or Scala is preferred

Experience in other languages such as Springboot, Javascript, Typescript, Kotlin, Python or Ruby is also valuable

Ability to lead other developers in tackling difficult programming challenges and drive the delivery of a backlog

Ability to contribute to architectural designs

Experience of setting testing strategies to match industry standards

Knowledge or experience of delivering complex services to Government Digital Service (GDS) standards, is beneficial

Being comfortable with new technology, t-shaped and comfortable with ongoing learning and development is key to success.

Experience with agile methodology

A contractor in software development at Opencast is responsible for:

Driving the elaboration of their team’s backlog

Setting testing strategies to match industry standards

Being a technical expert in their team (or acting as the team lead)

Leading the technical representation in a project discovery

Acting as a technical lead in the team, enabling them to achieve their full potential

Day Rate£450 - £600 per day (working inside IR35)Where you’ll workOur hybrid model means everyone at Opencast splits their time between multiple locations, including from our HQ and hub locations, client site or home. Travel is part of life at Opencast, and considers requirements of your work, our clients and your team.We include youWe welcome candidates from all identities, attributes, ways of thinking and backgrounds to thrive in a career at Opencast. Our aim is for the diversity of our people to be reflected in the solutions we deliver, to help create a fairer society for all.InterviewJob interviews are on Microsoft Teams. We’ll make any adjustments to help you. The recruitment process for this role includes pair programming, a values interview, and a technical interview.Want to know more?Visit our website or email careers@opencastsoftware.com.

Page 1 of 2

Frequently asked questions

What types of Apache Kafka jobs are available on Haystack?

Haystack features a wide range of Apache Kafka jobs including developer, architect, administrator, and DevOps roles, suited for various experience levels from junior to senior.

How can I filter Apache Kafka job listings by experience level?

You can filter Apache Kafka job listings by experience level using the search filters on our platform. Simply select your preferred experience range such as entry-level, mid-level, or senior positions to tailor your job search.

Are remote Apache Kafka jobs available on Haystack?

Yes, Haystack includes remote Apache Kafka job opportunities. Use the 'Remote' filter option to find jobs that allow you to work from anywhere.

What skills are commonly required for Apache Kafka roles?

Commonly required skills for Apache Kafka jobs include strong knowledge of Kafka architecture, experience with stream processing, proficiency in programming languages like Java or Scala, and familiarity with other big data technologies.

How can I apply for Apache Kafka jobs through Haystack?

To apply for Apache Kafka jobs on Haystack, create a profile, upload your resume, and click the 'Apply' button on the job listing. Some employers may redirect you to their application portals.

Terms

Feedback

Contact

Careers