Make yourself visible and let companies apply to you.
Roles
Remote Processing Jobs
Overview
Discover top remote processing jobs with Haystack, your go-to IT job board for flexible tech careers. Whether you're an expert in data processing, workflow management, or system optimization, find the latest remote processing roles that match your skills and advance your career from anywhere. Start exploring remote processing job opportunities today!
Lead AI Engineer
Sopra Steria
City of London
Remote or hybrid
Senior
£90,000
RECENTLY POSTED

Are you passionate about Artificial Intelligence and ready to lead from the front? Were looking for a Lead AI Engineer to join our AI and Data Practice at Sopra Steria. This is a hands-on leadership role where youll combine technical expertise with line management responsibilities, guiding and developing a talented team while shaping the future of AI solutions.

Youll work on cutting-edge projects, applying innovative AI technologies to solve complex business challenges. Alongside this, youll mentor and coach engineers, fostering a collaborative, high-performing environment.

We offer great career progression opportunities, flexible benefits, and the ability to work from anywhere in the UK, with only occasional travel for client or team meetings.

What youll be doing

Leading the delivery of advanced AI and agent-based solutions.

Managing and developing a team of engineers, providing hands-on line management and support.

Coaching and mentoring junior engineers, promoting best practice and growth.

Communicating complex AI concepts to technical and non-technical stakeholders.

Managing project delivery to ensure outcomes are on time, within budget and to quality standards.

Applying MLOps practices to address risk and technical debt.

Staying up to date with advancements in AI, agent architectures and emerging best practices.

What youll bring

Proven experience in line management and team leadership within a technical environment.

Expertise in AI and Machine Learning, including agent-based AI, RAG (Retrieval Augmented Generation), multi-agent systems and conversational agents.

Strong programming skills in Python, Java or .NET.

Experience with GenAI and LLMs (e.g. ChatGPT, Claude, Llama, OpenAI), including prompt engineering, fine tuning and advanced search.

Familiarity with AI agent frameworks (e.g. Autogen AI) and digital assistant solutions such as Microsoft Copilot.

Knowledge of cloud-native engineering techniques for scalable AI deployment.

If youre interested but not sure if your skills match every requirement, please apply wed love to hear from you!

Employment Type: Full-time, Permanent

Location: UK Wide (occasional travel for client or team meetings)

Security Clearance Level: SC Eligible

Salary: Up to £90,000

Internal Recruiter: Annecia

Benefits : £5,400 car allowance, 25 days annual leave with the option to buy additional days, private medical, life assurance, pension, and a generous flexible benefits fund.

We believe flexibility at work promotes balance and productivity. If you need to work flexibly, talk to us were happy to explore whats possible.

Loved reading about this job and want to know more about us?

With a long history of delivering transformation, we’ve developed a market-leading partnership ecosystem to provide business services of the future and shape valuable, positive outcomes for communities. We empower our clients by providing innovative solutions and commercial models that help them meet their business needs, drive operational efficiencies, and deliver impactful value creation. We remain committed to values of excellence, empathy and respect to produce transformative outcomes in business processing creating value for all.

We embrace difference as a source of creativity, innovation and competitive advantage and are striving to become a more diverse organisation. We welcome applications from people with a diverse variety of backgrounds and identities. We are committed to equality of opportunity for all and do not discriminate on the basis of race, religion, colour, gender, age, disability, sexual orientation or marital status. We havepartnered with Vercida , the UK’s largest diversity and inclusion focused careers site, where all our vacancies are available in an accessible format. If you require any adjustments to the recruitment process, to enable you to perform to the best of your ability, please let us knowwhen completingyour application. We participate in the Disability Confident scheme and are committed to offering an interview to any candidate with a disability, who meets the minimum criteria for the role. If you believe this could apply to you, please let us know when completing your application.

TPBN1_UKTJ

Senior Data Engineer (Big Data/ Hadoop/ Spark)
HAYS
City of London
Remote or hybrid
Senior
£700/day
RECENTLY POSTED
+5

Your new company Working for a renowned financial services organisation Your new role We're looking for a Senior Data Engineer to design and deliver scalable on prem, high-quality data solutions for low/ high-level data platforms that power analytical and business insights. This is a hands-on role suited to someone with strong data engineering and big data expertise, ideally gained within financial services. Joining leading commodities, metals, trading, and exchange group, you will support a strategic metals initiative focused on reducing on-prem platform costs and modernising legacy ETL processes. You'll help design and build a new on-prem data platform aligned to the metals strategy while developing and maintaining scalable data pipelines and analytics infrastructure. Using Hadoop, Big Data, and Spark technologies, you will ensure data quality through automated validation, monitoring, and testing. You will also enable seamless integration across data warehouses and data lakes, contributing to a robust, scalable, and resilient enterprise data ecosystem. What you'll need to succeed Vast Data Engineering expertise with Big Data technologies. Experience designing and building on-prem data platforms, from high-level architecture to detailed technical design. Hands-on experience configuring multi-node Hadoop clusters, including resource management, security, and performance tuning. Strong Big Data engineering background using Apache Airflow, Spark, dbt, Kafka, and Hadoop ecosystem tools. Knowledge of RDBMS systems (PostgreSQL, SQL Server) and familiarity with NoSQL/distributed databases such as MongoDB. Proven delivery of streaming pipelines and real-time data processing solutions. Improved job efficiency and reduced runtimes through Apache Spark optimisation and development. Some experience with containerisation (Docker, Kubernetes) and CI/CD pipelines. Delivered streaming pipelines and real-time data processing solutions. Experience replacing legacy ETL tools (e.g., Informatica) with modern data engineering pipelines and platform builds. Proven background working within financial services environments. What you'll get in return Flexible working options available. What you need to do now If you're interested in this role, click 'apply now' to forward an up-to-date copy of your CV, or call us now. Hays Specialist Recruitment Limited acts as an employment agency for permanent recruitment and employment business for the supply of temporary workers. By applying for this job you accept the T&C's, Privacy Policy and Disclaimers which can be found at hays.co.uk TPBN1\_UKTJ

AI Prompt Engineer
Harvey Nash
Edinburgh
Remote or hybrid
Mid - Senior
Private salary
RECENTLY POSTED

AI Prompt Engineer - 12 Month Contract - Outside IR35

Role Description:

Harvey Nash’s Pub Sec client are seeking an AI Prompt Engineer to design, develop, and optimise prompt-based solutions for AI systems.

This role will design and optimise AI prompts for extracting data from forms, fine-tune models for accuracy, automate end-to-end workflows, and manage production deployments. The ideal candidate will ensure robust, scalable, and secure AI solutions that streamline document processing

The initial focus of the role will look at building on exiting solution to extract structured data from various forms and documents. This role combines expertise in natural language processing (NLP), prompt engineering, and workflow automation to enable accurate and efficient data processing.

Key Responsibilities:

  • Prompt Design & Optimisation:

  • Develop and refine AI prompts to accurately extract data fields from structured and semi-structured forms.

  • Test and iterate prompts for different document types and languages to maximize accuracy and reliability.

  • Ensure prompt development is reusable and scalable across different use case scenarios

  • Work closely with developers, data scientists, and business analysts to align solutions with business needs.

  • Fine-tune AI models to improve performance across diverse document types and languages.

  • Workflow Automation

  • Develop automated pipelines for document ingestion, data extraction, and validation.

  • Integrate AI solutions with OCR tools and enterprise systems for seamless processing.

  • Deployment & Support

  • Manage deployment of AI solutions into production environments.

  • Monitor system performance, troubleshoot issues, and provide ongoing support.

  • AI Model Integration*:

  • Collaborate with data scientists and developers to integrate prompt-based solutions into existing AI/ML pipelines.

  • Ensure compatibility with OCR tools and document processing systems.

  • Data Quality & Validation:

  • Implement validation logic to ensure extracted data meets quality standards.

  • Work with QA teams to identify and resolve extraction errors.

  • Research & Innovation:

  • Stay updated on advancements in prompt engineering, LLMs, and document AI technologies.

  • Experiment with new techniques for improving extraction performance and reducing manual intervention.

  • Collaboration & Documentation:

  • Partner with business analysts to understand form structures and data requirements.

  • Document prompt strategies, workflows, and best practices for internal knowledge sharing.

  • Document guidance to support deployment approach and ongoing support and maintenance activities

Required Skills & Qualifications

  • Strong understanding of Large Language Models (LLMs) and prompt engineering principles.
  • Experience with document AI, OCR technologies, and data extraction workflows.
  • Proficiency in Python or similar languages for automation and integration tasks.
  • Familiarity with APIs and cloud-based AI services (e.g., Azure OpenAI, AWS, Google AI).
  • Excellent problem-solving skills and attention to detail.
  • Background in NLP, machine learning, or data science.
  • Experience with form processing systems in finance, healthcare, or enterprise environments.
  • Knowledge of data privacy regulations and secure handling of sensitive information.
  • Demonstrated success in delivery across both distributed and hybrid on-premises and cloud technology estates.
  • Experience in managing both agile and waterfall projects.
  • Excellent interpersonal skills, influencing and communication skills.
  • Ability to apply a broad understanding of IT infrastructure and interdependencies to create effective, risk-minimising migration plans.
  • The candidate will have an awareness of Digital First Service Standards, and Government Digital Services (GDS).
Engineer Six Sigma
Bond Williams Limited
Oxford
Remote or hybrid
Mid - Senior
Private salary
RECENTLY POSTED

An established engineering and laboratory-based organisation is seeking a Lean Six Sigma Consultant to drive operational excellence across the laboratory. This role focuses on process improvement, workflow optimisation, and continuous improvement initiatives to enhance efficiency, reduce bottlenecks, and support sustainable growth. The Lean Six Sigma Consultant will work closely with laboratory teams to embed Lean Six Sigma methodologies, support strategic planning, and ensure operational improvements are delivered effectively and sustainably. Key Responsibilities Identify operational bottlenecks and opportunities for process improvement. Lead Lean Six Sigma projects across laboratory workflows, including sample processing, data handling, and reporting. Analyse current processes, gather and interpret data, and recommend solutions that enhance efficiency and quality. Develop and implement continuous improvement initiatives, ensuring alignment with laboratory and organisational objectives. Provide coaching, training, and guidance to laboratory staff on Lean Six Sigma principles and best practices. Monitor and report on process improvement metrics, ensuring initiatives deliver measurable results. Collaborate with other laboratories across Europe to share best practices and drive standardisation. Essential Criteria: Strong experience in Lean Six Sigma and operational improvement within laboratory, scientific, or engineering environments. Proven track record of delivering measurable process improvements. Ability to lead projects and influence across multiple teams. Strong analytical skills and experience with data-driven decision-making. Excellent communication and coaching skills. Willingness to travel occasionally within Europe. What This Role Offers The opportunity to work closely with senior leadership on high-impact operational transformation. Exposure to international laboratory operations and best practices. A role where your expertise directly shapes efficiency, capability, and the long-term success of the laboratory team. Bond Williams Professional Recruitment are an equal opportunity employer and operate as an Employment Business and Recruitment Agency

AI Infrastructure Architect
MicroTECH Global Ltd
Edinburgh
Remote or hybrid
Mid - Senior
Private salary
RECENTLY POSTED

Responsibilities:

Design a unified AI Infra & Serving architecture platform for composite AI workloads such as LLM Training & Inference, RLHF, Agent, and Multimodal processing. This platform will integrate inference, orchestration, and state management, defining the technical evolution path for Serverless AI + Agentic Serving

Design a heterogeneous execution framework across CPU/GPU/NPU for agent memory, tool invocation, and long-running multi-turn conversations and tasks. Build an efficient memory/KV-cache/vector store/logging and state-management subsystem to support agent retrieval, planning, and persistent memory.

Build a high-performance Runtime/Framework that defines the next-generation Serverless AI foundation through elastic scaling, cold start optimization, batch processing, function-based inference, request orchestration, dynamic decoupled deployment, and other features to support performance scenarios such as multiple models, multi-tenancy, and high concurrency.

Key Requirements:

  • Strong foundational knowledge in system architecture, or computer architecture, operating systems, and runtime environments;
  • Hands-on experience with Serverless architectures and cloud-native optimization technologies such as containers, Kubernetes, service orchestration, and autoscaling
  • vLLM, SGLang, Ray Serve, etc.); understand common optimization concepts such as continuous batching, KV-Cache reuse, parallelism, and compression/quantization/distillation
  • Proficient in using Profiling/Tracing tools; experienced in analyzing and optimizing system-level bottlenecks regarding GPU utilization, memory/bandwidth, Interconnect Fabric, and network/storage paths
  • Proficient in at least one system-level language (e.g., C/C++, Go, Rust) and one scripting language (e.g., Python)
RPG Lead
Quinnox Limited
London
Remote or hybrid
Senior
£90,000
RECENTLY POSTED

We are seeking an experienced RPG Tech Lead to lead the design, development, and support of core banking customizations on the IBM i (AS/400) platform for a mid-sized bank. This role combines deep hands-on RPG development with technical leadership, solution ownership, and governance of mission-critical core banking systems.

The Tech Lead will ensure stability, performance, security, and regulatory compliance of core banking applications while mentoring developers and partnering closely with business, vendor, and operations teams.

Key Responsibilities

Technical Leadership & Architecture

  • Own the technical design and architecture of RPG-based core banking customizations.
  • Define and enforce coding standards, development practices, and system governance for RPG and IBM i applications.
  • Review and approve technical designs, RPG code, and database changes.
  • Ensure solutions meet performance, availability, security, and audit requirements.
  • Lead root cause analysis for complex production issues and ensure long-term fixes.

Development & Delivery

  • Act as a hands-on lead developer for complex RPG programs, batch jobs, and core banking extensions.
  • Design and implement enhancements to accounts, deposits, lending, interest, fees, GL, and transaction processing.
  • Oversee batch processing (EOD, EOM, EOY), job scheduling, and recovery procedures.
  • Guide the use of RPG (ILE / free-format), CL, and embedded SQL best practices.
  • Coordinate releases, change management, and production deployments.

Team & Stakeholder Collaboration

  • Mentor and guide RPG developers, providing technical direction and coaching.
  • Act as the primary technical point of contact for core banking customizations.
  • Work closely with business users, core banking vendors, and infrastructure teams.
  • Participate in requirement reviews, estimation, and delivery planning from a technical perspective.
  • Support audits, regulatory reviews, and compliance activities.

Required Qualifications & Skills

  • 10+ years of application development experience, with 6+ years in RPG on IBM i (AS/400).
  • Proven experience in a Tech Lead or Senior RPG Developer role.
  • Strong expertise in ILE RPG (free-format preferred), CL programming, and IBM i utilities.
  • Deep knowledge of DB2/400, SQL Server, embedded SQL, and performance tuning.
  • Hands-on experience customizing core banking systems.
  • Strong understanding of banking domain and transaction processing.
  • Experience managing production support in a 24x7 banking environment.
  • Strong communication skills and ability to lead technical discussions with business and vendor teams.

Preferred / Nice-to-Have

  • Experience with major core banking platforms (Finacle, Flex cube, Temenos, etc.).
  • Exposure to core banking modernization or system integration initiatives.
  • Knowledge of API enablement, message queues, or middleware.
  • Experience with high availability, disaster recovery, and failover setups.
  • Familiarity with banking regulations, audits, and compliance controls.
Client Success Director (AI)
Circana
Bracknell
Remote or hybrid
Leader
Private salary
RECENTLY POSTED

Company description:

At Circana, we are fueled by our passion for continuous learning and growth, we seek and share feedback freely, and we celebrate victories both big and small in an environment that is flexible and accommodating to our work and personal lives. We have a global commitment to diversity, equity, and inclusion as we believe in the undeniable strength that diversity brings to our business, employees, clients, and communities. With us, you can always bring your full self to work. Join our inclusive, committed team to be a challenger, own outcomes, and stay curious together. Circana is proud to be Certified by Great Place To Work. This prestigious award is based entirely on what current employees say about their experience working at Circana.

Job description:

We are seeking a user-focused, detail-oriented, resourceful individual to support the ongoing success of Emiri client deployments. This role bridges product support, user experience, and development by investigating issues, coordinating resolutions, coaching commercial teams, and managing communication between users, client service teams, and product development.

Job Responsibilities

  • Apply a voice of customer lens to user feedback and issues to surface enhancement opportunities and influence the product roadmap
  • Own issue root cause identification and resolution to triage root causes between feature enhancements, system bugs, and user education
  • Coach commercial teams on the configuration and functionality of Liquid AI; support key client meetings and demos
  • Support setup, configuration, and QA of client models
  • Drive continuous improvement of support processes, tools and user education materials
  • Clearly communicate guidance and resolutions to users or internal teams
  • Test new enhancements or fixes prior to release to ensure quality and expected behaviour
  • Prepare concise write-ups of confirmed bugs or feature requests for the development team

Required profile:

  • Familiarity with Circana tools, including Unify+, model/report building, and ideally Emiri
  • Background in product or client support, operations, or troubleshooting technical issues, ideally with a focus on data-driven AI tools
  • Analytical and problem-solving skills, with the ability to investigate user reports, logs, and system behaviour to identify root causes
  • Strong organizational skills to support multiple client deployments and maintain flawless on-time delivery and service levels
  • Strong communication abilities, especially in simplifying technical concepts for non-technical users and collaborating across teams
  • Tech-curious mindset, comfortable learning prompt engineering and system behaviour, with a process-driven approach to managing issues, QA, and feedback loops
  • Familiarity with AI systems, natural language processing tools, or machine learning products
  • Experience using tools like Jira, Confluence, or similar issue tracking and documentation systems
  • 7+ years of experience in client support for data analytics and reporting

What we offer:

As well as the technical skills, experience and attributes that are required for the role, our shared behaviours sit at the core of our organization. Therefore, we always look for people who can continuously champion these behaviour’s throughout the business within their day-to-day role:

  • Stay Curious: Being hungry to learn and grow, always asking the big questions.
  • Seek Clarity: Embracing complexity to create clarity and inspire action.
  • Own the Outcome: Being accountable for decisions and taking ownership of our choices.
  • Center on the Client: Relentlessly adding value for our customers.
  • Be a Challenger: Never complacent, always striving for continuous improvement.
  • Champion Inclusivity: Fostering trust in relationships engaging with empathy, respect, and integrity.

Commit to each other: Contributing to making Circana a great place to work for everyone

Project Engineer
Pioneer Selection
London
Remote or hybrid
Mid - Senior
£70,000/day
RECENTLY POSTED

Job Title – Project Engineer (Capital Projects Engineer / CAPEX Project Manager)

Location – Remote (Essex, Kent or London)

Salary – £60,000 – £72,000 (6 Month Fixed Term Contract)
Car Allowance – £5,500 per annum + Mileage Paid
Shift – Monday to Friday (Flexible / Project-Based Hours)

Job Role – Project Engineer

Are you an experienced Project Engineer looking for a high-impact 6-month fixed term contract within a fast-paced manufacturing environment? This Project Engineer role offers the opportunity to lead large-scale CAPEX projects (up to £1M) across multiple UK sites, delivering engineering investment programmes that directly impact operational performance and business growth. As a Project Engineer, you will take full ownership from concept through to commissioning, working with senior stakeholders to deliver projects on time, within budget and to specification. This is a fantastic opportunity for a results-driven Project Engineer who thrives in dynamic manufacturing environments and wants autonomy, responsibility and strong financial reward.

Sector – Fast-Paced Manufacturing / Industrial Manufacturing Non-Negotiable Requirements of “Project Engineer”

  • Proven project management experience
  • Experience delivering large CAPEX projects up to £1M within fast-paced manufacturing
  • Full UK Driving Licence and willing to travel to multiple sites
  • Recognised Engineering qualification

Essential Requirements of “Project Engineer”

  • Strong stakeholder management and communication skills
  • Experience managing contractors and external suppliers
  • Budget control and financial forecasting experience
  • Knowledge of UK health & safety and compliance regulations (CDM, PUWER etc.)
  • Experience delivering projects to strict cost and time constraints

Desirable Requirements of “Project Engineer”

  • FMCG or food manufacturing experience
  • Multi-site project delivery experience
  • Mechanical or Electrical bias
  • Experience commissioning production lines or process equipment

The “Project Engineer” will benefit from:

  • About the Company: A well-established, growing manufacturing business investing heavily in site upgrades and capital improvements across multiple UK locations.
  • Training & Development: Exposure to large-scale strategic investment programmes and senior leadership collaboration.
  • Investment in Engineer: High-value CAPEX portfolio with autonomy and decision-making responsibility.
  • Equipment: Work on automated production lines, processing equipment, utilities, and plant infrastructure projects.
  • £5,500 Car Allowance + Mileage
  • Competitive day-to-day autonomy
  • Strong opportunity to secure longer-term work based on performance

If you are interested in this role and feel that you have the right skills, then please click apply at the bottom of this advert.

For further details contact Adem Halil at Pioneer Selection – .

As a registered candidate with Pioneer Selection Ltd, you automatically become eligible for our referral scheme.

You will receive £250 for every candidate we place in permanent employment who has been recommended by you. Terms and Conditions apply – please see our website for further details.

Pega Lead System Architect LSA
Randstad Digital
London
Fully remote
Senior
£80,000
RECENTLY POSTED

Adword

Job Title: Pega Lead System Architect (LSA)

Location: Remote

Job type: Permanent

Salary: Open to the market rates

Job Description

Experience: 10-14 years overall; 3+ years as LSA; 2+ Pega CS end-to-end implementations

Role Summary: Design Authority. Owns architecture, quality, performance, security, and DevOps; leads CoE standards and AI enablement.

Key Responsibilities

  • Own solution blueprint: case taxonomy, microjourneys, interaction flows, CSR Desktop, Knowledge, and Digital Messaging.
  • Define non-functional requirements (scale, resiliency) and node strategy: Queue Processors vs. Job Schedulers, background processing, caching.
  • Integration architecture: REST/JSON, SOAP (if needed), OAuth2/SAML, eventing (Kafka/JMS), idempotency, pagination, circuit breaker and retry patterns.
  • Data design: enterprise data model, data pages (scope, refresh), reference data strategy, data obfuscation and masking for PII.
  • UX strategy: Constellation (preferred) / Cosmos; accessibility (WCAG), localization/i18n, responsive behavior.
  • DevOps: Deployment Manager pipelines, product packaging/versioning, branching/merge policy, automated quality gates, rollback patterns.
  • Observability and performance: PDC operating rhythm, PAL/Alerts analysis, log correlation; performance test strategy and tuning.
  • Security & compliance: GDPR-aligned retention/erasure, RBAC/ABAC, secrets management, auditability, encryption at rest and in transit.
  • CoE leadership: guardrails & code review checklists, reusable components, reference architectures, developer onboarding and enablement.
  • AI initiatives: seed NLP/Email Bot, Digital Messaging intent/sentiment, GenAI-assisted CSR (summarization, knowledge retrieval), and governance (prompt/data policies).

Must-Have Skills

  • Pega CS depth: Interaction Portal, Service Cases, Knowledge, Email Bot, Digital Messaging (e.g., chat/WhatsApp) with production go-lives.
  • Constellation experience: view templates, regions, editable tables, data-reference patterns; or strong Cosmos with migration path understanding.
  • Integration design mastery: REST with OAuth2 (client credentials, auth code), error handling frameworks, request/response mapping, timeouts, retries, backoff.
  • Event-driven patterns: Kafka/JMS producers/consumers, correlation IDs, exactly-once/at-least-once semantics, dead-letter handling.
  • Performance engineering: PDC triage, PAL reading, DB indexing considerations, cache invalidation, node classification, queue throughput tuning.
  • DevOps at scale: multi-stage pipelines in Deployment Manager, artifact versioning, approvals, infrastructure-as-code collaboration, release governance.
  • Security engineering: Access Manager, attribute-based access control (ABAC) using Access When, field-level encryption/obfuscation, secure logging.
  • Testing leadership: PegaUnit strategy, scenario tests, contract tests for integrations, test data management, coverage KPIs.
  • Documentation & stakeholder management: architecture decision records (ADRs), trade-off analysis, executive communication, risk management.

Nice-to-Have

  • Customer Decision Hub (CDH) to power NBA in service context and next-best-service actions.
  • GenAI/Agentic AI in Pega (e.g., summarization, knowledge buddy/coach patterns) and NLP model tuning.
  • Telephony/CCaaS: Genesys, Amazon Connect, Twilio, NICE; CTI handoff and screen-pop patterns.
  • Cloud ops (Pega Cloud, AWS/Azure) and enterprise observability (Splunk/Datadog/New Relic).
  • Travel/e-commerce domain: booking amendments, refunds/chargebacks, partner/supplier support, fraud/risk workflows.

Certifications

  • Mandatory: Pega Certified Lead System Architect (CLSA)
  • Preferred: Pega Decisioning Consultant, badges in GenAI, Digital Messaging, PDC

If you’re excited about this role then we would like to hear from you!

Please apply with a copy of your CV or send it to Prasanna . merugu @ randstaddigital . com and let’s start the conversation!

Randstad Technologies Ltd is a leading specialist recruitment business for the IT & Engineering industries. Please note that due to a high level of applications, we can only respond to applicants whose skills & qualifications are suitable for this position. No terminology in this advert is intended to discriminate against any of the protected characteristics that fall under the Equality Act 2010. For the purposes of the Conduct Regulations 2003, when advertising permanent vacancies we are acting as an Employment Agency, and when advertising temporary/contract vacancies we are acting as an Employment Business.

Senior Data Engineer (AWS, Airflow, Python)
Triad
London
Remote or hybrid
Senior
£60,000 - £65,000
RECENTLY POSTED
+1

Based at client locations, working remotely, or based in our Godalming or Milton Keynes offices.
Salary up to £65k plus company benefits.

About Us

Triad Group Plc is an award-winning digital, data, and solutions consultancy with over 35 years’ experience primarily serving the UK public sector and central government. We deliver high-quality solutions that make a real difference to users, citizens and consumers.

At Triad, collaboration thrives, knowledge is shared, and every voice matters. Our close-knit, supportive culture ensures you’re valued from day one. Whether working with cutting-edge technology or shaping strategy for national-scale projects, you’ll be trusted, challenged, and empowered to grow.

We nurture learning through communities of practice and encourage creativity, autonomy, and innovation. If you’re passionate about solving meaningful problems with smart and passionate people, Triad could be the place for you.

Glassdoor score of 4.7

96% of our staff would recommend Triad to a friend

100% CEO approval

See for yourself some of the work that makes us all so proud:

Helping law enforcement with secure intelligence systems that keep the UK safe

Supporting the UK’s national meteorological service in leveraging supercomputers for next-level weather forecasting

Assisting a UK government department responsible for consumer product safety with systems to track unsafe products

Powering systems that help the government monitor and reduce greenhouse gas emissions from commercial transport

Role Summary

Triad is seeking a Senior Data Engineer to play a key role in delivering high-quality data solutions across a range of client assignments, primarily within the UK public sector. You will design, build, and optimise cloud-based data platforms, working closely with multidisciplinary teams to understand data requirements and deliver scalable, reliable, and secure data pipelines. This role offers the opportunity to shape data architecture, influence technical decisions, and contribute to meaningful, data-driven outcomes.

Key Responsibilities

Design, develop, and maintain scalable data pipelines to extract, transform, and load (ETL) data into cloud-based data platforms, primarily AWS.

Create and manage data models that support efficient storage, retrieval, and analysis of data.

Utilise AWS services such as S3, EC2, Glue, Aurora, Redshift, DynamoDB and Lambda to architect and maintain cloud data solutions.

Maintain modular Terraform based IaC for reliable provisioning of AWS infrastructure.

Develop, optimise and maintain robust data pipelines using Apache Airflow.

Implement data transformation processes using Python to clean, preprocess, and enrich data for analytical use.

Collaborate with data analysts, data scientists, developers, and other stakeholders to understand and integrate data requirements.

Monitor, optimise, and tune data pipelines to ensure performance, reliability, and scalability.

Identify data quality issues and implement data validation and cleansing processes.

Maintain clear and comprehensive documentation covering data pipelines, models, and best practices.

Work within a continuous integration environment with automated builds, deployments, and testing.

Skills and Experience

  • Strong experience designing and building data pipelines on cloud platforms, particularly AWS.
  • Excellent proficiency in developing ETL processes and data transformation workflows.
  • Strong SQL skills (postgresql) and advanced Python coding capability (essential).
  • Experience working with AWS services such as S3, EC2, Glue, Aurora, Redshift, DynamoDB and Lambda (essential).
  • Understanding of Terraform codebases to create and manage AWS infrastructure.
  • Experience developing, optimising, and maintaining data pipelines using Apache Airflow.
  • Familiarity with distributed data processing systems such as Spark or Databricks.
  • Experience working with high-performing, low-latency, or large-volume data systems.
  • Ability to collaborate effectively within cross-functional, agile, delivery-focused teams.
  • Experience defining data models, metadata, and data dictionaries to ensure consistency and accuracy.

Qualifications & Certifications

  • A degree or equivalent qualification in Computer Science, Data Science, or a related discipline (desirable).
  • Due to the nature of this position, you must be willing and eligible to achieve a minimum of SC clearance. To be eligible, you must have been a resident in the UK for a minimum of 5 years and have the right to work in the UK.

Triad’s Commitment to You

As a growing and ambitious company, Triad prioritises your development and well-being:

  • Continuous Training & Development: Access to top-rated Udemy Business courses.
  • Work Environment: Collaborative, creative, and free from discriminatioBenefits:
    • 25 days of annual leave, plus bank holidays.
    • Matched pension contributions (5%).
    • Private healthcare with Bupa.
    • Gym membership support or Lakeshore Fitness access.
    • Perkbox membership.
    • Cycle-to-work scheme.

What Our Colleagues Have to Say

Please see for yourself on Glassdoor and our “Day in the Life” videos at the bottom of our Careers Page.

Our Selection Process

After applying for the role, our in-house talent team will contact you to discuss Triad and the position. If shortlisted, you will be invited for:

  1. A technical test including numerical, logical and verbal reasoning
  2. A technical interview with our consultants
  3. A management interview to assess cultural fit

We aim to complete interviews and progress candidates to offer stage within 2-3 weeks of the initial conversation.

Other Information

If this role is of interest to you or you would like further information, please contact Ryan Jordanand submit your application now.

Triad is an equal opportunities employer and welcomes applications from all suitably qualified people regardless of sex, race, disability, age, sexual orientation, gender reassignment, religion, or belief. We are proud that our recruitment process is inclusive and accessible to disabled people who meet the minimum criteria for any role. Triad is a signatory to the Tech Talent Charter and a Disability Confident Leader.

Data Scientist (NLP & LLM Specialist)
Randstad Technologies Recruitment
London
Fully remote
Mid - Senior
£400/day - £565/day

Remote- UK 6-month contract with Potential Extension Day rate - £427.68 - £565 per day Inside IR35 Data Scientist (NLP & LLM Specialist) Are you an expert in Natural Language Processing who thrives on building scalable, real-world AI solutions? We are seeking a hands-on Data Scientist to join a premier global credit ratings and financial information firm. You will be a key player in launching a brand-new, from-scratch analytics platform designed for elite institutional clients including corporate banks and asset managers. The Opportunity In this role, you will go beyond conventional boundaries to design, build, and deploy quantitative models that power advanced insights. You will collaborate with a cross-domain team of economists, political scientists, and developers to transform proprietary risk data into actionable strategic assets. Your Impact Model Innovation: Design and optimize risk models for analytics and generative AI applications using proprietary NLP data generation processes. Pipeline Development: Develop and maintain robust ML and data pipelines for experimentation and deployment. Insight Extraction: Prototype and test new approaches for extracting insights from structured and unstructured data. Technical Translation: Explain ML/NLP model outputs and methodologies to non-technical stakeholders to drive strategic decisions. Your Experience Experience Level: 5-7+ years (More experience is welcomed). Core Technicals: High expertise in Python and Machine Learning (ML). NLP Expertise: 3-5 years of experience in Natural Language Processing. AI Knowledge: Familiarity with LangChain and LlamaIndex. The role involves using Large Language Models (LLMs) to build data models rather than building LLMs from scratch. Deployment: Must understand the deployment process and CI/CD practices to troubleshoot, though a dedicated engineering team handles the heavy lifting. Industry Knowledge: Experience with Risk Modeling or financial services is preferred.This is an urgent vacancy where the hiring manager is shortlisting for an interview immediately. Please apply with a copy of your CV or send it khushboo. pandey @ randstad. Co. uk Randstad Technologies is acting as an Employment Business in relation to this vacancy

Data Scientist (Government)
Hays Technology
London
Remote or hybrid
Mid - Senior
£300/day - £310/day

Your new company Working for a globally renowned consultancy (end client is a public sector organisation). Your new role We are offering an exciting opportunity for a Data Scientist to join our expanding AI delivery team. In this role, you will work hands-on as an AI engineer, data scientist, and developer, contributing to the design and delivery of strategic AI initiatives. You'll help build intelligent solutions, automate processes, and apply modern AI technologies to real business challenges within a public sector environment. What you'll need to succeed Must have lived in the UK for a minimum of 5 years (essential for security clearance checks). Experience with key AI platforms and tools, including: Microsoft Copilot / Copilot Studio Experience configuring or building AI-driven workflows, copilots, or automation solutions. Familiarity with prompt design, data integration, and governance within the Microsoft ecosystem is beneficial. AWS Bedrock Hands-on experience using Bedrock to access and apply foundation models for tasks such as text generation, summarisation, classification, or search. Understanding how to integrate Bedrock models into wider AWS services is advantageous. IBM ICA (Intelligent Content Analysis) - Desirable Useful experience with document understanding, processing unstructured data, and rule‑based or AI‑assisted content analysis. What you'll get in return Flexible working options available. What you need to do now If you're interested in this role, click 'apply now' to forward an up-to-date copy of your CV, or call us now. Hays Specialist Recruitment Limited acts as an employment agency for permanent recruitment and employment business for the supply of temporary workers. By applying for this job you accept the T&C's, Privacy Policy and Disclaimers which can be found at (url removed)

Test Engineer
Platform Recruitment
London
Remote or hybrid
Junior - Mid
£40,000 - £55,000

We’re representing a multinational advanced entertainment electronics company working with the likes of Netflix, Disney, and PL football teams. The culture is techy.

Profit-sharing, a good salary package and employee councils and working groups. They take care of their employees, and their engineers have clout. They’re working on driving forwards automation, including implementing agentic workflows.

They’re looking for a Software Test Engineer to help drive forward software automation for their software-driven electronics.

Responsibilities

  • Perform end-to-end quality assurance testing of software releases, from development through to production.
  • Investigate and reproduce reported faults, documenting findings clearly within the issue-tracking system.
  • Create structured, comprehensive test plans and detailed test cases for both manual and automated testing.
  • Design, develop and execute automation scripts to improve coverage and efficiency.
  • Collaborate with product management, developers and project teams to clarify requirements and feature specifications.
  • Contribute to improving QA methodologies, processes and overall testing effectiveness.

Requirements

  • Degree in a relevant engineering discipline with hands-on experience in software and embedded systems testing
  • Proven ability to troubleshoot complex technical issues, manage bug tracking and prioritise effectively across teams.
  • Strong communication skills, analytical mindset, attention to detail, and working knowledge of high-level languages (preferably Python).

Desirable

  • Interest or experience within live entertainment, lighting control or video processing environments.
  • Familiarity with version control systems such as Git and packet analysis tools (e.g. Wireshark).
  • Understanding of networking fundamentals and protocols including DMX-512, ArtNet and sACN.

If you’re naturally curious and like cool technology, apply now!

Overnight Application Support Analyst - FinTech
James Joseph Associates
London
Remote or hybrid
Junior - Mid
£25,000 - £60,000
+1

THE ROLE:Overnight Application Support Analyst

Our client is is a small dynamic FinTech company, Providing functional electronic services to support post-trade processing in the Securities Lending and Repo markets by providing services which perform faster and are

Our client is looking for an Overnight Application Support Analyst to join their growing team of experts. Note the working hours : Night shift APAC hours Sunday 11pm to 8am Monday morning all the way through to Thursday evening -Friday and Saturday will be the weekend.

Our Client offers the opportunity to work in a small but growing award-winning company with other skilled professionals, delivering to the highest standards and providing outstanding client service,where good work is both recognised and rewarded.

THE ROLE (DUTIES) :Overnight Application Support Analyst

The position is a UK Based role that provides UK Overnight Application support coverage for the APAC time-zone. During the first three month onboarding period, you will work UK daytime hours, while receiving comprehensive training and gaining full familiarity with the companies systems, processes and support procedures. On completion of the onboarding process, you will transition to the APAC support rotation, covering overnight hours from 23:00 to 08:00 (UK time) as part of the dedicated APAC support schedule. You will take the handover from the US based team at the start of your shift and

hand back to the UK team at the end of your shift.

Continuing our dynamic production support to

ensure a high quality of service to our clients. You will be fully trained to understand our

application and business in depth. Starting with a high-level overview of Securities Finance and the company s application, You will receive full assistance

from the support and development team as you progress to an expert in the field.

This is a unique opportunity to join a small company that is at the point of looking to

increase delivery capacity and product offering. You will also gain valuable experience in Technical Support and problem-solving ability.

  • The successful candidate with be responsible for monitoring the production and User Acceptance testing environments
  • Investigate, action and resolve issues impacting internal systems and clients.
  • You will be required to work independently and prioritise tasks in what can be a challenging environment at times.
  • Report common issues, analyse the root cause and prevent them from recurring.
  • You are required to be responsive to internal and external client queries and tickets.
  • On boarding of new services for new and existing clients.
  • Updating system configuration across environments.
  • Continuous improvements of the production service and team effectiveness.
  • Participating in Client Service and Technology meetings.
  • Handle production incidents and problem management activities related to the incident.

Challenges:

  • Develop a comprehensive understanding of the services provided and the associated benefits /value proposition for clients.
  • Gain an understanding of the complex technical structure of services, starting initially
  • at the top level, but with increasing depth over time.
  • Maintain and continually improve the exceptional quality of support that the company provides to clients (e.g. by being flexible, having a can do approach, executing smooth data integrations,understanding client issues)
  • Understand the risks associated with production issues, both to the client and to the company and prioritise issue resolution accordingly.
  • Improve support processes and procedures from a technical perspective
  • Become an expert in the Securities Finance business, company products and technology

SKILLS / EXPERIENCE REQUIRED: Overnight Application Support Analyst :

Experience with the below Technologies will be of advantage

  • Linux, Apache, MySQL, Perl, PHP
  • Monitoring and Alerting Systems
  • Ticketing / workflow Systems (e.g. Jira)

Essential Requirements:

  • A Good understanding of Unix/Linux and SQL knowledge
  • Ability to apply the right sense of urgency in a fast-paced environment
  • Highly motivated, punctual, organised, responsible and not afraid to ask questions or pick up the phone to clients
  • Enjoy both the responsive and proactive elements of the support role
  • Enjoy solving complex problems
  • Strong Technical ability for complex issue resolution and prioritisation
  • Ability to communicate effectively, especially during incidents

Disirable Requirements:

Knowledge of encryption protocols and browser security PGP

Customer Service or Client Interaction

Development experience

Knowledge of file transfer protocols (i.e. FTP/SFTP)

Experience with networking and firewalls

Senior Data Scientist
RCRTR
Birmingham
Remote or hybrid
Senior
£400/day - £450/day

400 per day - inside IR35

Are you an expert in Natural Language Processing who thrives on building scalable, real-world AI solutions? We are seeking a hands-on Data Scientist to join a premier global credit ratings and financial information firm. You will be a key player in launching a brand-new, from-scratch analytics platform designed for elite institutional clients including corporate banks and asset managers.

The Opportunity

In this role, you will go beyond conventional boundaries to design, build, and deploy quantitative models that power advanced insights. You will collaborate with a cross-domain team of economists, political scientists, and developers to transform proprietary risk data into actionable strategic assets.

Your Impact

  • Model Innovation: Design and optimize risk models for analytics and generative AI applications using proprietary NLP data generation processes.
  • Pipeline Development: Develop and maintain robust ML and data pipelines for experimentation and deployment.
  • Insight Extraction: Prototype and test new approaches for extracting insights from structured and unstructured data.
  • Technical Translation: Explain ML/NLP model outputs and methodologies to non-technical stakeholders to drive strategic decisions.

Your Experience

  • Experience Level: 5-7+ years (More experience is welcomed).
  • Core Technicals: High expertise in Python and Machine Learning (ML).
  • NLP Expertise: 3-5 years of experience in Natural Language Processing.
  • AI Knowledge: Familiarity with LangChain and LlamaIndex. The role involves using Large Language Models (LLMs) to build data models rather than building LLMs from scratch.
  • Deployment: Must understand the deployment process and CI/CD practices to troubleshoot, though a dedicated engineering team handles the heavy lifting.
Data Scientist (NLP & LLM Specialist)
Randstad Technologies Recruitment
London
Fully remote
Mid - Senior
£400/day - £565/day

Data Scientist (NLP & LLM Specialist)Remote- UK6-month contract with Potential ExtensionDay rate - 427.68 - 565 per day Inside IR35

Data Scientist (NLP & LLM Specialist)

Are you an expert in Natural Language Processing who thrives on building scalable, real-world AI solutions? We are seeking a hands-on Data Scientist to join a premier global credit ratings and financial information firm. You will be a key player in launching a brand-new, from-scratch analytics platform designed for elite institutional clients including corporate banks and asset managers.

The Opportunity

In this role, you will go beyond conventional boundaries to design, build, and deploy quantitative models that power advanced insights. You will collaborate with a cross-domain team of economists, political scientists, and developers to transform proprietary risk data into actionable strategic assets.

Your Impact

  • Model Innovation: Design and optimize risk models for analytics and generative AI applications using proprietary NLP data generation processes.
  • Pipeline Development: Develop and maintain robust ML and data pipelines for experimentation and deployment.
  • Insight Extraction: Prototype and test new approaches for extracting insights from structured and unstructured data.
  • Technical Translation: Explain ML/NLP model outputs and methodologies to non-technical stakeholders to drive strategic decisions.

Your Experience

  • Experience Level: 5-7+ years (More experience is welcomed).
  • Core Technicals: High expertise in Python and Machine Learning (ML).
  • NLP Expertise: 3-5 years of experience in Natural Language Processing.
  • AI Knowledge: Familiarity with LangChain and LlamaIndex. The role involves using Large Language Models (LLMs) to build data models rather than building LLMs from scratch.
  • Deployment: Must understand the deployment process and CI/CD practices to troubleshoot, though a dedicated engineering team handles the heavy lifting.
  • Industry Knowledge: Experience with Risk Modeling or financial services is preferred.

This is an urgent vacancy where the hiring manager is shortlisting for an interview immediately. Please apply with a copy of your CV or send it khushboo. Co. uk

Randstad Technologies is acting as an Employment Business in relation to this vacancy.

Business Development Manager
De Lacy Executive
Scotland
Remote or hybrid
Mid - Senior
Private salary

Are you a technically minded machinery salesperson with a background in Dairy Farming or the AD sector? Our client, a UK leading Dairy equipment manufacturer, is looking for a Business Development Manager to grow their dealership network, and improve product distribution across the North of the UK and Scotland. You will be the technical and commercial link between the factory and dealership. You'll oversee all current relationships with dealerships and help make connections with potential new distributors. You'll get to represent a premium brand, and will need to know the products back-to-front. The role will give you plenty of independence. Ideally you'd be well connected across the agricultural machinery dealership network in the north and have an in-depth understanding of the Dairy equipment market; you also help gather industry information to inform the company's commercial strategy. Key Responsibilities: Identify and build new business relationships across the north of England and into Scotland Collaborate with sales, marketing and senior management teams. Manage and maintain strong relationships with dealers, distributors, and key accounts. Develop and implement strategic plans to grow market share and increase brand visibility. Attend trade shows, exhibitions, and on-farm demos to showcase product range. Offer market insights to inform product development and marketing efforts. Show potential clients around market-leading manufacturing facility Immediately take on and manage responsibilities for 20+ key accounts. Ensure excellent customer support and service delivery. Your profile: Proven agricultural machinery sales experience would be a clear advantage. Recent technical sales experience in an allied sector is a minimum requirement. An existing ledger would be preferred. Sound technical understanding/interest in agricultural machinery. Ability to drive sales growth. Build longstanding customer relationships. Embrace and contribute towards a strong team ethic. Full driving license. Remunerations: Competitive base salary + bonus + commission. Company vehicle or car allowance. Career development potential + consistent CPD opportunities. 28 days of Annual Leaves + Bank Holidays How to apply: For more information and an informal confidential discussion please call Rupert Kettle on: / or e-mail your CV (in word format) and covering letter to , thank you. De Lacy Executive Recruitment will upload your CV to our database and retain some data about you in order to process your application. More information about our processing activities can be found at Please be assured that all contact is treated in complete confidence and your details will not be passed to a third party without your prior permission. Please note that this advertisement is not a job description and you should satisfy yourself about the full details at interview. De Lacy Executive Recruitment is an Approved member of the Recruitment and Employment Confederation, which promotes high standards in recruitment practice, and is registered with the Information Commissioners Office. De Lacy Executive Recruitment complies with all relevant data protection legislation.

Data Engineer
BGTS LTD
London
Remote or hybrid
Mid - Senior
£60,000 - £70,000

As a Data Engineer, you will be responsible for:

Data Engineering & Development

  • Design, build, and maintain high-quality, scalable, and tested data pipelines.
  • Develop and manage Databricks structured streaming pipelines.
  • Build and optimize event-driven and real-time data processing solutions.
  • Implement and maintain Unity Catalog-based Lakehouse architecture.
  • Develop analytics-ready datasets to support business insights and reporting.

Platform & Automation

  • Build and manage CI/CD pipelines using Azure DevOps.
  • Identify and implement automation opportunities across workflows.
  • Ensure reliable and stable data platform operations.
  • Apply governance, security, and documentation standards.

Data Quality & Reliability

  • Establish the Data Lakehouse as a trusted and reliable source of truth.
  • Monitor, troubleshoot, and resolve data incidents.
  • Support business users and technical teams with data-related queries.
  • Continuously improve platform performance and reliability.

Collaboration & Support

  • Work closely with data science, analytics, platform, and business teams.
  • Champion data engineering best practices.
  • Provide technical guidance and mentorship where required.
  • Contribute to a culture of learning, quality, and continuous improvement.

Essential Skills

  • Strong experience with Azure Databricks and cloud data platforms.
  • Advanced proficiency in Python, PySpark, and SQL.
  • Experience developing Spark/Databricks pipelines.
  • Hands-on experience with structured streaming and event-driven systems.
  • Strong understanding of Lakehouse architecture and best practices.
  • Experience with Unity Catalog.
  • Expertise in Azure DevOps and CI/CD pipelines.
  • Knowledge of data modelling (dimensional/star schemas).
  • Experience working in Agile environments.

Desirable Skills

  • Exposure to multiple data technology stacks.
  • Experience in large-scale enterprise environments.
  • Knowledge of security, governance, and compliance frameworks.
Audio Machine Learning Engineer
Enterprise Recruitment Ltd
London
Remote or hybrid
Mid - Senior
£50,000 - £90,000

A growing technology team is developing a new generation of intelligent, audio-driven products designed to interpret real-world acoustic environments and generate meaningful insight. As development accelerates, they are seeking an Audio Machine Learning Engineer to shape how sound is analysed, classified, and translated into useful information across edge and cloud platforms.

The Opportunity Working alongside embedded, hardware, and software specialists, you will contribute to the full lifecycle of audio intelligence, from dataset strategy and model design through to optimisation and deployment.

The role offers genuine ownership and the chance to influence core technology within a product-focused engineering environment.

Required:

Core experience

  • Strong grounding in audio machine learning or applied signal processing
  • Experience training and evaluating models using modern ML tooling
  • Awareness of real-world acoustic challenges such as noise, reverberation, and variability
  • Comfort working in a small, fast-moving engineering team
  • Likely a PhD or MSc + some industry experience

Beneficial

  • Edge or embedded ML optimisation
  • Audio feature extraction or DSP knowledge
  • Postgraduate study in a relevant technical discipline
  • Experience with sensing, monitoring, or real-world data systems
Business Development Manager
Nicholas Associates
Yorkshire
Fully remote
Mid - Senior
£50,000 - £55,000

Position: Business Development Manager

Location: Remote

Salary: c 50K + car + bonus + laptop/phone/expenses

Nicholas Associates has an excellent opportunity for a Business Development Manager to join an established & growing client within the fabricated metals sector.

Reporting in to the Sales Director, you will be responsible for generating new business leads, managing enquiries & customer visits, processing quotes through the estimation office & subsequent follow up. There is an existing base of lapsed clients that require revisiting & developing however, the role is biased more towards growth of new business.

Experience in the following industries is preferred, metals, fabrication, recycling (glass/metals) biomass, aggregates (cement, quarry), renewable energy. You will also have a technical/engineering background & the ability to build credible discussion with Maintenance Managers, Project Engineers & Engineering Managers.

You will have a solid understanding of business & marketing principles, with the ability to create strategies to reach new business opportunities, new markets & new clients. You will be a strong relationship builder, accurately gauging customer ‘pain points’ & approaching those with a solutions-based perspective.

About Us

We are dedicated to fostering a diverse and inclusive community. In line with our Diversity and Inclusion policy, we welcome applications from all qualified individuals, regardless of age, gender, ethnicity, sexual orientation, or disability. As a Disability Confident Employer, and part of the Nicholas Associates Group, we are committed to supporting candidates with disabilities, and we’re happy to discuss flexible working options.

We are committed to protecting the privacy of all our candidates and clients. If you choose to apply, your information will be processed in accordance with the Nicholas Associates Group of companies Privacy Notice.

Lead PySpark Engineer - Data, SAS, AWS
Randstad Technologies Recruitment
London
Remote or hybrid
Senior
£350/day - £380/day

Lead Data Engineer - Pyspark / AWS / Python / SAS - Financial Sector

As a Lead PySpark Engineer, you will design, develop, and fix complex data processing solutions using PySpark on AWS. You will work hands-on with code, modernising legacy data workflows and supporting large-scale SAS-to-PySpark migrations. The role requires strong engineering discipline, deep data understanding, and the ability to deliver production-ready data pipelines in a financial services environment.

Essential Skills

PySpark & Data Engineering

  • Minimum 5+ years of hands-on PySpark experience.
  • SAS to Pyspark migration experience
  • Proven ability to write production-ready PySpark code.
  • Strong understanding of data and data warehousing concepts, including: ETL/ELT, Data models, Dimensions and facts, Data marts, SCDs

Spark Performance & Optimisation

  • Strong knowledge of Spark execution concepts, including partitioning, optimisation, and performance tuning.
  • Experience troubleshooting and improving distributed data processing pipelines.
  • Python & Engineering Quality
  • Strong Python coding skills with the ability to refactor, optimise, and stabilise existing codebases.
  • Experience implementing parameterisation, configuration, logging, exception handling, and modular design.

SAS & Legacy Analytics

  • Strong foundation in SAS (Base SAS, SAS Macros, SAS DI Studio).
  • Experience understanding, debugging, and modernising legacy SAS code.

Data Engineering & Testing

  • Ability to understand end-to-end data flows, integrations, orchestration, and CDC.
  • Experience writing and executing data and ETL test cases.
  • Ability to build unit tests, comparative testing, and validate data pipelines.

Engineering Practices

  • Proficiency in Git-based workflows, branching strategies, pull requests, and code reviews.
  • Ability to document code, data flows, and technical decisions clearly.
  • Exposure to CI/CD pipelines for data engineering workloads.

AWS & Platform Skills

  • Strong understanding of core AWS services, including: S3, EMR / Glue, Workflows, Athena, IAM
  • Experience building and operating data pipelines on AWS.
  • Big data processing on cloud platforms.

Desirable Skills

  • Experience in banking or financial services.
  • Experience working on SAS modernisation or cloud migration programmes.
  • Familiarity with DevOps practices and tools.
  • Experience working in Agile/Scrum delivery environments.

I have three roles available all of which can be worked remotely so dont delay and apply today. I have interview slots ready to be filled

Randstad Technologies is acting as an Employment Business in relation to this vacancy.

Frequently asked questions
Haystack features a variety of remote processing jobs including data processing, payment processing, image processing, and workflow automation roles across multiple industries.
Simply create an account, upload your resume, and submit your application directly through the job listing page. You'll be able to track your applications in your Haystack dashboard.
Many remote processing jobs on Haystack are open to international candidates, but eligibility depends on the employer's requirements. Check each job listing for specific location and work authorization details.
Common skills include proficiency with data management software, experience with processing systems (e.g., payment gateways, image processing tools), attention to detail, problem-solving abilities, and strong communication skills.
Yes, Haystack allows you to set up personalized job alerts based on your criteria such as job title, keywords, or location to receive notifications when new remote processing jobs are posted.