Lead AWS Data Engineer | Birmingham | Finance | AWS | Java | Outside IR35 | Contract | 12 Months Opus is partnered with financial services client to deliver a major programme of work. You’ll join an established engineering group, working alongside internal teams to build a new reporting workflow, upgrade an existing pipeline, and lead a full data‑sourcing uplift across multiple reporting workflows. The team will also be responsible for helping upgrade the framework for two critical internal workflows. This role will require you to be on site in either the London or Birmingham office 5 days per week, please only apply if you hit this criteria. Required Experience Strong background in data engineering within distributed data environments Hands-on expertise with AWS, Spark, Glue, and Snowflake Experience building and optimising data pipelines & reporting workflows Ability to work closely with internal engineering and controls teams Experience upgrading or modernising existing workflows and frameworks For Lead-level: prior experience leading engineering teams or workstreamsTech Stack AWS (Glue, S3, Lambda, Step Functions) Apache Spark Snowflake Java if you are interested in this role then please apply here or email me your most recent and up to date CV, along with your availability  to (url removed) Lead AWS Data Engineer | Birmingham | Finance | AWS | Java | Outside IR35 | Contract | 12 Months

We are looking for experienced Data Engineers to join a long-standing, high-impact public sector partnership. This isn’t just about moving data; it’s about modernizing essential services and delivering secure, reliable data products at scale. You will play a pivotal role in shaping engineering design, mentoring talent, and helping our clients reimagine what’s possible through technology. Data Engineer (AWS) Location: Telford / Worthing Base Locations (Hybrid 2-3 days onsite) Salary: £55,000 - £70,000 + Bens, Perks, Healthcare Options, Unlimited Training Budget Security Clearance: Must be eligible for SC Clearance (5+ years UK residency) Sector: Public Sector & Government Client Build the Data Infrastructure That Powers the Public Sector We are looking for experienced Data Engineers to join a long-standing, high-impact public sector partnership. This isn’t just about moving data; it’s about modernizing essential services and delivering secure, reliable data products at scale. You will play a pivotal role in shaping engineering design, mentoring talent, and helping our clients reimagine what’s possible through technology. The Role As a Senior member of our engineering team, you will: Design & Implement: Create robust, secure, and performant data integration solutions (both batch and near-real-time). Build & Optimize: Develop and improve end-to-end data pipelines-from ingestion to curation-ensuring high availability through rigorous monitoring and alerting. Collaborate: Work closely with product teams and client stakeholders to align technical decisions with cost, performance, and security requirements. Innovate: Support incident resolution and contribute to our internal Engineering Communities of Practice. Lead: Actively participate in Agile ceremonies and mentor junior colleagues to grow our collective capability.Your skills and experience ​ Strong SQL and hands-on experience with data modelling. Hands-on with ETL/ELT tooling (at least one of Talend, Pentaho DI, Informatica, AWS Glue, or SAS). Experience with databases/data platforms (ideally Oracle or Cloudera) Knowledge of cloud platforms (ideally AWS) Good experience with programming/scripting languages (e.g. Python, Bash). Strong grasp of data engineering fundamentals, including integration, transformation, orchestration, and version control. Excellent client-facing and consultancy skills.NOTE: This role requires Security Check (SC) clearance. To be eligible, you must have resided continuously in the UK for the last 5 years. Interested? Apply now or send your CV

Skill Profile

• PySpark - Advanced (P3)
• AWS - Advanced (P3)
• SAS - Foundational (P1)

Key Responsibilities Technical Delivery

• Design, develop, and maintain complex PySpark solutions for ETL/ELT and data mart workloads.
• Convert and refactor Legacy SAS code into optimized PySpark solutions using automated tooling and manual refactoring techniques.
• Build scalable, maintainable, and production-ready data pipelines.
• Modernize Legacy data workflows into cloud-native architectures.
• Ensure data accuracy, quality, integrity, and reliability across transformation processes.

Cloud & Data Engineering (AWS-Focused)

• Develop and deploy data pipelines using AWS services such as EMR, Glue, S3, and Athena.
• Optimize Spark workloads for performance, scalability, partitioning strategy, and cost efficiency.
• Implement CI/CD pipelines and Git-based version control for automated deployment.
• Collaborate with architects, engineers, and business stakeholders to deliver high-quality cloud data solutions.

Core Technical Skills PySpark & Data Engineering

• 5+ years of hands-on PySpark experience (Advanced level).

• Strong ability to write production-grade, maintainable data engineering code.

• Solid understanding of:

  • ETL/ELT design patterns
  • Data modelling concepts
  • Fact and dimension modelling
  • Data marts
  • Slowly Changing Dimensions (SCDs)

Spark Performance & Optimization

• Expertise in Spark execution planning, partitioning strategies, and performance tuning.
• Experience troubleshooting distributed data pipelines at scale.

Python & Engineering Quality

• Strong Python programming skills with emphasis on clean, modular, and maintainable code.

• Experience applying engineering best practices including:

  • Parameterization
  • Configuration management
  • Structured logging
  • Exception handling
  • Modular design principles

SAS & Legacy Analytics (Foundational)

• Working knowledge of Base SAS, Macros, and DI Studio.
• Ability to interpret and analyze Legacy SAS code for migration to PySpark.

Data Engineering & Testing

• Understanding of end-to-end data flows, orchestration frameworks, pipelines, and change data capture (CDC).
• Experience creating ETL test cases, unit tests, and data comparison/validation frameworks.

Engineering Practices

• Proficient in Git workflows, branching strategies, pull requests, and code reviews.
• Ability to document technical decisions, architecture, and data flows.
• Experience with CI/CD tooling for data engineering pipelines.

AWS & Platform Expertise (Advanced)

Strong hands-on experience with:

• Amazon S3
• EMR and AWS Glue
• Glue Workflows
• Amazon Athena
• IAM
• Solid understanding of distributed computing and big data processing in AWS environments.
• Experience deploying and operating large-scale data pipelines in the cloud.

Desirable Experience

• Experience within banking, financial services, or other regulated industries.
• Background in SAS modernization or cloud migration programs.
• Familiarity with DevOps practices and infrastructure-as-code tools such as Terraform or CloudFormation.
• Experience working in Agile or Scrum delivery environments.

Data Engineer -Government Project

SC Clearance Required

Day Rate:£460 per day inside IR35

Contract Length:6 months

Location:Telford- 2 days per month (Mostly remote)

Job Description:

We are seeking experiencedData Engineersto join a growing team within a large, long-standing public sector partnership. In this pivotal role, you will contribute to data acquisition, preparation, and management initiatives that help modernise services and deliver secure, reliable data products at scale.

This is an exciting opportunity to influence engineering design, build capability across teams, and deliver tangible value for public sector clients.

Key Responsibilities

• Design and implement robust, secure, and high-performance data integration solutions (batch and/or near-Real Time).
• Build, operate, and continuously improve data pipelines covering ingestion, transformation, and curation, with appropriate monitoring, alerting, and SLAs.
• Collaborate closely with product teams and client stakeholders to refine requirements and align technical decisions with non-functional requirements (cost, performance, security).
• Support incident resolution activities and ensure ongoing service continuity.
• Share knowledge, mentor colleagues, and contribute to engineering communities of practice.
• Actively participate in Agile ceremonies and work cross-functionally with engineers, analysts, and business teams.

Skills and Experience

• Strong SQL skills with hands-on experience in data modelling.
• Hands-on experience with ETL/ELT tooling, including at least one of: Talend, Pentaho DI, Informatica, AWS Glue, or SAS.
• Experience working with databases and data platforms, ideally Oracle or Cloudera.
• Knowledge of cloud platforms, ideally AWS.
• Good experience with programming and Scripting languages such as Python and Bash.
• Strong understanding of data engineering fundamentals, including integration, transformation, orchestration, and version control.
• Excellent client-facing and consultancy skills.

If this role aligns with your skills and experience, and you’re looking to contribute to meaningful public sector data programmes, we’d love to hear from you. Apply today to be considered.

Data Platform Engineer – London

(AWS, Apache Spark, AWS Glue, Iceberg, S3, RDS, Redshift, Kafka/MSK, Python, Terraform, Ansible, CI/CD, Jenkins, GitLab, Snowflake, Databricks)

Working with an established FinTech client in London who is looking for a Data Platform Engineer to play a key role in defining, building, and evolving their enterprise Data Lakehouse platform during an exciting period of growth. You’ll work closely with Platform Engineering and Application Engineering teams, taking ownership of the infrastructure, patterns, standards,and tooling used to build and operate data products across the business.

The role focuses on ensuring the data platform is resilient,secure, reliable, and cost-effective within an AWS environment. You’ll be responsible for how the platform is operated, maintained, monitored, and extended, with a strong emphasis on observability, fault prevention, and early fault detection across AWS data services.

Automation is central to the way this team works. You’ll design and maintain Infrastructure as Code and Configuration as Code solutions, supported by CI/CD pipelines, to ensure consistent, repeatable deployments and strong governance. You’ll also enhance data lake integration testing, security measures, monitoring, SLAs, and operational metrics.

Working for a tech driven organisation in a collaborative environment, for an organisation that values engineering that values engineering best practises! This client Is offering this role on hybrid basis, looking to be in the office few times per month.

For more information, please get in touch

Job Title: AWS Support Engineer / Data Engineer
Location: Ipswitch (onsite)
Job Type: Permanent

Job Summary:

AWS Support Engineer / Data Engineer Telecom Domain (JD)

• Key Skills & Expertise

• AWS Core Services: S3, Redshift, Glue, Athena, Lake Formation, IAM

• Data Engineering / ETL:

• Building and optimizing ETL pipelines

• Data ingestion, transformation & orchestration using AWS Glue (PySpark/Python)

• Working with structured/semi-structured telecom datasets (CDRs, network logs, subscriber data)

• Data Lake Technologies:

• Expertise in Apache Iceberg table format

• Schema evolution, partitioning, compaction & metadata management

• Query performance tuning with Athena & Redshift Spectrum

• Redshift Expertise:

• Data modeling, distribution styles, sort keys

• Workload management (WLM)

• Performance optimization & troubleshooting

• Python:

• Automation scripts

• Data processing workflows

• Monitoring, debugging, validation scripts

• AWS Support / Operations:

• Troubleshooting ETL failures, performance bottlenecks, pipeline issues

• Monitoring cloud workloads (CloudWatch, CloudTrail)

• Handling incidents, root-cause analysis (RCA), patching & releases

• Cost optimization and resource usage tracking

• Telecom Domain:

• Experience with OSS/BSS systems

• Understanding of CDR processing, network KPIs, subscriber analytics

• Data quality checks for telecom data pipelines

• Roles & Responsibilities

• Provide L2/L3 support for AWS-based data platforms in the telecom domain.

• Maintain and enhance ETL pipelines built on Glue + Iceberg + Athena + Redshift.

• Monitor production jobs, fix failures, optimize queries, and ensure SLA adherence.

• Develop automation for operational workflows using Python.

• Collaborate with data architects, business teams, and network teams for data requirements.

• Implement best practices for data governance, security, and cost management.

• Support migrations from legacy systems to AWS-native data lakes or Redshift.

• Ideal Candidate Profile

• 3 10+ years of experience in AWS Data Engineering / Support Engineering.

• Strong telecom domain understanding.

• Hands-on with Iceberg, Athena, Glue (PySpark), Python, Redshift, S3, ETL frameworks.

• Strong troubleshooting mindset and ability to work in 24 7 or rotational support environments (if required).

Location: Telford / Worthing Base Locations (Hybrid 2-3 days onsite)
Salary: £50,000 - £60,000 + Bens, Perks, Healthcare Options, Unlimited Training Budget
Security Clearance: Must be eligible for SC Clearance (5+ years UK residency)
Sector: Public Sector & Government Client

Build the Data Infrastructure That Powers the Public Sector

We are looking for experienced Data Engineers to join a long-standing, high-impact public sector partnership. This isn’t just about moving data; it’s about modernizing essential services and delivering secure, reliable data products at scale. You will play a pivotal role in shaping engineering design, mentoring talent, and helping our clients reimagine what’s possible through technology.

The Role

As a Senior member of our engineering team, you will:

• Design & Implement: Create robust, secure, and performant data integration solutions (both batch and near-real-time).
• Build & Optimize: Develop and improve end-to-end data pipelines-from ingestion to curation-ensuring high availability through rigorous monitoring and alerting.
• Collaborate: Work closely with product teams and client stakeholders to align technical decisions with cost, performance, and security requirements.
• Innovate: Support incident resolution and contribute to our internal Engineering Communities of Practice.
• Lead: Actively participate in Agile ceremonies and mentor junior colleagues to grow our collective capability.

Your skills and experience ?

• Strong SQL and hands-on experience with data modelling.
• Hands-on with ETL/ELT tooling (at least one of Talend, Pentaho DI, Informatica, AWS Glue, or SAS).
• Experience with databases/data platforms (ideally Oracle or Cloudera)
• Knowledge of cloud platforms (ideally AWS)
• Good experience with programming/scripting languages (e.g. Python, Bash).
• Strong grasp of data engineering fundamentals, including integration, transformation, orchestration, and version control.
• Excellent client-facing and consultancy skills.

NOTE: This role requires Security Check (SC) clearance. To be eligible, you must have resided continuously in the UK for the last 5 years.

Location: Telford / Worthing Base Locations (Hybrid 2-3 days onsite)

Salary: £50,000 - £60,000 + Bens, Perks, Healthcare Options, Unlimited Training Budget

Security Clearance: Must be eligible for SC Clearance (5+ years UK residency)

Sector: Public Sector & Government Client

Build the Data Infrastructure That Powers the Public Sector

We are looking for experienced Data Engineers to join a long-standing, high-impact public sector partnership. This isn’t just about moving data; it’s about modernizing essential services and delivering secure, reliable data products at scale. You will play a pivotal role in shaping engineering design, mentoring talent, and helping our clients reimagine what’s possible through technology.

The Role

As a Senior member of our engineering team, you will:

Design & Implement: Create robust, secure, and performant data integration solutions (both batch and near-real-time).

Build & Optimize: Develop and improve end-to-end data pipelines-from ingestion to curation-ensuring high availability through rigorous monitoring and alerting.

Collaborate: Work closely with product teams and client stakeholders to align technical decisions with cost, performance, and security requirements.

Innovate: Support incident resolution and contribute to our internal Engineering Communities of Practice.

Lead: Actively participate in Agile ceremonies and mentor junior colleagues to grow our collective capability.

Your skills and experience ?

Strong SQL and hands-on experience with data modelling.

Hands-on with ETL/ELT tooling (at least one of Talend, Pentaho DI, Informatica, AWS Glue, or SAS).

Experience with databases/data platforms (ideally Oracle or Cloudera)

Knowledge of cloud platforms ( ideally AWS )

Good experience with programming/scripting languages (e.g. Python, Bash).

Strong grasp of data engineering fundamentals, including integration, transformation, orchestration, and version control.

Excellent client-facing and consultancy skills.

NOTE: This role requires Security Check (SC) clearance . To be eligible, you must have resided continuously in the UK for the last 5 years.

TPBN1_UKTJ

Job Title: AWS Support Engineer / Data Engineer

Location: Ipswitch (onsite)

Job Type: Permanent

Job Summary: AWS Support Engineer / Data Engineer Telecom Domain (JD)

Key Skills & Expertise

AWS Core Services : S3, Redshift, Glue, Athena, Lake Formation, IAM

Data Engineering / ETL:

Building and optimizing ETL pipelines

Data ingestion, transformation & orchestration using AWS Glue (PySpark/Python)

Working with structured/semi-structured telecom datasets (CDRs, network logs, subscriber data)

Data Lake Technologies:

Expertise in Apache Iceberg table format

Schema evolution, partitioning, compaction & metadata management

Query performance tuning with Athena & Redshift Spectrum

Redshift Expertise:

Data modeling, distribution styles, sort keys

Workload management (WLM)

Performance optimization & troubleshooting

Python:

Automation scripts

Data processing workflows

Monitoring, debugging, validation scripts

AWS Support / Operations:

Troubleshooting ETL failures, performance bottlenecks, pipeline issues

Monitoring cloud workloads (CloudWatch, CloudTrail)

Handling incidents, root-cause analysis (RCA), patching & releases

Cost optimization and resource usage tracking

Telecom Domain:

Experience with OSS/BSS systems

Understanding of CDR processing, network KPIs, subscriber analytics

Data quality checks for telecom data pipelines

Roles & Responsibilities

Provide L2/L3 support for AWS-based data platforms in the telecom domain.

Maintain and enhance ETL pipelines built on Glue + Iceberg + Athena + Redshift.

Monitor production jobs, fix failures, optimize queries, and ensure SLA adherence.

Develop automation for operational workflows using Python.

Collaborate with data architects, business teams, and network teams for data requirements.

Implement best practices for data governance, security, and cost management.

Support migrations from legacy systems to AWS-native data lakes or Redshift.

Ideal Candidate Profile

3 10+ years of experience in AWS Data Engineering / Support Engineering.

Strong telecom domain understanding.

Hands-on with Iceberg, Athena, Glue (PySpark), Python, Redshift, S3, ETL frameworks.

Strong troubleshooting mindset and ability to work in 24 7 or rotational support environments (if required).

TPBN1_UKTJ

Role DetailsRole / Job Title:Data Architect SeniorJob Type:ContractingLocation:Glasgow (5 days onsite)Role Administration DetailsRole OverviewWe are seeking an experienced Senior Data Architect to join our Market Data Services team, focusing on our high-impact 3rd Party Data Project. This is a contract role for an initial 6-month period, based in our Glasgow office, with full-time onsite presence required.As a key member of the team, you will play a pivotal role in modelling currently available data, defining and structuring new data catalogues of marketplace data products, and validating existing contracts and data usage rights. Your expertise in RDF data and data architecture will be essential as you review and enhance our data management practices, develop new data architecture policies, and strategically structure data flows for the project.You will be working within an Agile project environment, participating in two-week sprint cycles, and collaborating closely with cross-functional teams to deliver high-quality solutions. The Engineering Team develop predominantly be in Python, with Pandas and SPARQ Data frames for backend APIs, and with JavaScript with React for the front end and an understanding of these technologies is beneficial.Key Responsibilities

• Model and structure currently available marketplace data and define new data catalogs.
• Validate existing data contracts and usage rights, ensuring compliance and optimal utilization.
• Review current data management practices and develop robust, future-proof data architecture policies.
• Design and implement strategic data flows for the 3rd Party Data Project.
• Work extensively with RDF data, leveraging SPARQL for graph queries and data models.
• Utilize SQL for Oracle databases and No-SQL DSL for ElasticSearch to manage and query data.
• Collaborate with stakeholders to ensure data solutions align with business and regulatory requirements.
• Actively participate in Agile ceremonies and two-week sprint cycles.

Required Skills & Experience

• Proven experience in data architecture and data modeling within professional services or contract environments.
• Strong hands-on expertise with RDF data and SPARQL graph query languages.
• Deep familiarity with W3C standards for data modeling and interoperability.
• Experience with AWS Neptune, AWS Glue, ElasticSearch, and Oracle database products.
• Proficient in SQL for Oracle and No-SQL DSL for ElasticSearch.
• Demonstrated ability to validate data contracts and usage rights.
• Experience working in Agile teams.
• Track record of developing and implementing data management policies and best practices.
• Excellent communication and stakeholder management skills.
• Managing expectations of non-technical stakeholders.

Good to Have (As Applicable)

• Familiar with AWS via hands on experience or certification
• Familiarity with orchestration tools like Airflow
• Familiarity with BASEL regulatory reporting framework
• Familiarity with engineering in a regulatory controlled environmen

Pyspark Engineer- (Data Engineering, AWS GLUE) SC Cleared OR Eligible
Stevenage (Hybrid) 2-3 days onsite
Up to 80,000
High-impact programme - Revolutionary platform

I am looking for a Pyspark expert to take the reins on a range of highly ambitious Data Migration projects supporting a range of truly high-impact programmes across the UK.

This is a unique opportunity to work on cutting-edge cloud, software, and infrastructure projects that shape the future of technology in both public and private sectors. You’ll be part of a collaborative team delivering scalable, next-generation digital ecosystems

What you’ll be doing?

As a Developer within our Centre of Excellence, you will play a critical role in delivering complex data migration and data engineering projects for our clients. This position focuses on the planning, execution, and optimisation of data migrations from legacy platforms to modern cloud-based environments ensuring accuracy, consistency, security, and continuity throughout the process

Key Responsibilities

• Analyse existing data structures and understand business and technical requirements for migration initiatives.

• Design and deliver robust data migration strategies and ETL solutions.

• Develop automated data extraction, transformation, and loading (ETL) processes using industry-standard tools and scripts.

• Work closely with stakeholders to ensure seamless migration and minimal business disruption.

• Plan, coordinate, and execute data migration projects within defined timelines.

• Ensure the highest standards of data quality, integrity, and security.

• Troubleshoot and resolve data-related issues promptly.

• Collaborate with wider engineering and architecture teams to ensure migrations align with organisational and regulatory standards.

  Relevant exposure;

• Strong hands-on experience with ETL processes and tools (Talend, Informatica, Matillion, Pentaho, MuleSoft, Boomi) or scripting using Python, PySpark, and SQL.

• Proficient-level SQL skills for complex query development, performance tuning, indexing, and data transformation across on-premise databases and AWS cloud environments.

• Solid understanding of data warehousing and modelling techniques (Star Schema, Snowflake Schema).

• Familiarity with security frameworks such as GDPR, HIPAA, ISO 27001, NIST, SOX, and PII, as well as AWS security features including IAM, KMS, and RBAC.

• Ability to identify and resolve data quality issues across migration projects.

Strong track record of delivering end-to-end data migration projects and working effectively with both technical and non-technical stakeholders.

Salary up to 80,000 plus wider benefits - Contact me today for further insight (url removed).

Modis International Ltd acts as an employment agency for permanent recruitment and an employment business for the supply of temporary workers in the UK. Modis Europe Ltd provide a variety of international solutions that connect clients to the best talent in the world. For all positions based in Switzerland, Modis Europe Ltd works with its licensed Swiss partner Accurity GmbH to ensure that candidate applications are handled in accordance with Swiss law.

Both Modis International Ltd and Modis Europe Ltd are Equal Opportunities Employers.

By applying for this role your details will be submitted to Modis International Ltd and/ or Modis Europe Ltd. Our Candidate Privacy Information Statement which explains how we will use your information is available on the Modis website.