Role: Data Engineer (Automation)
Location: Milton Keynes (Hybrid 3 Days In-Office Weekly)
Salary: £45,000 - £55,000
Network IT are supporting a large, enterprise-scale organisation as they continue to evolve and modernise their Data Analytics and Automation Platform ; were looking for an experienced Data Engineer to design, build, and optimise secure, automated data pipelines that enable scalable analytics, business intelligence, and data-driven decision-making across multiple business units.
This is a highly technical role with strong exposure to cloud and on-prem data platforms , automation, and emerging AI-driven capabilities, and is specifically suited to candidates with strong, hands-on data engineering experience , particularly in building, operating, and optimising complex data pipelines, data models, and integration workflows at scale.
Role Overview and Responsibilities
As a Data & Automation Engineer , you will be responsible for the end-to-end delivery, operation, and continuous improvement of enterprise data pipelines and analytics platforms. Youll work closely with architects, application managers, and international teams to ensure data solutions are reliable, scalable, and aligned with data governance standards.
Key responsibilities include:
Designing, developing, and maintaining automated end-to-end data pipelines across cloud and on-premise source systems.
Delivering reliable data ingestion, transformation, and delivery processes using technologies such as Azure Data Factory, Databricks, SSIS, and SQL .
Reducing manual interventions through automation and standardisation , including data preparation, feature engineering, and training-data pipelines.
Preparing data models and datasets (DWH / Lakehouse) to support business intelligence, analytics, and operational reporting.
Monitoring and supporting live data pipelines, resolving issues in line with ITIL best practices , and implementing proactive alerting and self-healing mechanisms.
Identifying and implementing performance optimisations across data pipelines, queries, and reporting workloads.
Supporting data governance processes , including data archiving, masking, encryption, and versioning, with opportunities to integrate AI-driven automation.
Contributing to CI/CD processes for data pipelines, ensuring releases are tested, compliant, and deployed with minimal operational impact.
Collaborating with cross-functional and international teams to support aligned, scalable data operations.
Supporting the ongoing evolution and execution of the organisations data strategy .
Essential Skills and Experience
To be successful in this role, you will bring:
Strong commercial experience delivering end-to-end data engineering and automation solutions in complex environments.
Advanced SQL skills, including performance tuning and optimisation across large datasets.
Knowledge of Python or R for data processing or analytics.
Hands-on experience with data integration and ingestion tools such as Azure Data Factory and Databricks .
Proven experience in data modelling , data warehousing, and relational database platforms (e.g. MS SQL Server).
Experience designing cloud-native and/or on-prem data solutions .
Exposure to automation and AI-enabled data processes , with awareness of LLM use cases within data workflows.
Experience working in Agile delivery environments (Scrum, Kanban, DevOps).
Strong analytical and problem-solving skills, with the ability to translate complex data into meaningful insights.
Excellent communication skills and the ability to work effectively with both technical and non-technical stakeholders.
Desirable Experience
Experience coordinating or supporting AI / ML initiatives within data platforms.
Experience working within large, regulated, or international organisations.
TPBN1_UKTJ
Sparta Global is looking for passionate and committed individuals who want to kickstart a career in technology! You must be willing to complete full-time training in DevOps Engineering and will then be assigned to work in a junior role with one of our trusted client partners as a 'Spartan' consultant. As a Junior DevOps Engineer you will: Collaborate with the development and operations teams to automate the deployment of applications to multiple environments. You will be responsible for monitoring the health and performance of systems and troubleshooting issues as they arise. You will implement and maintain infrastructure as code to manage and provision resources effectively, while contributing to the development and improvement of DevOps practises and processes. How it works: Learn : Complete a period of full-time Academy training when you join Sparta Global. All training is delivered remotely by our team of industry-professional trainers and is paid from day one. Work: At the successful completion of training, you will become a 'Spartan' consultant and be available for assignment to work with one of our clients as a DevOps Engineer. Grow: You'll work with our client for up to 24 months, be able to access upskilling, salary increases, and are then available to convert to a full-time employee with your assigned employer. How to apply: Our recruitment process is simple and supportive, and we encourage people from all demographics and backgrounds to apply. You do not need to have prior experience of working in tech or studying a STEM subject at a high level. Apply online - Our team of talent coordinators will review your application and invite you to the next stage if you showcase the right aptitude for success. Complete online assessments and a first-stage interview - These assessments are testing your aptitude for learning, not what you know. Show us your potential and then your personality in a face-to-face interview. Final competency-based interview - Demonstrate your collaborative skills, problem-solving abilities, and growth mindset to secure your spot in the Academy. Person specification: To qualify, you need to demonstrate some experience or understanding of python or similar technologies. Most importantly, you should have a strong eagerness to learn and grow as a DevOps Engineer. We're also seeking passionate individuals who align with our values: Empathy & Diversity - Integrity, respect, and a commitment to inclusivity. Drive - A goal-oriented mindset with a passion for growth. Collaboration - A team-focused approach with a desire to build strong relationships. Innovation - Curiosity, creativity, and openness to new ideas. Flexibility - Adaptability and resilience in a fast-paced industry. Eligibility: As a Sparta Global DevOps Engineer, you will be deployed to work with one of our client partners at the completion of your training. For this reason, candidates must be open to relocation/commuting for client site deployments and remote work cannot be guaranteed. Applicants must have the right to work in the UK (British/Irish Citizenship, EU Settled Status, or Permanent Visa Holder) and unfortunately, we are unable to sponsor visas at this time. About Sparta Global: Sparta Global is a technology services and education company, specialising in hiring, training, and deploying the next generation of leaders across in-demand technology and business skills. Over the past decade Sparta Global has helped more than 3000 people kickstart a career in technology, supporting graduates, non-graduates, career changers, returners, and ex forces personnel to develop exciting careers with our network of 100+ employers across public sector, financial services, and commercial. In 2024, Sparta Global was an awarded a King's Award for Enterprise for Promoting Opportunity, adding to its accolades as a Top 20 Employer for Social Mobility, B Corp accredited business for sustainability, and Princess Royal Training Award winner. The Benefits: Free training - paid from day one Performance-based reviews every six months to discuss salary increases Referral bonuses No exit fees --------- 20 days of annual leave + bank holidays An extra day off for your birthday Pension scheme Eye care support Death-in-service cover Cycle-to-work scheme Season ticket loan Employee Assistance Programme Personal development budget Access to alumni and professional networks Opportunities to become a brand ambassador Don't wait to kickstart a career in technology, grab your opportunity to train and work with Sparta Global today! TPBN1\_UKTJ
Based in Bedford
We are an established Bedfordshire-based manufacturer of special purpose machines to household names across the globe and serving a wide range of industries is expanding our in-house engineering team.
Due to a sustained period of growth we have an exciting opportunity for an experienced Automation Engineer to join our business.
Based at our recently refurbished site on the outskirts of Bedford (within easy reach of the A6 and A421 and free on-site parking) with an early finish on Fridays, you will work on both improving our existing product ranges and the development of new products.
In addition, occasionally (approximately 4 to 5 times a year) you will travel both in the UK and Overseas to customer sites to resolve any automation issues regarding commissioning, installation and trouble shooting.
This is an exciting time to join us as we are continuing to expand product ranges, integrating technological advancements, and our development of bespoke solutions to meet specific customer needs means that your work will be interesting and varied.
We are looking for a dynamic individual who can take the function forward and embrace the opportunity to directly contribute to NPD and NPI of one of Bedford’s most highly respected manufacturers.
We invite applications from Controls and Automation Engineers with the following attributes:
A background ofPLC /HMI control systems incorporating at least one of the following: Siemens S7
Rockwell ControlLogix
Allen-Bradley Kinetics Motion Control
Previous working experience of automated or special purpose machinery
Solid understanding of languages such as Python, C++, and JavaScript
Ability to write code from scratch
Experience with Motion Control and Servo Drive Applications would be highly desirable
Previous experience of embedded code will be helpful but not essential
Valid Passport and Full driving licence
More information available upon application.
TPBN1_UKTJ
With a big investment into Databricks, and with a large amount of interesting data, this is the chance for you to come and be part of an exciting transformation in the way we store, analyse and use data in a fast paced organisation. You will join as a Senior Platform Data Engineer providing technical leadership to the Data Engineering team. You will work closely with our Data Scientists and business stakeholders to ensure value is delivered through our solutions.
Job Accountabilities
- Develop robust, scalable data pipelines to serve the easyJet analyst and data science community.
- Highly competent hands-on experience with relevant Data Engineering technologies, such as Databricks, Spark, Spark API, Python, SQL Server, Scala.
- Work with data scientists, machine learning engineers and DevOps engineers to develop, develop and deploy machine learning models and algorithms aimed at addressing specific business challenges and opportunities.
- Coach and mentor the team (including contractors) to improve development standards.
- Work with Business Analysts to deliver against requirements and realise business benefits.
- Build a documentation library and data catalogue for developed code/products.
- Oversight of project deliverables and code quality going into each release.
Requirements of the Role
Key Skills Required
- Technical Ability: has a high level of current, technical competence in relevant technologies, and be able to independently learn new technologies and techniques as our stack changes.
- Clear communication; can communicate effectively in both written and verbal forms with technical and nontechnical audiences alike.
- Complex problem-solving ability; structured, organised, process-driven and outcome-oriented. Able to use historical experiences to help with future innovations.
- Passionate about data; enjoy being hands-on and learning about new technologies, particularly in the data field.
- Self-directed and independent; able to take general guidance and the overarching data strategy and identify practical steps to take.
Technical Skills Required
- Significant experience designing and building data solutions on a cloud based, big data distributed system.
- Hands-on software development experience with Python and experience with modern software development and release engineering practices (e.g. TDD, CI/CD), and software deployment automation with GitHub actions or Azure DevOps.
- Experience in testing automation of data transformation pipelines, using frameworks like Pytest or dbt Unit Test.
- Comfortable writing efficient SQL and debugging.
- Data warehouse operations and tunning experience in schema evolution, indexing, partitioning.
- Hands-on IaC development experience with Terraform or CloudFormation.
- Understanding of ML development workflow and knowledge of when and how to use dedicated hardware.
- Significant experience with Apache Spark or any other distributed data programming frameworks (e.g. Flink, Hadoop, Beam)
- Familiarity with Databricks as a data and AI platform or the Lakehouse Architecture.
- Experience with data quality and/or and data lineage frameworks like Great Expectations, dbt data quality, OpenLineage or Marquez, and data drift detection and alerting.
- Understanding of Data Management principles (security and data privacy) and how they can be applied to Data Engineering processes/solutions (e.g. access management, data privacy, handling of sensitive data (e.g. GDPR)
Desirable Skills
- Experience in event-driven architecture, ingesting data in real time in a commercial production environment with Spark Streaming, Kafka, DLT or Beam.
- Understanding of the challenges faced in the design and development of a streaming data pipeline and the different options for processing unbounded data (pubsub, message queues, event streaming etc)
- Understanding of the most commonly used Data Science and Machine Learning models, libraries and frameworks.
- Knowledge of the development lifecycle of analytical solutions using visualisation tools (e.g. Tableau, PowerBI, ThoughtSpot)
- Hands-on development experience in an airline, e-commerce or retail industry.
- Worked within the AWS cloud ecosystem.
- Experience of building a data transformation framework with dbt.
Trainee AI Engineer - No Experience Needed! Ready to launch a future-proof career in AI - even if you have zero experience? We’re looking for ambitious individuals ready to break into the world of artificial intelligence and data science. Our industry-leading AI Traineeship is designed to take you from complete beginner to a highly employable Junior AI Engineer, with full training provided and a guaranteed job offer (£25K-£45K starting salary) within 20 miles of your location. Whether you're working full-time, part-time, or currently unemployed, our flexible, self-paced program allows you to train around your lifestyle and be job-ready in as little as 6-12 months. How it works - your journey to AI success Step 1: Discover AI Start your journey with our beginner-friendly mini-course bundle. Explore the fundamentals of AI through interactive videos, presentations, and quizzes - all accessible anytime, anywhere, through our easy-to-use online platform. Step 2: Full-Stack AI Mastery Dive deeper with in-demand technical skills including Python programming, data handling, machine learning, and version control with Git and GitHub. You’ll work on hands-on mini projects that mirror real-world challenges, helping you build confidence and a strong portfolio as you learn. Step 3: Get Certified Prepare for and earn your Microsoft AI-900: Azure AI Fundamentals certification, an internationally recognised qualification that proves your knowledge and boosts your credibility with employers. Step 4: Real-World Projects Showcase your new skills with two industry-based, practical projects assigned by your personal tutor. These projects are designed to give you real, portfolio-worthy experience, making you stand out to employers from day one. Your guaranteed future After completing your training, you'll be placed in a Junior AI Engineer role with a guaranteed starting salary of £25K-£45K. We work with top employers across the UK to ensure you get matched with a role close to home. We guarantee a job offer upon completion or 100% of your course fees refunded. We’re proud to have helped over 1,000 people each year transform their careers. Explore our success stories on our website and see what your future could look like. At a one off cost of £990, or a deposit of £149 followed by 10 interest free monthly instalments of £124, this represents a great opportunity to start a rewarding career in Ai and have a real career ladder to start climbing. If you are not offered a role at the end of the training we will refund 100% of your course fees. Ready to future-proof your career? If you’re passionate about tech and ready to break into one of the fastest-growing industries in the world, apply now. One of our friendly advisors will be in touch to guide you through the next steps. ‘Please note that this is a training course and fees apply
Based in Bedford
We are an established Bedfordshire-based manufacturer of special purpose machines to household names across the globe and serving a wide range of industries is expanding our in-house engineering team.
Due to a sustained period of growth we have an exciting opportunity for an experienced Automation Engineer to join our business.
Based at our recently refurbished site on the outskirts of Bedford (within easy reach of the A6 and A421 and free on-site parking) with an early finish on Fridays, you will work on both improving our existing product ranges and the development of new products.
In addition, occasionally (approximately 4 to 5 times a year) you will travel both in the UK and Overseas to customer sites to resolve any automation issues regarding commissioning, installation and trouble shooting.
This is an exciting time to join us as we are continuing to expand product ranges, integrating technological advancements, and our development of bespoke solutions to meet specific customer needs means that your work will be interesting and varied.
We are looking for a dynamic individual who can take the function forward and embrace the opportunity to directly contribute to NPD and NPI of one of Bedford’s most highly respected manufacturers.
We invite applications from Controls and Automation Engineers with the following attributes:
- A background ofPLC /HMI control systems incorporating at least one of the following:
- Siemens S7
- Rockwell ControlLogix
- Allen-Bradley Kinetics Motion Control
- Previous working experience of automated or special purpose machinery
- Solid understanding of languages such as Python, C++, and JavaScript
- Ability to write code from scratch
- Experience with Motion Control and Servo Drive Applications would be highly desirable
- Previous experience of embedded code will be helpful but not essential
- Valid Passport and Full driving licence
More information available upon application.
Trainee AI Engineer – No Experience Needed Future-proof your career in Artificial Intelligence – starting today. Looking for a career change? Currently employed but want something better? Or maybe you're between jobs and ready for a fresh start? ITOL Recruit's AI Traineeship is designed to get you into one of the fastest-growing industries with zero experience required. Train online at your own pace and land your first AI Engineer role in 1-3 months. Please note this is a training course and fees apply Job guaranteed - complete the programme and get a job or get your money back. Our candidates earn £30,000-£45,000. Why AI? AI is reshaping every industry you can think of. Healthcare, finance, retail, and manufacturing – they’re all scrambling for skilled professionals. The demand far outstrips supply, which means excellent salaries, flexible working arrangements, and genuine job security. How It Works Step 1 – AI Engineering Fundamentals Start with the basics of AI, including neural networks and large language models, to build a solid foundation in AI engineering. Step 2 – Data Fundamentals Understand the data workflow, from collection to cleaning, and learn how to prepare data for AI applications. Step 3 – Notebooks & IDEs Get hands-on with industry-standard tools like Jupyter Notebooks and VS Code to develop AI systems. Step 4 – Python Programming Master Python, covering everything from the basics to object-oriented programming (OOP). Step 5 – Python Streamlit Project Apply your Python skills by building a car price prediction app using Python and Streamlit. Step 6 – Python for Data Learn essential Python libraries like NumPy, Pandas, and Matplotlib for data manipulation and visualisation. Step 7 – AI Sentiment Analysis Project Work with Hugging Face to build a sentiment analysis classifier using real-world AI techniques. Step 8 – AI Prompt Engineering Master prompt engineering, learning how to craft effective prompts for controlling AI outputs. Step 9 – Retrieval-Augmented Generation (RAG) Learn how to integrate external knowledge into AI systems using RAG techniques and vector databases. Step 10 – AI Specialised Customer Service Chatbot Project Combine prompt engineering and RAG to build an AI-powered customer service chatbot, delivering intelligent responses using vector databases and knowledge bases. Step 11 – Machine Learning Fundamentals Understand machine learning principles and algorithms, and how to train and test models using scikit-learn. Step 12 – Machine Learning Project Put your machine learning knowledge into practice with a hands-on project. Step 13 – AI & Data Ethics Study the ethical considerations in AI, including issues of bias, fairness, and data privacy. Step 14 – Oral Exam Complete a virtual oral exam to assess your understanding and ability to apply your learning. Step 15 – AWS Certified Cloud Practitioner Finish with the AWS Certified Cloud Practitioner course and exam to gain essential cloud computing knowledge. What You Get · 100% online, self-paced training · Microsoft AI-900 certification included · 1-to-1 tutor and recruitment support · Real-world project experience · Job guarantee – get a job or your money back · Starting salary of £30,000–£45,000 We Get You Hired! We're not new to this. ITOL Recruit has 15+ years of experience and has placed over 5,000 people into new roles. Our job programmes include certified tutors, UK-accredited qualifications, and one-on-one support from a recruitment adviser focused on placing you. We don't believe in empty promises. Complete our programme, follow the process, and if you don't land a job, you get your money back. "Five months from complete beginner to AI engineer. Best decision I ever made." – Jamie W., now working as a Junior AI Engineer in London Ready to Start? If you’re motivated, curious, and excited about technology, we’ll help you turn that into a career you can be proud of. Apply now, and one of our expert Career Advisors will be in touch within 4 working hours to guide you through your next steps