Thrive IT Systems Ltd
Databricks Architect
Explore roles
Thrive IT Systems Ltd
Databricks Architect
Private salary
London
Hybrid
RECENTLY POSTED
Graduate
Junior
Mid
Senior
Leader
Description

We have one open position of Databricks Architect with one of our client based at London, UK. This is a contract position. Below is the full job description for your reference. Please share your application once you are interested

Role: Databricks Architect

Mode: Contract

Location: London, UK(2 Days work from office)

Job Description:

We are looking for a hands-on Databricks Architect with strong experience in designing and delivering scalable data and AI solutions in production environments. This role is perfect for someone who enjoys setting architectural direction while remaining deeply technical and hands-on.

Key Responsibilities

  • Design and implement end-to-end data solutions on Databricks (Spark, Delta Lake, notebooks, jobs, clusters, Lakehouse)
  • Define reference architectures, best practices, and standards for data/AI workloads
  • Work closely with stakeholders to translate business requirements into scalable Databricks designs
  • Implement CI/CD pipelines, DevSecOps practices, and IaC for data platform deployments
  • Ensure strong data governance, security, and cost optimisation across cloud environments
  • Collaborate across engineering teams to deliver production-grade solutions

Must-Have Skills

  • 7+ years of data architecture & engineering experience
  • 3-4+ years hands-on with Databricks in production environments
  • Strong expertise with Spark, Delta Lake, Databricks jobs, notebooks, and cluster management
  • Architectural experience defining standards and best practices
  • Strong knowledge of at least one cloud platform (Azure, AWS, or GCP)
  • Experience with CI/CD, DevSecOps, and infrastructure as code (eg, Terraform)
  • Solid understanding of security, governance, and cost management on cloud data platforms
  • Excellent stakeholder management and requirement-translation skills

Nice to Have

  • Experience integrating Databricks with dbt Cloud, Snowflake, Fivetran, BI tools, etc.
  • Background in financial services or capital markets
  • Experience with Machine Learning/AI workloads on Databricks

Recruiter Email: (see below)

Role tech stack
Thrive IT Systems Ltd
Databricks Architect
Share role