About the Role

We are looking for an experienced Lead / Data Engineering Architect to design, build, and scale modern data platforms on Microsoft Azure. This role is ideal for someone who has deep expertise in Azure Databricks, Azure Data Factory, and other Azure data services—and who enjoys both hands-on development and architectural leadership.

Key Responsibilities

Data Architecture & Design

Design scalable, secure, and high-performance data architectures on Azure.
Define data ingestion, transformation, modelling, and orchestration frameworks.
Ensure solutions follow best practices for data governance, quality, lineage, metadata, and CI/CD.

Hands-On Engineering

Build and optimize data pipelines using Azure Databricks (PySpark), Azure Data Factory, Delta Lake, and Azure Storage (ADLS Gen2).
Develop reusable data frameworks, ETL/ELT components, and automation scripts.
Optimize Spark jobs, cluster configuration, and cost.

Stakeholder Management

Translate business goals into technical designs.
Present architecture recommendations, roadmaps, and implementation plans to senior stakeholders.

Required Skills & Experience

5+ years of data engineering experience;
Strong hands-on experience with:
Azure Databricks (PySpark, Delta Lake)
Azure Data Factory
Azure Data Lake Storage (ADLS)
Azure SQL / Synapse
Azure Functions, Azure DevOps CI/CD
Proven track record designing and implementing large-scale data pipelines (batch & streaming).
Strong understanding of data modelling, distributed computing, and cloud-native architecture.
Experience with Git, CI/CD, Terraform/Bicep is a plus.
Experience in building Lakehouse architecture preferred

Tech Lead / Senior Data Engineer (Azure/Databricks) - Freelance/Contract