About the Role
We are looking for an experienced Lead / Data Engineering Architect to design, build, and scale modern data platforms on Microsoft Azure. This role is ideal for someone who has deep expertise in Azure Databricks, Azure Data Factory, and other Azure data servicesand who enjoys both hands-on development and architectural leadership.
Key Responsibilities
Data Architecture & Design
- Design scalable, secure, and high-performance data architectures on Azure.
- Define data ingestion, transformation, modelling, and orchestration frameworks.
- Ensure solutions follow best practices for data governance, quality, lineage, metadata, and CI/CD.
Hands-On Engineering
- Build and optimize data pipelines using Azure Databricks (PySpark), Azure Data Factory, Delta Lake, and Azure Storage (ADLS Gen2).
- Develop reusable data frameworks, ETL/ELT components, and automation scripts.
- Optimize Spark jobs, cluster configuration, and cost.
Stakeholder Management
- Translate business goals into technical designs.
- Present architecture recommendations, roadmaps, and implementation plans to senior stakeholders.
Required Skills & Experience
- 5+ years of data engineering experience;
- Strong hands-on experience with:
- Azure Databricks (PySpark, Delta Lake)
- Azure Data Factory
- Azure Data Lake Storage (ADLS)
- Azure SQL / Synapse
- Azure Functions, Azure DevOps CI/CD
- Proven track record designing and implementing large-scale data pipelines (batch & streaming).
- Strong understanding of data modelling, distributed computing, and cloud-native architecture.
- Experience with Git, CI/CD, Terraform/Bicep is a plus.
- Experience in building Lakehouse architecture preferred
