Description
We are seeking a skilled Azure Data Bricks and Data Quality Frameworks professional to join our team in India. The ideal candidate will have extensive experience in designing data solutions and implementing data quality measures to ensure that our data assets are reliable and ready for analysis.
Responsibilities
- Design and implement data processing solutions using Azure Databricks.
- Develop and maintain data quality frameworks to ensure data integrity and accuracy.
- Collaborate with data engineering and data science teams to understand data requirements and deliver solutions.
- Monitor and troubleshoot data pipelines and workflows to ensure optimal performance.
- Create documentation for data processing and quality assurance processes.
Skills and Qualifications
- 8-12 years of experience in data engineering or a related field.
- Strong proficiency in Azure Databricks and its associated tools.
- Experience with data quality frameworks and best practices.
- Proficient in SQL and data modeling techniques.
- Familiarity with data integration tools and ETL processes.
- Knowledge of programming languages such as Python or Scala.
- Understanding of cloud computing concepts and services, specifically Microsoft Azure.
- Strong problem-solving skills and attention to detail.
