Lead Engineer (Data Engineer)
- Posted a month ago
- Over 100 applicants have applied
Job Description
ob description
- Design, develop, and maintain robust and scalable data pipelines that ingest, transform, and load data from various sources into data warehouse.
- Collaborate with business stakeholders to understand data requirements and translate them into technical solutions.
- Implement data quality checks and monitoring to ensure data accuracy and integrity.
- Optimize data pipelines for performance and efficiency.
- Troubleshoot and resolve data pipeline issues.
- Stay up-to-date with emerging technologies and trends in data engineering.
Qualifications
- Bachelor s or Master s degree in Computer Science, Engineering, or a related field.
- 7+ years of experience in data engineering or a similar role.
- Strong proficiency in SQL and at least one programming language (e.g., Python, Java).
- Experience with data pipeline tools and frameworks
- Experience with cloud-based data warehousing solutions (Snowflake).
- Experience with AWS Kinesis, SNS, SQS
- Excellent problem-solving and analytical skills.
- Strong communication and interpersonal skills.
Desired Skills & Experience:
- Data pipeline architecture
- Data warehousing
- ETL (Extract, Transform, Load)
- Data modeling
- SQL
- Python or Java or Go
- Cloud computing
- Business intelligence
More Info
Job Type:
Industry:
Function:
Employment Type:
About Company
Skills:
Pyspark, Data Governance, Sql, Git, MLops, Docker, Terraform, Databricks, Azure, Python, Azure DevOps, GenAI, ML solutions, LLMOps, Distributed System Design, Lakehouse engineering, Security, Privacy, GitHub Actions, Responsible AI, Bicep
Skills:
Pyspark, Scala, Apache Spark, Kafka, Oracle Goldengate, Jenkins, Terraform, Python, Airflow, Google BigQuery, Cloud Composer, GitHub Actions
Skills:
MLops, Python, Data DevOps
Skills:
Orchestration, S3, Metadata Management, Pyspark, PostgreSQL, Automated Testing, Data Modeling, Lambda, Advanced Sql, Python, RDS, release management, Dynamodb, SQL Server, Redshift, Data Quality, ECS, transformation standards, CI CD, AWS data services, ETL best practices, data cataloging, Step Functions, Monitoring, large-scale data processing, Glue
Skills:
Java, Cloud Computing, Sql, Python, Business Intelligence