JOB DESCRIPTION
We are seeking a highly skilled Senior Data Engineer with deep expertise in Spark and AWS Glue to design, develop, and maintain scalable ETL pipelines. The ideal candidate will have experience working with large-scale data processing, cloud-native services, and modern data architecture.
Responsibilities
- Collaborate with stakeholders to communicate complex technical concepts effectively.
- Provide technical guidance and mentorship to junior engineers and architects.
- Actively participate in the evaluation and selection of data modeling and technologies.
- Lead design, develop, and optimize ETL/ELT pipelines using AWS Glue and Python
- Build and maintain data lakes and data warehouses on AWS (e.g., S3, Redshift).
- Collaborate with data analysts, scientists, and business stakeholders to understand data requirements.
- Implement data quality, governance, and security best practices.
- Monitor and troubleshoot Spark jobs and Glue workflows for performance and reliability.
- Develop and maintain documentation for data workflows and architecture.
- Ensure the quality delivery for batch ETL
Qualifications:
- Bachelor's degree in computer science or a related field
- 5+ years of experience as a Spark Expert (data modeling) and AWS Glue or in a similar role.
- 5+ years of hands-on experience with AWS services, including EC2, VPC, S3, Lambda, ECS/EKS, RDS, IAM, and more.
- Proficiency in scripting languages such as Python or Bash.
- Experience with containerization technologies such as Docker.
- Excellent communication, presentation, and interpersonal skills (English).
- Strong analytical and problem-solving abilities.
- Nice to have experience working with Japan Project
WHY YOU'LL LOVE WORKING HERE
- Career growth opportunities
- Health Benefits + Premium Health Insurance package for you.
- 5 working days per week (Monday-Friday), to some extent flexible working hours.
- Competitive salary package with 13th monthly salary and a good long-term and performance bonus monthly and yearly.
- Vibrant team culture
- Team events & trips
- Sports activities: football, badminton, foosball
- Free snack and coffee
- Competitive salary package with 13th monthly salary and a good long-term and performance bonus monthly and yearly
- Skills up plan with Tech talk, soft skill talk, English club, working process training.
- Company trip yearly
