Senior Data Engineer

The Mission: We are seeking a seasoned Senior Data Engineer to architect, build, and scale our core data platform from scratch. In this role, you will design and optimize high-throughput data pipelines handling massive daily transaction volumes (exceeding 50M+ transactions / >10GB daily). You will work extensively with PySpark/Glue, Apache Airflow, and real-time streaming technologies (Kafka/Flink) to power critical business analytics and data-driven products.

Key Responsibilities:

• Architecture & Platform Build (From Scratch): Design, construct, and scale robust data platform architecture and data models capable of handling high-volume transactional systems.
• High-Volume Pipeline Engineering: Build and maintain batch & real-time ETL/ELT pipelines using Python, Apache Spark (PySpark/Glue), and event-driven streaming frameworks (Kafka/Flink).
• Workflow Automation & Orchestration: Implement, monitor, and automate complex data workflows using Apache Airflow.
• Performance Optimization & Reliability: Troubleshoot data bottlenecks, optimize query execution, and ensure high reliability across distributed environments (Hadoop/Spark ecosystem & Cloud platforms).
• Data Technical Decision-Making: Evaluate short-term vs. long-term technical trade-offs, drive architectural decisions, and document data pipelines and system flows for compliance and scalability.

Requirements:

• Experience: 5+ years of hands-on experience in Data Engineering or Big Data roles.
• Core Spark Expertise: At least 3+ years of dedicated, hands-on experience with Apache Spark / AWS Glue in production.
• Real-Time Streaming Stack: Proven experience working with real-time data processing tools such as Apache Kafka, Apache Flink, or equivalent streaming technologies.
• Big Transaction & Data Volume: Track record of processing high-volume datasets (at least >10M records / >10GB daily, ideally scaling up to 50M+ transactions/day).
• Workflow Management: In-depth working knowledge of Apache Airflow for pipeline orchestration.
• Programming & Systems: Strong proficiency in Python, SQL, ETL frameworks, and Big Data ecosystems (Hadoop, HDFS, Hive).
• Architectural Mindset: Ability to weigh technical trade-offs, solve complex data pipeline bottlenecks, and build scalable systems independently.
• Experience with Cloud Data Platforms (AWS, GCP, Azure).
• Experience building or migrating data platforms from scratch.

What We Offer:

• Working-support devices provided on demand.
• Excellent and competitive salary package.
• 13th-month salary with good long‑term and performance bonus.
• Review performance and salary every release milestone.
• Friendly working environment, no office politics.
• Free snack breaks and drinks, birthday celebration policy.
• Opportunities to gain hands-on experience in cutting-edge technologies and work on new technology.
• Experience the true start-up spirit of a fast growing and well funded studio.