The Mission
We are seeking a heavyweight Senior Data Engineer to join our client's dynamic team. You will be responsible for architecting, optimizing, and maintaining massive data pipelines handling 50M+ transactions per day.
Core Responsibilities:
- Scalable Architecture: Design and maintain scalable data pipelines and models for massive transaction systems.
- ETL Mastery: Utilize Python and ETL tools (Talend, NiFi, etc.) to extract, transform, and load data with maximum efficiency.
- Automation: Implement and manage complex workflows using Apache Airflow to automate high-frequency data processing.
- Hadoop Optimization: Fine-tune data processing performance and reliability within the Hadoop ecosystem (HDFS, Hive, Spark).
- Strategic Collaboration: Partner with Data Scientists and stakeholders to ensure 100% data quality and availability.
- System Integrity: Proactively monitor and troubleshoot pipeline issues to ensure zero downtime in operational efficiency.
Requirements:
- Experience:8+ years in Data Engineering or a similar high-level role.
- Tech Stack: Expert proficiency in Python, Apache Airflow, and Hadoop Ecosystem.
- ETL Expertise: Hands-on experience with tools like Talend, Informatica, or NiFi.
- High-Volume Proven Track Record: Experience building systems that handle 50 million+ transactions per day.
- Domain Focus: Strong background in Accounting, Financial data, or related quantitative fields.
- Soft Skills: Open mindset, proactive learning, and a meticulous, detail-oriented approach to financial figures.
Why You Should Join Us:
- Technical Challenge: Solve real Big Data problems for massive financial infrastructures.
- Environment: A professional, fast-paced environment that values technical excellence and detail.
- Premium Gear: High-end working equipment provided.
- Compelling Compensation: Attractive salary package based on performance and contribution; Salary reviews twice a year.
- Performance Bonuses: Project-based bonuses, performance bonuses, and a 13th-month salary.
- Health & Wellness: Comprehensive social insurance plus premium health insurance packages and annual health check-ups.
- Vibrant Culture: Frequent team-building activities, birthday celebrations, and festive gifts (Lunar New Year, Mid-Autumn).
- Internal Clubs: Join our soccer, archery, and other hobby clubs.
