Search by job, company or skills

Shopee

Engineering lead - Algorithm Data Engineering

5-7 Years
new job description bg glownew job description bg glownew job description bg svg
  • Posted 2 days ago
  • Be among the first 10 applicants
Early Applicant

Job Description

Job Description:

  • Collaborate closely with the MPID algorithm team, fully participating in model training, deployment, and iteration. Drive high-quality feature engineering and efficient data pipeline development.
  • Design, deploy, and integrate online data pipeline systems. Establish feedback loops for performance evaluation and data return flows, enabling continuous optimization and performance improvement of models in real-world scenarios.
  • Own the end-to-end data engineering lifecycle for large model training, including multi-source data ingestion, cleaning, labeling, automated data production, and distributed pipeline design and optimization. Support different stages such as pretraining, supervised fine-tuning (SFT), and parameter-efficient fine-tuning (e.g., LoRA).
  • Build and maintain the data foundation for AI systems. Manage the full data lifecycle, including data taxonomy design, schema standardization, and improving data quality, diversity, and usability. Develop comprehensive data quality evaluation and monitoring systems to enhance model performance across multilingual and multi-domain applications.
  • Lead the data engineering team and drive cross-functional collaboration with algorithm teams. Ensure high-quality project delivery and foster team growth and professional development.

Requirements:

  • Bachelor's degree or above in Computer Science, Artificial Intelligence, Data Engineering, or a related field, or equivalent practical experience.
  • Strong expertise in data engineering and distributed systems. Proficient in tools and frameworks such as Spark, Flink, Ray, Python, Java, and SQL.
  • At least 5 years of hands-on experience building and operating large-scale data pipelines, with a proven track record of handling PB-scale data processing, optimization, and automation.
  • At least 3 years of experience in team management, with strong leadership, communication, and project execution skills.
  • Solid understanding of machine learning workflows, with the ability to collaborate effectively with algorithm teams and contribute to feature engineering and data sampling strategies.
  • Experience in building end-to-end LLM data platforms, such as Data Lake or Data Flywheel systems or experience or research background in data selection, synthetic data generation, LLM-based evaluation (LLM-as-a-Judge), or agent evaluation frameworks.

More Info

Job Type:
Employment Type:

About Company

Shopee Pte. Ltd. is a Singaporean multinational technology company that specialises in e-commerce. The company was launched in Singapore in 2015, before it expanded abroad. As of 2021, Shopee is considered the largest e-commerce platform in Southeast Asia with 343 million monthly visitors.

Job ID: 144747635