Big Data Software Engineer - Paid Ads

Job Description:

• Design, build and maintain the ingestion system to support various types of data (e.g. user behavior, RDS, NoSQL DB and others) to be ingested to the data warehouse more timely and accurately
• Translate data requirements into scalable technical data service with low latency and high concurrency
• Design, build and maintain the batch or real-time data pipeline in production using Hadoop big data technology
• Analyse and improve efficiency, scalability, and stability of the system
• Define and manage service level agreement and data quality for all data sets in allocated areas of ownership

• Minimum Bachelor's degree in Computer Science or a related technical field
• 2+ years of working experience in programming languages, such as Java, Scala, Python, Golang & C++, SQL is optional
• Familiar with Hadoop, Spark and Flink data processing experience with TB data processing experience is a plus
• Understand data mining or machine learning, excited to work with data, passionate, self-motivated, and takes ownership
• Familiar with designing and operating of a robust distributed system is a plus