Senior/Lead Data Engineer

home credit vietnam

4-6 Years

Ho Chi Minh, Vietnam

Posted 4 days ago

Be among the first 10 applicants

Job Description

In accordance with the applicable laws and regulations on personal data protection, including the Law on Personal Data Protection and its implementing regulations, Home Credit Vietnam Finance Company Limited (Home Credit) collects and processes candidates personal data for recruitment purposes and other related purposes in accordance with the Agreement, Notice and Acceptance for Personal Data Processing.

By submitting your application to Home Credit through Linkedin , you acknowledge that you have read, understood and agreed to the contents of the Agreement, Notice and Acceptance for Personal Data Processing available at the following link: AGREEMENT, NOTICE, ACCEPTANCE FOR PERSONAL DATA PROCESSING, and consent to Home Credit collecting and processing your personal data in accordance with applicable laws and regulations.

KEY RESPONSIBILITIES

The Data & Feature Engineer Senior's main objective is to drive data availability for business analytic & reporting purposes. Key areas of responsibility:

• Analyze data from data producers and transform them into unified form, organize them within the data platforms and/or analytical/production feature store, produce base & derived features in line with Risk Modelling team requirements

• Closely cooperate with IT department on implementing company wide data products following standardized development practices

• Develop, maintain and monitor data pipelines preparing suitable data for analytic & reporting activities

• Set up effective data quality monitoring to detect and remedy discrepancies (collaborate with HQ teams)

• Drive utilization of Big Data Hadoop platform to reduce dependence on DWH Analytical Playgrounds

• Support implementation of MLOps solution aiming to significantly transform data preparation, model development, deployment and monitoring

• Work closely with our data scientists to understand their requirements and challenges and provide them with tailored solutions to optimize their workflows

• Build local expertise for end-to-end development, deployment and monitoring of ML models using Feature Store solution

• Deliver data processing mechanisms for real-time data processing and analytical use to utilize the value of new technologies

• Guarantee technical and operational excellence by:

• Performing code reviews to guarantee high standards and code quality and providing constructive feedback to Junior members

• Designing innovative technical solutions to optimize and elevate the functionality of the Data Platform and Data Products

• Sharing best practices on relevant technical topics to foster collaborative learning environment

EXPERIENCE:

Need-to-have areas

• Proven track record with Data & Feature Engineering activities (4+ years)

• Hands-on experience with Big Data ecosystem, data integration, transformation, processing and visualization tools (Hadoop, Hive, Spark, Kafka, Airflow, Jupyter)

• Experience with containerized applications, microservices (Docker, Kubernetes), CI/CD (gitlab-ci) and serverless / real-time functions

• Hands-on experience MLOps lifecycle, involving the entire process Features Preparation, Model Development, Model Deployment and Model Monitoring

• Programming Language: SQL and Python on advanced level

• University degree in Computer Science, Engineering or related field

• Good written and oral communication skills

• Good English

Nice-to-have areas

• Experience with PowerBI/Tableau BI tools

• Experience with Scala is an advantage

• Experience from working in the data-related area in online, fin-tech, ecommerce, digital, IT dev

• Able to communicate efficiently as well as to interpret and promote a big data culture to the organization

COMPENSATION & BENEFITS