Join the Integration & Data Services (IDS) team as a Data Engineer. You will build and operate the data pipelines and reporting systems behind VNG's core finance processes — revenue reporting, cash management, and reconciliation — and help expand into real-time data engineering, building high-throughput streaming pipelines for security log data (ISO / security-compliance) using Kafka and ClickHouse.
Responsibilities:
- Build, operate, and maintain ETL/data pipelines for finance reporting, ingesting from multiple sources (banks, Oracle EBS, internal systems).
- Orchestrate workflows with Airflow/Scheduler and optimize pipeline performance, memory usage, and reliability.
- Design and operate real-time streaming pipelines for logs via Kafka
- Set up data-quality checks, monitoring, alerting, and anomaly detection.
- Handle daily operations, bugs, and hotfixes while meeting SLAs; ensure data security (masking, encryption).
- Collaborate with Finance/Accounting and Security/IT stakeholders, and apply AI/LLM/automation where it adds value.
Requirements:
- Bachelor's degree in Computer Science, Software/Control Engineering, Information Systems, or related.
- 1–2 years in data engineering, backend, or data-focused roles (strong fresh graduates with relevant internships considered).
- Solid Python and SQL.
- Hands-on ETL/data pipeline experience with workflow orchestration (Airflow or similar).
- Working knowledge of relational databases (PostgreSQL/Oracle) and basic data-warehousing concepts.
- Strong problem-solving, ownership, and ability to manage multiple concurrent tasks.
- Able to read technical documentation in English.
- Nice to have: Kafka & ClickHouse (streaming/OLAP); data lakehouse & open table formats (Apache Iceberg), S3-compatible object storage (Ceph / MinIO), query engines (Spark / Trino); Hadoop/Hive/HDFS; Oracle/Postgres; applied AI/LLM/GenAI;