Senior Data Engineer

Job Description

Data Architecture & Data Warehouse Development (50%)

• Design and manage the organizational data system architecture, including configuring the Data Lake, Data Warehouse, and Workspace.
• Develop, optimize, and automate ETL/ELT processes; optimize pipelines to ensure reports are updated fully and timely.
• Data Quality Management: Establish validation frameworks to monitor data quality, ensuring data is always ready for reporting and operations.
• Build a data governance framework (data owner, data policy, data governance) to ensure quality, compliance, security, and consistency throughout the data lifecycle within the organization.
• Implement Row-Level Security (RLS). Maintain clear data documentation and data lineage diagrams to ensure compliance.

Report Development & Analytics Support (50%)

• Design and optimize data models (data modeling) such as Star Schema (Fact/Dimension tables) or Snowflake Schema to simplify complex business logic for end-users.
• Advanced DAX Development: Build and fine-tune complex DAX functions, ensuring reports have fast response times and consistent calculation metrics.
• Collaborate with various departments to thoroughly understand business requirements and deliver deep analytical reports.
• Implement Data Crawling and data ingestion solutions (via APIs, Web Scraping, and third-party data).
• Support data preparation tasks, conduct ad-hoc analyses, and optimize the reporting system.

3. Other Tasks (if any)

• Support building a long-term roadmap for the BI team and propose new analytical ideas/projects.

Requirements

• 5 years of experience in equivalent positions. Possess hands-on experience in building and operating data systems.
• Proficient in SQL (Mandatory): Ability to write complex queries, optimize query performance, and handle big data.
• Deep understanding of Data Lake and Data Warehouse architectures.
• Solid grasp of Data Pipeline construction processes, ETL/ELT methodologies, and data modeling.
• Proficient in using BI tools (Power BI, Tableau are preferred).
• Experience working with ERP systems (especially Microsoft Dynamics 365 Business Central).
• Proficiency in Python for analysis and experience in Data Crawling (web/API data collection) is a major plus.
• Experience working on cloud computing platforms (Azure).