We are seeking a skilled Data Engineer to join our dynamic team. The ideal candidate will have a strong understanding of data warehousing, SQL Server, and Lakehouse platforms such as Databricks. This role will involve managing and organizing data, while also ensuring its quality and accessibility.
Main Responsibilities:
1. Data Warehouse Construction and Management:
- Collaborate closely with ERP, Software teams, and functional departments to define data flows and data semantics.
- Execute ETL processes, establish and manage connections with the data warehouse.
- Partner with the analytics team to design appropriate data sets for reporting.
- Adapt data set structures in response to evolving business needs and requirements.
- Document data structures and definitions, maintaining comprehensive and up-to-date records.
- Resolve issues related to the database promptly and effectively.
2. Data Warehouse Performance Enhancement:
- Develop optimal data warehousing and data loading solutions in line with product requirements from the analytics and Machine Learning teams.
- Collaborate with the IT team to enhance the data warehouse environment, providing advice and proposing solutions to increase storage capacity, improve loading speed, and reduce costs.
- Monitor the cost and capacity of the data warehouse environment, tracking any issues and resolving them as quickly as possible to ensure the smooth operation of the reporting system and Machine Learning tools.
3. Data Security and Integrity:
- Establish and manage outgoing connections from the data warehouse, ensuring stability and security.
- Monitor for any issues that could compromise data accuracy, alert relevant parties and resolving issues promptly.
4. Compliance:
- Adhere to the company's processes, procedures, regulations, and standards, ensuring all activities are compliant.
5. Performance Management:
- Align on individual KPIs with the direct line manager and strive to achieve these targets.
Requirements:
- Bachelor's degree in computer science, Engineering, or related field, or equivalent work experience.
- At least 2 years of experience working with large and complex data warehouse systems with hand-on data architecture experience.
- Proven experience as a Data Engineer, Software Developer, or similar.
- Strong knowledge of Data Warehousing concepts.
- Proficient in designing and building data models using the Kimball methodology for various data marts (Sales, Finance, Marketing).
- Advanced skills in SQL and dbt for building, testing, and optimizing data transformation workflows.
- Hands-on experience with workflow orchestration tools like Airflow, Dragster, or n8n.
- Experience implementing data quality frameworks, including unit testing and data validation.
- Strong understanding of various data ingestion patterns (e.g., Incremental, Snapshot, CDC).
- Knowledge of Power BI data modeling and writing complex DAX queries.
- Strong organizational and project management skills.
- Strong problem-solving skills, analytical abilities, and attention to detail.
