Data Engineer

Responsibilities:

• Design, build, and optimize scalable data systems using Azure cloud services (Azure Data Factory, Azure Function, etc.).
• Develop, integrate, and manage data pipelines, ensuring efficient and reliable data flows across platforms such as SQL and ElasticSearch.
• Implement messaging and data streaming solutions using RabbitMQ.
• Deploy, manage, and optimize containerized applications with Kubernetes.
• Collaborate with stakeholders and clients to clarify technical requirements, provide updates, and address issues through frequent meetings and discussions.
• Analyze, optimize, and maintain system performance and data quality.
• Proactively and independently ensure tasks and responsibilities are completed to a high standard, taking ownership of assigned work.
• Clearly document and explain problem-solving processes, demonstrating strong analytical ability and clean coding habits.
• Support AI/ML projects by building robust data foundations and integrating relevant models.

Requirements:

• Solid, well-rounded understanding of Data Engineering and AI/ML concepts, with practical experience in data pipelines, model integration, and performance optimization.
• Proficiency with Azure cloud services (Azure Data Factory, Azure Function, etc.), RabbitMQ, SQL, ElasticSearch, and Kubernetes.
• Strong technical skills and logical thinking, with structured coding approaches and clean coding habits.
• Excellent communication skills, able to work collaboratively and proactively with both internal teams and clients.
• Ability to work independently in a dynamic project environment, demonstrating professionalism, ownership, and self-motivation.
• Comfortable participating in meetings and communicating directly with clients.