We are looking for a Senior Machine Learning Engineer to build and run production-grade LLM services on Azure. You will turn models and agent workflows into secure, monitored APIs, improve reliability and cost, and partner with data, product and engineering teams to ship AI features that scale.
Responsibilities
- Productionize AI models, LLM applications and agent workflows into reliable Back-end services and automated pipelines
- Build and enhance Python APIs, middleware and integrations connecting user interfaces, AI agents and enterprise systems
- Deploy and support solutions across development, test and production with release management and version control
- Implement authentication, authorization and access control for AI services, data and files using modern identity patterns
- Design resilient systems with observability, robust error handling, retries and failover strategies
- Create automated tests across unit, integration and API layers to protect production quality
- Monitor model behavior, latency, token usage, operational costs and infrastructure health and act on insights
- Optimize scalability and performance through caching, async processing and database tuning
Requirements
- Proven experience building Python back-end services with FastAPI, Pydantic, asynchronous programming and pytest
- Hands-on experience connecting Azure OpenAI Service or OpenAI APIs including embeddings, tool calling, structured outputs and streaming
- Background in LLM observability and telemetry using Langfuse, Grafana or comparable tools
- Ability to create orchestration layers for session management, validation, transformation and system integrations
- Strong SQL for reusable queries, quality checks, aggregation and analytics-focused data logic
- Experience using Azure services such as Azure AI Search, Redis, cloud storage, managed identities and deployment pipelines
- Hands-on experience delivering retrieval-augmented generation (RAG) solutions with vector search, hybrid search and ranking techniques
- Understanding of security practices including OAuth, Microsoft Entra ID and operational support for distributed systems
We offer
- By choosing EPAM Vietnam, you're getting a job at a Vietnam Best Workplace™ certified company (2022-23 and 2023-24)
- You'll work with the latest and most advanced technologies on exciting global projects with a supportive multicultural team where your voice matters
- We prioritize a healthy work-life balance with a flexible hybrid working model and generous annual leave of up to 19 days
- We offer a transparent career path and an individual roadmap to engineer your future & accelerate your journey
- At EPAM, you can find vast opportunities for self-development: access to over 25,000 online courses and libraries from industry leaders, English classes, mentoring programs, partial grants of certification, and experience exchange with colleagues around the world. You will learn, contribute, and grow with us
Life at EPAM
EPAM Systems, Inc. (EPAM) is a leading digital transformation services and product engineering company. Since 1993, we have used our software engineering expertise to become a leading global provider of digital engineering, cloud and AI-enabled transformation services, and a leading business and experience consulting partner for global enterprises and ambitious startups. We address our clients transformation challenges by fusing EPAM Continuum's integrated strategy, experience and technology consulting with our 30+ years of engineering execution to speed our clients time to market and drive greater value from their innovations and digital investments.
- Established in 2019, EPAM Vietnam has been constantly expanding our team and capabilities with two offices in Ho Chi Minh City and Hanoi. We offer a multicultural environment where our tech talents can proactively develop world-class solutions directly with international clients. At EPAM Vietnam, we adopt a global growth strategy, thinking and acting like start-ups, working in multi-disciplinary teams, and delivering results. You'll find interesting challenges typically dealt with at a start-up, yet you'll be in a highly professional corporate setting.
- Learn more at www.epam.com and follow us on facebook.
How we hire
Here, we summarize the typical journey to finding a job within EPAM:
- Step 1: General interview with our talent attraction specialist
- Step 2: Technical interview with our technology experts*
- Step 3: Manager interview with a hiring manager
- Step 4: Client interview**
- And you are ready to join the team!
- Not sure if you meet all the requirements No problem. Let's talk anyway and find out more!
- It takes 1 min of application to start the journey with us. Apply now!
*Certain positions may necessitate entry tests tailored to specific client and project requirements.
**A project-specific interview may precede the client interview to assess project fit.
