EPAM VIỆT NAM ★ 4.2

EPAM Vietnam is seeking an exceptional LLM Engineer to join our innovative team in Ho Chi Minh City. This is your opportunity to shape the future of AI by designing, building, and optimizing cutting-edge applications powered by Large Language Models — specializing in LLMOps, multi-agent systems, and advanced LLM integration patterns.

You'll work on a high-impact initiative for a prestigious global client, collaborating with a talented international engineering team to deliver next-generation AI solutions that push boundaries. This role includes exciting opportunities for business travel to Hong Kong and the chance to drive groundbreaking GenAI developments in a rapidly evolving industry.

Responsibilities

• Design and develop sophisticated LLM-powered applications, including multi-agent systems (chatbots, agentic workflows) with advanced prompt orchestration, tool/function calling, and seamless multi-step coordination
• Build robust retrieval-augmented generation (RAG) capabilities — from data ingestion and chunking to embedding/indexing, vector search, reranking, and citation/attribution — ensuring highly grounded, accurate responses
• Develop and maintain intelligent data pipelines that curate and govern external knowledge sources, ensuring freshness, quality, and appropriate access controls
• Continuously enhance model and system performance through prompt optimization, dataset curation, lightweight adaptation techniques (LoRA/PEFT), and strategic fine-tuning
• Implement and operate LLMOps practices: drive deployment strategies, monitoring/observability, rigorous evaluation, incident response, and iterative optimization for quality, latency, and cost efficiency
• Collaborate with ML engineers and data scientists to seamlessly integrate LLM systems into production products and services (APIs, platforms, downstream applications)
• Stay at the forefront of the LLM ecosystem, translating emerging innovations into measurable improvements for our production applications

Requirements

• Bachelor's or Master's degree in Computer Science, Mathematics, Data Science, or related field (or equivalent hands-on experience)
• Expert-level Python skills with a proven track record of building production-grade services (APIs, async jobs, testing, CI/CD)
• Hands-on experience with modern LLM frameworks and tooling (LangChain/LangGraph, LlamaIndex) and contemporary integration patterns
• Demonstrated success developing LLM applications and driving improvements through systematic experimentation — prompting, RAG tuning, dataset iteration, and fine-tuning with PEFT
• Strong analytical mindset: you define meaningful success metrics and conduct comprehensive offline/online evaluations (groundedness, faithfulness, relevance, retrieval metrics, A/B testing, human review)
• Production deployment expertise with models/LLM applications using containers, cloud services, scalable architectures, and robust monitoring
• Knowledge of responsible AI and security best practices, including privacy, access control, prompt injection defenses, and guardrails for policy-aligned behavior
• Proficient in spoken and written English

We offer

• By choosing EPAM Vietnam, you're getting a job at a Vietnam Best Workplace™ certified company (2022-23 and 2023-24)
• You'll work with the latest and most advanced technologies on exciting global projects with a supportive multicultural team where your voice matters
• We prioritize a healthy work-life balance with a flexible hybrid working model and generous annual leave of up to 19 days
• We offer a transparent career path and an individual roadmap to engineer your future & accelerate your journey
• At EPAM, you can find vast opportunities for self-development: access to over 25,000 online courses and libraries from industry leaders, English classes, mentoring programs, partial grants of certification, and experience exchange with colleagues around the world. You will learn, contribute, and grow with us

Life at EPAM

• EPAM Systems, Inc. (EPAM) is a leading digital transformation services and product engineering company. Since 1993, we have used our software engineering expertise to become a leading global provider of digital engineering, cloud and AI-enabled transformation services, and a leading business and experience consulting partner for global enterprises and ambitious startups. We address our clients’ transformation challenges by fusing EPAM Continuum’s integrated strategy, experience and technology consulting with our 30+ years of engineering execution to speed our clients’ time to market and drive greater value from their innovations and digital investments.

• Established in 2019, EPAM Vietnam has been constantly expanding our team and capabilities with two offices in Ho Chi Minh City and Hanoi. We offer a multicultural environment where our tech talents can proactively develop world-class solutions directly with international clients. At EPAM Vietnam, we adopt a global growth strategy, thinking and acting like start-ups, working in multi-disciplinary teams, and delivering results. You’ll find interesting challenges typically dealt with at a start-up, yet you’ll be in a highly professional corporate setting.
• Learn more at www.epam.com and follow us on facebook.

How we hire
Here, we summarize the typical journey to finding a job within EPAM:

• Step 1: General interview with our talent attraction specialist
• Step 2: Technical interview with our technology experts*
• Step 3: Manager interview with a hiring manager
• Step 4: Client interview**
• And you are ready to join the team!
• Not sure if you meet all the requirements? No problem. Let’s talk anyway and find out more!
• It takes 1 min of application to start the journey with us. Apply now!

*Certain positions may necessitate entry tests tailored to specific client and project requirements.

**A project-specific interview may precede the client interview to assess project fit.