Hữu Toàn Group

Tóm tắt công việc
We're seeking a Machine Learning Engineer to build and deploy multi-agent conversational AI systems with voice capabilities. You'll be responsible for developing real-time voice agents that can engage in natural, multi-turn conversations while maintaining high performance at scale.
Responsibilities
Design and implement multi-agent voice-based AI systems that can handle complex, real-time conversations
Build and optimize streaming communication pipelines for real-time speech processing
Deploy and scale ML models for production environments
Optimize model serving and inference for high-performance requirements
Technical Requirements
Multi-Agent Systems & Voice AI
Experience building multi-agent systems using LLMs
Knowledge of voice agent architectures and conversation management
Understanding of multi-turn dialogue systems
Knowledge of interruption and end turn detection in voice interaction, mimicking human-like conversation flow.
Streaming & Real-time Processing
Strong experience with async/streaming architectures
Proficiency in building real-time communication systems
Experience with WebSocket, gRPC, or similar streaming protocols
Hands-on experience with speech processing pipelines
Production ML Experience
Track record of deploying ML systems to production
Experience with ML monitoring and observability
Understanding of ML system scalability and reliability
Understanding of deploying ML/DL models on a large scale setup (optimize latency / throughput/ GPU usage...)
Experience with at least one serving framework such as Ray, Triton Server, Kubeflow,..
Competitive compensation package, including 13th-month salary and performance bonuses
Comprehensive health care coverage for you and your dependents
Generous leave policies, including annual leave, sick leave, and flexible work hours
Convenient central district 1 office location, next to a future metro station
Onsite lunch with multiple options, including vegetarian
Grab for work allowance and fully equipped workstations
Fun and engaging team building activities, sponsored sports clubs, and happy hour every Thursday
Unlimited free coffee, tea, snacks, and fruit to keep you energized
An opportunity to make a social impact by helping to democratize credit access in emerging markets.