Humax Vietnam ★ 3.6

Projects description

MaruAI Applications Development: We are building next-generation Android TV/Devices chatbot, agent that redefine user interaction through AI-powered experiences. Our focus firstly is on implementation and optimization of Small Language Models (SLMs) for our STB Helpdesk Chatbot. Unlike cloud-based LLMs, your focus will be on deploying efficient, high-performing models directly on hardware (STB/Android devices) to ensure low latency, privacy, and maybe offline functionality covering domains such as health-care, game and entertainment.

1.0. General Description

1.1. Join an international development team creating AI solutions using the latest technology.

1.2. Involving in developing AI solutions for Android TV, mobile phones, and web platforms, integrated with hardware.

1.3. Research cutting-edge AI technologies, particularly in the field of AI ML

1.4. Collaborate with the development team to deliver valuable, commercial products to end-users.

2.0. Essential Duties and Responsibilities

2.1. Model Selection & Fine-tuning: Evaluate and fine-tune open-source SLMs (e.g., Phi-3, TinyLlama, Gemma, or Mistral-7B variants) specifically for helpdesk and technical support domains.

2.2. Optimization for Edge: Implement quantization (INT8/FP16/GGUF), pruning, and knowledge distillation to ensure models run smoothly on limited CPU/RAM environments (STBs and IoT devices).

2.3. Deployment Pipeline: Use frameworks like ONNX Runtime, llama.cpp, or TensorRT-LLM to deploy models on specific hardware architectures.

2.4. System Integration: Collaborate with backend and hardware teams to integrate the chatbot engine with STB system APIs for device troubleshooting.

2.5. Performance Monitoring: Benchmark inference speed (tokens per second) and memory footprint on actual hardware to meet project KPIs.

3.0. Job Requirements

3.1. Qualifications

3.1.1. Bachelor’s or Master’s degree in Computer Science, Artificial Intelligence, or related field.

3.2. Work Experience

3.2.1. From 2 years of experience as AI Engineer

3.2.2. AI/ML Skills: Proven experience with Transformers, PyTorch, or TensorFlow. Deep understanding of Retrieval-Augmented Generation (RAG).

3.2.3. Optimization Expertise: Experience with model compression techniques (Quantization, LoRA/QLoRA fine-tuning).

3.2.4. Programming: Strong proficiency in Python and/or C++ (C++ is highly preferred for hardware-level optimization).

3.2.5. Participating in all works in the software development process, including requirements inquiry, analysis, design, and research of new technology ...

3.2.6. Keen on learning new tech stacks and frameworks

3.2.7. Big plus points if you have knowledge:

      • Experience with SLM, Edge Computing

      • Android-based apps/platform experience

3.3. Knowledge

3.3.1. [Essential] Know how to write clean, efficient, reusable code

3.3.2. [Essential] Process of Code Versioning (GIT)

3.3.3. [Preference] Have strong interest and deep understanding in AI domain.

3.3.4. [Preference] Understanding of software development process and design.

3.3.5. [Preference] Knowledge of Agile Scrum development process is a plus

3.4. Skills and attitude

3.4.1. Good Written English skill, Verbal English Communication is a big plus    

3.4.2. Good problem-solving skills, thorough, sincere, responsible, understanding mindset

3.4.3. Logical thinking required as an engineer.

3.4.4. Experience working independently and as part of a team. Active communication internally and externally

3.4.5. Bachelor’s degree in Information Technology, Software, or equivalent. 

4.0. Benefit & working environment

4.1. Benefits

- Salary will be negotiated depends on your competency

- Competitive compensation package (Basic salary, Monthly Allowance, Performance incentive)

- Attractive benefits (SHUI Insurance, PTI Premium Health Care Insurance for both you and your family)

- Teambuilding Support Bonus quarterly

- 100% official salary during the probation period, annual salary raise

- Extra bonus per special occasions (Birthday, Labor Day, National Day, Solar New year, Lunar New Year)

- Annual company outing trip/travel

4.2. Working environment

- 5 working days/week with flexible working time and no overtime

- Chance to go on business trip oversea

- English working environment: You will have chance to practice English in both 4 skills.

- If you aren't confident? Let's join Internal English Class full sponsored by Company

- Professional, creative, comfortable and flexible working environment

- Young and talented colleagues with nice and supportive leader

- Chance to develop career with clear and motivated performance management system

- Common cultural-sportive Clubs and activities, sponsored and/or supported by the Company

If you find an open culture where people are valued, trusted and treated fairly, let's join us and start our journey!