GIẢI PHÁP PHÂN TÍCH DỮ LIỆU INSIGHT DATA 4.6 ★

Job Overview:

We are seeking a highly skilled Data Engineer with expertise in Artificial Intelligence (AI) to join our dynamic team. This role involves designing, building, and maintaining robust data pipelines while integrating AI models into data processing workflows. The ideal candidate will have a strong background in data engineering, machine learning, and AI, enabling them to work on complex data challenges and implement intelligent solutions.

Key Responsibilities:

• Data Pipeline Development: Design, build, and maintain scalable data pipelines to collect, process, and store large datasets from various sources using technologies such as Apache Kafka, Apache Spark, and ETL tools.
• AI Model Integration: Collaborate with data scientists and AI engineers to deploy machine learning models into data pipelines, ensuring seamless integration and efficient model performance.
• Data Architecture Design: Develop and implement data architecture and infrastructure that supports both batch and real-time data processing.
• Data Quality and Governance: Ensure data accuracy, completeness, and consistency across the organization by implementing data quality checks and governance policies.
• Performance Optimization: Optimize data storage and processing frameworks for speed, efficiency, and scalability, using techniques like indexing, partitioning, and caching.
• Cloud Infrastructure: Utilize cloud platforms (AWS, Azure, GCP) to deploy and manage data pipelines and AI models, ensuring reliability and scalability.
• Automation and Monitoring: Automate data workflows and set up monitoring systems to ensure smooth operations and quick resolution of any issues.
• Collaboration: Work closely with AI engineers, data scientists, and software developers to support AI-driven projects and enhance data-driven decision-making processes.
• Documentation: Create and maintain comprehensive documentation for data workflows, pipelines, and AI model integration processes.
• Research and Innovation: Stay updated with the latest trends in data engineering and AI, bringing innovative solutions to improve data processing and AI implementation.

Qualifications

• Education: Bachelor’s or Master’s degree in Computer Science, Data Engineering, Information Technology, or a related field. Specialization in AI or Machine Learning is a plus.
• Experience:
• 3+ years of experience in data engineering with a focus on building and optimizing data pipelines.
• Hands-on experience with big data technologies such as Hadoop, Spark, Kafka, and cloud-based data platforms (AWS, GCP, Azure).
• Proven experience in integrating AI/ML models into data workflows.
• Proficiency in programming languages such as Python, Java, Scala, or SQL.
• Experience with containerization (Docker, Kubernetes) and CI/CD pipelines for data engineering and AI deployments.
• Skills:
• Strong understanding of data architecture principles and data modeling techniques.
• Familiarity with machine learning frameworks such as TensorFlow, PyTorch, or scikit-learn.
• Ability to work with structured and unstructured data, and experience with NoSQL databases.
• Excellent problem-solving skills and attention to detail.
• Strong communication skills to collaborate effectively with cross-functional teams.
• Knowledge of AI ethics, data privacy, and compliance is a plus.