Mô tả công việc
Data Pipeline Development
Work with structured and unstructured data from various sources.
Develop, maintain, and optimize data pipelines and ETL processes to ensure efficient data flow and integration.
Data Management
Ensure data integrity, accuracy, and consistency across all data systems.
Implement and monitor data quality checks to maintain high standards of data quality.
Collaboration
Assist in integrating data from different sources into a unified data warehouse.
Work closely with data scientists, analysts, and other stakeholders to understand data requirements and deliver solutions.
Performance Optimizatio
n
Optimize data processing workflows and database performance.
Identify and resolve data- related issues and bottlenecks.
Documentation
Ensure all data engineering practices comply with company policies and industry standards.
Create and maintain documentation for data pipelines, processes, and data models.
Yêu cầu công việc
Yêu cầu công việc
Knowledge of cloud platforms (e.g., AWS, Azure, Google Cloud) and their data services.
Proficiency in programming languages such as Python or Java.
Bachelor&039;s degree in computer science, Engineering, or a related field.
Experience with ETL tools (e.g., Talend, Apache Nifi) and data integration processes.
Strong problem- solving skills and attention to detail.
From 2 years of experience in data engineering or a related role.
English communication skills, both written and verbal is a plus.
Familiarity with big data technologies (e.g., Hadoop, Spark) and data processing frameworks.
Strong experience with SQL and relational databases (e.g., MySQL, PostgreSQL, SQL Server).
Preferred Skills
Experience with NoSQL databases (e.g., MongoDB, Cassandra).
Certification in cloud data services or big data technologies.
Experience with version control systems (e.g., Git) and CI/CD pipelines.
Familiarity with containerization and orchestration tools (e.g., Docker, Kubernetes).
Knowledge of data warehousing concepts and tools (e.g., Snowflake, Redshift, BigQuery).
Understanding of machine learning and data analytics concepts.
Quyền lợi
Professional, creative and dynamic working environment
Probation salary is 100% of the official salary
Enjoy company summer trips and other team building activities held monthly and quarterly
Employee’s professional certification and training allowances subject to company regulations
Annual Health Assessment
Social, health and unemployment insurance following government policy
Work five days per week with flexible working time
Bonus for special occasions each year (Labor Day, National Day, Solar New Year, Lunar New Year)
Have chances to gain knowledge on the latest waves of blockchain, AI, Big Data
Project bonuses
BIC Care Health Insurance
13th- month salary and performance review twice a year
Cập nhật gần nhất lúc: 2024-08-06 02:40:03
Datatyk là công ty tư vấn có trụ sở tại Việt Nam, chuyên cung cấp các giải pháp Phân tích dữ liệu và tư vấn Business Intelligence.