Mô tả công việc
As a Senior Data Engineer, you will be responsible for architecting, building, and optimizing scalable data pipelines and systems to support the organization's data needs (automatic reporting, machine learning, AI). You will collaborate closely with cross-functional teams, including, cloud devops, software engineers, business analysts and stakeholders, to ensure seamless data integration, processing, and delivery. Leveraging your expertise in big data technologies, you will drive the evolution of our data architecture, ensuring reliability, scalability, and performance.
Key Responsibilities
- Design, develop, and maintain data pipelines and ETL processes to extract, transform, and load data into designated data warehouse.
- Design, develop, and maintain automatic data visualization dashboards using respective data visualization tools.
- Collaborate with business analysts and stakeholders to understand data requirements and translate them into technical solutions, ensuring alignment with business objectives.
- Collaborate with business analysts, cloud devops to architect data models and schemas for efficient storage, retrieval, and analysis of structured and unstructured data.
- Implement best practices for data quality, governance, and security to maintain the integrity and confidentiality of data assets.
- Evaluate and implement new tools, frameworks, and technologies to enhance the capabilities of our data platform.
- Mentor junior members of the team, providing guidance on technical design, coding standards, and best practices.
- Stay current with industry trends and advancements in data manufacturing, contributing to continuous improvement and innovation within the organization.
- Perform ad-hoc data analysis requests on demand.
Yêu cầu công việc
The Must-Haves
- Bachelor's degree in Computer Science, Engineering, or related field.
- 5+ years of experience in data industry, with a proven track record of designing and implementing complex data solutions.
- Proficiency in programming languages such as Python, with experience in data processing frameworks like Spark.
- Hands-on experience with platforms like Airflow
- Strong understanding of relational and NoSQL databases, data modeling, and SQL query optimization (including optimizing and maintaining store procedures, triggers and functions).
- Proficiency in visualization tools on market like PowerBI and Tableau with a proven track record of implementing and maintaining reporting system on Tableau Cloud or Azure Power App.
- Experience with stream processing technologies (e.g., Kafka, Flink) and real-time data processing pipelines is a plus.
- Hands on experience with AWS services for data pipeline implementation including S3, Glue, Athena, Lambda, Event Bridge.
- Understanding of data format like Avro, Parquet, Delta, ORC
- Understanding of machine learning models and AI, a proven track record of implementing a machine learning model or AI to solve business case is a huge plus.
- Excellent problem-solving skills, with the ability to troubleshoot and debug complex data issues.
- Effective communication skills, with the ability to collaborate with cross-functional teams and present technical concepts to non-technical stakeholders.
The Nice-to-Haves
- Hands-on experience with Google Cloud.
- Understanding of Big Data Systems, Hive, Spark, Presto.
- Understanding PySpark or ScalaSpark.
- Knowledge of Kafka & Streaming (Flink).
- Familiar with observability tools like Splunk, Kibana.
- Understanding of LLM and Computervision.
- Understanding of Git and CI/CD.
Quyền lợi được hưởng
- 13th month salary.
- Annual salary review
- Dedicated budget for staff training: technical, soft skills, English, Korean classes.
- Telephone allowance.
- Provide Travel Expense for work
- We pay health and social insurance.
- We pay PIT
- Birthday gift
- Marriage Gift
- Baby born Gift
- Holiday and Tet Gift
- Funeral support
- 12 days of annual leave + 1 days of Establishment Ceremony Date + 2 days of Refresh Leave for 1 year joined
- We provide yearly health check-ups with International Hospital.
- Team Building activities:
- Annual outdoor Team building
- Monthly birthday Party
- Provide Laptop & Monitor
Với sự ra đời của kỷ nguyên Xe thông minh, LG hy vọng sẽ trở thành một đối tác sáng tạo trong lĩnh vực điện khí hóa phương tiện thông qua việc phát triển các thành phần công nghệ tiên tiến. Công ty Giải pháp Thành phần Xe (VS) đang phát triển nhiều loại sản phẩm có tính cạnh tranh cao. Các sản phẩm của chúng tôi bao gồm hệ thống Thông tin giải trí trong xe như Viễn thông, Điều hướng AV, Âm thanh hiển thị, Hệ thống Hiển thị Tích hợp và Hệ thống Hỗ trợ Người lái Nâng cao (ADAS) được gọi là 'an toàn thông minh' và các thiết bị tiện lợi khác. Công ty chúng tôi cũng đang tập trung vào kỹ thuật xe, bao gồm Hệ thống truyền lực, Bộ pin xe điện tử, v.v. và đang cung cấp chúng cho các khách hàng lớn trong ngành công nghiệp xe trên toàn thế giới.
Chúng tôi cung cấp một môi trường cho phép đồng nghiệp thể hiện năng lực của họ, tập trung vào công việc và tạo ra giá trị