Ambitionplus Custom Solutions .,ltd

Tóm tắt công việc
Strategically explore and obtain data and information from various sources within the ecosystem and external partners into VNPAY's core platform
Ensure data assets are organized and stored most efficiently for mining purposes
Design, build and maintain optimized data pipelines and ETL/ELT solutions as business support tools in providing analysis and real-time analytics platform for critical decision making.
Proactively collaborate with data users to understand data requirements, build and deploy optimized data solutions
Evaluate current complex data architecture in the organization and identify mandatory improvements
Define strategies for data infrastructure to fulfill data analytic and utilization needs of the organization
Manage and drive the upgrades to systems and storage to accommodate business and product requirements for data operations
Design and deliver data infrastructure and functionalities with the most suitable technologies for data analysts, data scientists, and other business roles to monetize data and fulfill the strategy of VNPAYGood at 1 of these 3 programming languages: Java, Scala, Python
Worked with bigdata eco-system: Hadoop, Spark, Kafka, Nifi, Airflow, Flink, Kafka, Hive, Delta Lake
Worked with NOSQL databases: Mongo, Redis and SQL databases: oracle, Postgres
Worked with Docker, Kubernetes, Google Bigquery, Cassandra is a plus
Basic knowledge of searching and sorting algorithms.
Deep experiences in optimizing ETL tasks, designing and building dimensional data models
Understanding of Information Security principles to ensure compliantly
Experience working in Agile teams to lead successful innovative projects with a cross-functional team
Experience architecting, coding, and delivering high-performance microservices and/or delivering solutions serving millions of users
Worked with HyperLogLog algorithm is a plus