We are seeking a highly skilled and experienced Event/Streaming Specialist with expertise in AWS Managed Streaming for Apache Kafka (MSK) to join our engineering team. In this role, you will be responsible for designing, implementing, and managing our event-driven architectures and real-time streaming solutions using AWS MSK. Your work will be pivotal in enabling our systems to process large-scale data streams efficiently, ensuring high availability, scalability, and reliability.

Requirements

Responsibilities:

AWS MSK Management:

Design, implement, and maintain streaming solutions using AWS Managed Streaming for Apache Kafka (MSK)
Monitor and manage Kafka clusters to ensure optimal performance, scalability, and uptime
Configure and fine-tune MSK clusters, including partitioning strategies, replication, and retention policies

Event-Driven Architecture:

Collaborate with our engineering teams to design and implement event-driven systems and microservices architectures

Develop and maintain robust data pipelines to process and stream data in real-time using Kafka.

Ensure seamless integration between MSK/SQS/SNS and other AWS services such as Lambda, EventBridge Pipes, S3

Performance Optimization:

Analyze and optimize the performance of Kafka clusters and streaming pipelines to meet high-throughput and low-latency requirements
Implement best practices for Kafka topic design, consumer group management, and message serialization (e.g., Avro)

Security and Compliance:

Implement security best practices for MSK, including encryption, authentication, and access controls
Ensure compliance with industry standards and regulations related to data streaming and event processing

Monitoring and Troubleshooting:

Set up comprehensive monitoring and alerting for Kafka clusters and streaming applications using AWS CloudWatch and Datadog
Troubleshoot and resolve issues related to data loss, message lag, and streaming failures

Data Integration and ETL:

Design and implement data integration solutions to stream data between various sources and targets using MSK
Lead data transformation and enrichment processes to ensure data quality and consistency in streaming applications

Benefits

Must have skills:

Bachelor's or Master's degree in Computer Science, Information Technology, or a related field
Minimum of 5 years of experience in event-driven architectures and streaming solutions
Proven experience with Apache Kafka, with at least 2 years specifically in AWS MSK
Experience in designing and implementing high-throughput, low-latency streaming applications in AWS environments
Strong understanding of Kafka internals, including partitions, brokers, consumer groups, and message serialization formats
Proficiency in programming languages such as Java, Python, or Scala for building streaming applications
Experience with AWS services like Lambda, Kinesis, S3, and IAM in conjunction with MSK
Familiarity with CI/CD tools and practices, as well as IaC tools like CloudFormation, Terraform, or CDK
Strong analytical and problem-solving skills, with a proactive approach to identifying and resolving issues
Excellent communication and collaboration skills, with the ability to work effectively across teams

Nice to have skills

AWS Certified Solutions Architect, AWS Certified Developer, or similar AWS certificatrion
Strong analytical and problem-solving skills, with a proactive approach to identifying and resolving issues
Excellent communication and collaboration skills, with the ability to work effectively across teams
Ability to manage multiple priorities and projects in a fast-paced environment

Khu vực

Long An - Việc làm tại Long An

Báo cáo

Reeracoen Xem trang công ty

Quy mô:

25 - 100 nhân viên

Địa điểm:

Eurowindow Multicomplex, 27 Đ. Trần Duy Hưng, Trung Hoà, Cầu Giấy, Hà Nội 100000

REERACOEN VIETNAM là một chi nhánh của Neo Career – Một công ty tư vấn tuyển dụng nhân sự hàng đầu tại Nhật Bản được điều hành bởi đội ngũ tư vấn tuyển dụng chuyên nghiệp. REERACOEN VIETNAM chúng tôi sẽ hỗ trợ các hoạt động tìm việc của các bạn dựa trên các kiến thức và kinh nghiệm trong lĩnh vực nhân sự mà chúng tôi có được trong hơn mười năm qua kể từ năm 2000.

Chính sách bảo hiểm

Được hưởng bảo hiểm sức khỏe.
Được hưởng bảo hiểm xã hội.

Các hoạt động ngoại khóa

Du lịch hàng năm
Party

Lịch sử thành lập

2011: Công ty được thành lập

Mission

Chúng tôi không chỉ giải quyết những vấn đề của người tìm việc hay khách hàng làm việc cùng chúng tôi, mà còn quan tâm đến sự phát triển bền vững của xã hội và môi trường.

Xem thêm