Kafka admin

Job Title: Sr. AWS MSK Specialist (Kafka Admin)

Job Summary:

We're looking for a skilled Kafka Admin with expertise in AWS Managed Streaming for Apache Kafka (MSK) to design, build, and maintain high-performance data pipelines. You'll work closely with data architects and software engineers to ensure seamless data integration and streaming capabilities using AWS MSK.

Responsibilities:

Design, develop, and manage real-time data pipelines using AWS MSK Integrate AWS MSK with various data sources and consumers Monitor and optimize AWS MSK cluster performance and costs Collaborate with Dev Ops to ensure optimal performance and uptime Implement security best practices for data streaming and storage Document technical processes and best practices Work with AWS services like S3, Glue, and Lambda for data processing and integration

Requirements:

Bachelor's degree in computer science, Engineering, or a related field 4-5 years of experience working with AWS MSK or Apache Kafka in a production environment Strong understanding of distributed systems, real-time data processing, and cloud-based data streaming Proficiency in programming languages such as Python Experience with AWS services like S3, Glue, and Lambda Excellent problem-solving and debugging skills

Nice-to-Have Skills:

Experience with containerization technologies like Docker and Kubernetes Familiarity with other messaging systems like Rabbit MQ or Apache Pulsar Experience with data serialization formats like Avro, Protobuf, or JSON Knowledge of Snowflake or other cloud-based data warehousing solutions