Lead Kafka Platform Engineer (Remote)

The primary focus of this role is to oversee and improve our systems that are powered by Kafka, focusing on their performance, safety, and growth potential.

Responsibilities

• Oversee the creation and management of new Kafka clusters and pertinent components
• Regularly check the health and efficiency of the system and its data pipelines
• Troubleshoot and solve technical issues within the platform
• Constantly fine-tune components of the Kafka platform to ensure optimal functionality
• Coordinate updates and enhancements to Kafka clusters
• Enforce security protocols for data safety and regulate access
• Monitor the capacity of the Kafka platform and strategize for prospective expansion
• Document detailed processes and solutions and communicate them within the team
• Work with Confluent Support to address complex unsolved problems
• Manage Infrastructure as Code and Configuration Management tools specific to Kafka platforms
• Create and improve automation scripts to simplify platform management
• Enable Kafka self-service automation options to boost user independence
• Aid application teams in integrating Kafka services
• Direct escalations of team support inquiries through proper channels
• Launch new features that align with updates from related vendors

Requirements

• Over 5 years of expertise in Apache Kafka
• Demonstrable experience in managing and maintaining Confluent Platform, including mastery of Kubernetes and HELM
• Qualifications or certifications such as Confluent Certified Developer or Administrator for Apache Kafka are desired
• Understanding of Kubernetes, HELM, Groovy, and Jenkins
• Capability to create automation with Python and Groovy
• Mastery in analyzing and resolving intricate technical problems
• Excellent communication abilities both in writing and speaking

Nice to have

• Competency in Python/Shell scripting, automation, Jenkins pipelines, and Groovy at an intermediate level
• Intermediate understanding of GCP
• Comprehensive knowledge at an intermediate level regarding Linux system settings and management

We offer

• Voluntary health insurance for you (100% covered) and your family (with corporate discount)
• Individual sessions with professional psychologists and coaches
• Free corporate sports and wellness programs
• Paid time off
• Free licensed software
• Relocation and mobility programs
• Flexible and hybrid work opportunities
• Access to soft skills training in general communication, presenting and public speaking, diversity, equity and inclusion (DEI), cultural Intelligence, self-productivity, well-being and more.
• Unlimited access to the LinkedIn Learning Library, including 22,000+ courses
• Over 20 language courses
• Access to internal learning platforms, EPAM University and a wide range of professional communities and competency centers
• Upskilling, reskilling and certification courses 
• Skill advisory service