H-1B Job Board

Finding companies that sponsor visas is a lot of work.
We've made your life easier by compiling top companies and startups that hire foreign nationals.

Lead Kafka Support Engineer

EPAM Systems

EPAM Systems

Customer Service
Remote
Posted on Jun 27, 2024

Lead Kafka Support Engineer Description

We are building a Kafka platform support team and looking for a Lead Kafka Support Engineer.

The candidate will be responsible for installing, monitoring, troubleshooting, and maintaining Kafka platform, ensuring optimal performance, security, developing new features/automation/integration. Kafka Platform team are also involved into supporting PagerDuty and Uptrends SaaS including automation of these platforms support.

This role requires participation in an on-call support, including up to 8 hours on one weekend day (Saturday or Sunday).

We are supporting B2B contract only for this role.

#EasyApply

Responsibilities

  • Install and provision new Kafka clusters and supporting components
  • Regularly monitor the health and performance of the Kafka platform and data pipelines
  • Identify and fix issues related to the platform, including data pipelines, network problems, cloud or containerization resource failures, or software bugs
  • Perform regular performance tuning of Kafka platform components
  • Monitor and optimize the cost and performance of Kafka clusters
  • Upgrade the Kafka platform to newer versions, including planning, testing, and implementation
  • Manage the security of the Kafka platform, including access control lists, encryption, and regular security reviews
  • Perform regular backups and disaster recovery procedures
  • Manage the capacity of the Kafka platform, including projecting future growth and scaling needs
  • Document procedures, configurations, and issue resolutions, and share knowledge with the team
  • Work with Confluent Support for issues that cannot be resolved in-house
  • Support existing Infrastructure as Code (IaC) and Configuration Management (CM) automations/pipelines for Kafka platform management and maintenance
  • Maintain and enhance onboarding automation scripts
  • Support Kafka self-service automations for Topic, RBAC, Schema, and Connectors management
  • Support application teams in setting up and onboarding Kafka consumers, producers, connectors, and streams
  • Provide support for team requests in Slack and convert to CLOUD Tickets if complexity is high
  • Implement new features released by the vendor as part of their product roadmap, in coordination with the CoreLogic Platform owner team
  • Implement and enhance automation scripts and processes to reduce the number of tickets via self-service

Requirements

  • 5+ years of experience with Apache Kafka
  • Demonstrated experience in leading and managing teams of developers, ensuring successful project outcomes
  • Proven experience in the implementation and maintenance of Confluent Platform
  • Relevant certifications (such as Confluent Certified Developer or Administrator for Apache Kafka) would be an advantage
  • Strong knowledge of HELM
  • Experience with Python/Shell scripting and automation
  • Excellent problem-solving skills and the ability to troubleshoot complex issues
  • Experience in automating processes and maintaining automated scripts
  • Understanding of networking, and capability to coordinate with different teams including the Networking team, and CI/CD team, among others
  • Fluent English written and verbal communication skills at a B2+ level

Nice to have

  • Proficiency in GCP and AWS (compute, networking, storage, IAM)
  • Experience with Jenkins (Pipelines, Groovy), and Linux Administration
  • Competency in PagerDuty and Uptrends

We offer

  • We gather like-minded people:
    • Engineering community of industry professionals
    • Friendly team and enjoyable working environment
    • Flexible schedule and opportunity to work remotely within Poland
    • Chance to work abroad for up to 60 days annually
    • Relocation within our 50+ offices
  • We provide growth opportunities:
    • Outstanding career roadmap
    • Leadership development, career advising, soft skills, and well-being programs
    • Certification (GCP, Azure, AWS)
    • Unlimited access to LinkedIn Learning, Get Abstract, O’Reilly, Cloud Guru
    • Language classes in English and Polish for foreigners
  • We cover it all:
    • Stable income (Employment Contract or B2B)
    • Participation in the Employee Stock Purchase Plan
    • Benefits package (health insurance, multisport, shopping vouchers)
    • Strategically located offices featuring entertainment and relaxation zones, table tennis and football, free snacks, fantastic coffee, and more
    • Referral bonuses
    • Corporate, social and well-being events
  • Please, note:
    • The set of bonuses might vary based on the role you apply for – specifics will be discussed with our recruiter during the general interview
    • We will reach out to selected candidates exclusively

EPAM is a leading global provider of digital platform engineering and development services. We are committed to having a positive impact on our customers, our employees, and our communities. We embrace a dynamic and inclusive culture. Here you will collaborate with multi-national teams, contribute to a myriad of innovative projects that deliver the most creative and cutting-edge solutions, and have an opportunity to continuously learn and grow. No matter where you are located, you will join a dedicated, creative, and diverse community that will help you discover your fullest potential.