Hiring for Kafka Lead in MNC

Job Description:

Mandatory Skill combination: Mandatory skill Kafka, Multiple Kafka connector, Streaming Data processing.

In some cases, Databricks and PySpark knowledge is required.

JD:

Hands-on experience working on Kafka connect using schema registry in a very high-volume environment.

Complete understanding of Kafka config properties (acks, timeouts, buffering, partitioning, etc. ).

Hands-on experience on custom connectors using the Kafka core concepts and API.

Design, develop, and manage Kafka-based data pipelines

Design recommends the best approach suited for data movement to/from different sources using Apache/Confluent Kafka.

Expertise in Kafka brokers, zookeepers, KSQL, KStream and Kafka Control center.

Physical deployment of infrastructure across multiple environments

Create topics, set up redundancy cluster, deploy monitoring tools, and alerts, and has good knowledge of best practices.

Monitor and optimize Kafka clusters

Troubleshoot Kafka related issues

Handle customer queries and support

Work with other big data technologies such as Hadoop, Hive, Spark

Good programming skills in SQl, Python/Scala/Java

Good understanding of distributed systems

Good communication and interpersonal skills

5+ years of experience with Apache Kafka or Confluent Kafka

7+ years of experience with Data Integrations, big data or related field

10+ years relevant experiences

Good to have:

Experience / exposure to Azure environment.

Experience connecting Kafka to Oracle EBS / Oracle database as source and Azure data lake storage (ADLS Gen2) as Sink.

Experience with deploying Kafka in Azure environment.