Skip to main content
The Kafka Source Connector integrates with Apache Kafka, a distributed, fault-tolerant, and highly-scalable event streaming platform designed for handling real-time data streams. It enables the efficient publishing, storing, and processing of large volumes of events, making it ideal for building data pipelines, messaging systems, and real-time analytics applications. Kafka is widely used across various industries for its high throughput, low latency, and strong durability guarantees.

​
Compatible versions

Brokers older than 2.1 are not supported — the client negotiates API versions with the cluster and no longer implements the pre-2.1 protocol.

​
Key Features

  • Continuous consumption: the connector subscribes to your Kafka topics and streams events into Popsink as they are produced.
  • Broad authentication support: PLAINTEXT, SSL, and SASL (PLAIN, SCRAM-SHA-256, SCRAM-SHA-512, OAUTHBEARER, GSSAPI), including mutual TLS.
  • Message metadata: optionally include Kafka message metadata (topic, partition, offset, timestamp) alongside the payload.

​
Prerequisites

  • A reachable Kafka cluster.
  • Credentials with permission to read from the source topics (and to use the configured consumer group).

​
Configuration

​
TLS and Mutual TLS

When connecting over SSL or SASL_SSL, you can additionally provide certificates (PEM or base64-encoded PEM):

​
Security Protocols