Techment — Site Header

What is Kafka Connect

Definition

Kafka Connect is a framework within Apache Kafka for reliably streaming data between Kafka and external systems using reusable, configuration-driven connectors, so teams can move data in and out of Kafka at scale without writing custom integration code.

« Back to Glossary Index

Moves data between Kafka and external systems through configuration, not custom code
Offers a large ecosystem of ready-made source and sink connectors
Scales and handles fault tolerance for connectors automatically
Standardises integrations, reducing bespoke pipeline maintenance

Real World Example

A company uses a Kafka Connect source connector to stream database changes into Kafka and a sink connector to land those events in cloud storage, all configured declaratively rather than coded by hand.

FAQs

What is Kafka Connect used for?

It streams data between Kafka and external systems like databases and storage using reusable, configurable connectors.

What is the difference between source and sink connectors?

Source connectors pull data into Kafka from external systems, while sink connectors push data from Kafka out to external systems.

Why use Kafka Connect instead of custom code?

It provides scalable, fault-tolerant, configuration-driven integration, removing the need to build and maintain bespoke connectors.