A Detailed Explanation
Kafka is a distributed architecture capable of processing messages with greater volume and velocity. Designed to handle millions of messages per second from real-time applications.
Introduction to Kafka Architecture
Key APIs of the Apache Kafka Architecture
1. Producer API -
An application can publish a stream of records to a Kafka topic.
2. Consumer API -
Applications can subscribe to one or more topics and process the records generated to them.
3. Streams API -
Apps can convert input streams into output streams by consuming input streams from a topic and producing output streams from output topics.
4. Connector API -
Connect Kafka topics to existing apps or data systems.
Kafka cluster architecture consists of multiple components:
Kafka Cluster Architecture
7. Zookeeper (phasing out)
8. Schema registry
Find out what Kafka Architecture has to offer.