Kafka supports two cleanup policies which can be specified either cluster-wide “log.cleanup.policy” or topic-level override “cleanup.policy” configuration as a comma separated list of any of

Let’s quickly examine how data is transmitted in and out of a Kafka pipeline between the producers, brokers and consumers. Typically, when compression is properly

Since 0.10.0.0, Kafka clients and brokers are by design, bidirectionally compatible, meaning new clients can talk to old brokers, and old clients can talk to

Let’s take a quick dive into Kafka storage system and see what it entails. In the end, it is hoped that this short article unravels

By design, Kafka doesn’t delete messages as soon as they are consumed unlike other pubsub messaging platforms. Delete Log Retention is basically a log cleanup