Tiered Storage was made generally available in Confluent Platform 6.0. This allowed for our users to use cost-effective object storage for long term storage of their Kafka data.
Object Stores have gotten really good in recent years. Especially when it comes to performance, durability, and resilience. Tiered Storage gives our self-managed users the flexibility to scale compute resources independently of storage comes with some important operational benefits in addition to cost savings.
Because only a small fraction of a users data remains locally on the Kafka broker, data movement operations such as rebalancing or failure recovery happens extremely fast since the majority of data is sitting in object storage.
This is an absolute game changer for our users and we were extremely proud when this launched.
https://www.confluent.io/blog/confluent-platform-6-0-delivers-the-most-powerful-event-streaming-platform-to-date/
Object Stores have gotten really good in recent years. Especially when it comes to performance, durability, and resilience. Tiered Storage gives our self-managed users the flexibility to scale compute resources independently of storage comes with some important operational benefits in addition to cost savings.
Because only a small fraction of a users data remains locally on the Kafka broker, data movement operations such as rebalancing or failure recovery happens extremely fast since the majority of data is sitting in object storage.
This is an absolute game changer for our users and we were extremely proud when this launched.
https://www.confluent.io/blog/confluent-platform-6-0-delivers-the-most-powerful-event-streaming-platform-to-date/