Showcase: Stateless Kafka Broker built with async Rust and pluggable storage backends

Hi all!

Operating Kafka at scale is complex and often doesn't fit well into cloud-native or ephemeral environments. I wanted to experiment with a simpler, stateless design.

So I built a **stateless Kafka-compatible broker in Rust**, focusing on:

- No internal state (all metadata and logs are delegated to external storage)

- Pluggable storage backends (e.g., Redis, S3, file-based)

- Written in pure async Rust

It's still experimental, but I'd love to get feedback and ideas! Contributions are very welcome too.

👉 [https://github.com/m-masataka/stateless-kafka-broker]

Thanks for checking it out!