Three Streaming Engines, Three Answers: Spark, Flink, and Kafka Streams
The choice is rarely about features. It is about the latency you actually need, how much state you will carry, and whether you want a cluster to operate.
-
-
Changelog Topic
Keep state locally and back it with a log: simple to reason about, and the reason a restart takes as long as the log is long.