30/09/2026
Databricks just removed one of streaming's biggest constraints.
For years, once you set the partition count on a stateful Structured Streaming query, you were stuck with it for the life of the checkpoint — no right-sizing, no scaling with demand. Databricks' new On-Demand State Repartitioning changes that: resize partitions on a live stream, zero checkpoint rebuild, zero state loss.
If you're running fraud detection, real-time dashboards, or IoT pipelines on Databricks, this is worth a read.
Read more: https://zurl.co/Q8hNQ
Our Databricks-certified engineers can help you evaluate and adopt it. Let's talk
Databricks now lets you resize stateful streaming partitions without losing checkpoint data. Learn what it means and how Simbus can help you adopt it.