Posts tagged "streaming"

Scanner benchmarks are easy to make fast by changing the work. I use a reproducible matrix for construction, chunks, matches, prefilters, cache state, and result validation.

An automaton can recognize a cross-chunk match with little state, yet a streaming API may still need bytes. The missing distinction is recognition state versus output state.

A pattern may begin in one input chunk and finish in the next. I explain the state, offsets, and split-point tests needed to keep a Rust streaming scanner correct.

Zero-copy scanning still reads every inspected byte. It removes a second materialization in memory. I use streaming Aho-Corasick to explain automaton state, chunk boundaries, DFA dependency chains, prefilters, and honest performance measurement.

The sliding window pattern shows up in rate limiters, monitoring dashboards, and analytics pipelines. This guide explains the concept from first principles, then builds a real-time stock price monitor in Go step by step — explaining each piece before writing a line of code.