Streaming

What it is

Streaming delivers AI responses token-by-token as they're generated rather than waiting for the complete response. You see text appear progressively, like watching someone type. Most chat interfaces use streaming; APIs offer it as an option.

Why it matters

Streaming improves user experience by eliminating the wait for long responses. Users can start reading immediately and can cancel if the response is heading in the wrong direction. For applications, streaming creates more responsive interfaces and can enable early processing of partial responses.