Skip to content

Add streaming support to Conversations building block - #113

Open
WhitWaldo wants to merge 1 commit into
dapr:mainfrom
WhitWaldo:streaming-conversations
Open

WhitWaldo wants to merge 1 commit into
dapr:mainfrom
WhitWaldo:streaming-conversations

Conversation

@WhitWaldo

@WhitWaldo WhitWaldo commented Nov 12, 2026 •

Copy link
Copy Markdown
Contributor

This reflects my propose to augment the Conversation building block to add streaming responses but with support for the style used by both autoregressive models (e.g. Claude Opus, GPT Luna, Mistral, etc.) and diffusion models (Inception Lab's Mercury 3 or LLaDA-8B-Instruct ) as the approach taken by either one is different (the former appends to the output, the latter replaces it with progressive snapshots), keeping our support open-ended for whatever models developers seek to use.

…n building block

Signed-off-by: Whit Waldo <whit.waldo@innovian.net>
Sign up for free to join this conversation on GitHub. Already have an account? Sign in to comment

Labels

None yet

Projects

None yet

Development

Successfully merging this pull request may close these issues.

1 participant