feat: Streaming (DSN-2619)

[mikaalnaik]

Fixes or implements VF-XXX

Brief description. What is this change?

Implementation details. How do you make this change?

Setup information

Deployment Notes

Related PRs

• https://github.com/voiceflow/XXXXXXXXX/pull/123

Checklist

• Breaking changes have been communicated, including:
  • New required environment variables
  • Renaming of interfaces (API routes, request/response interface, etc)
• New environment variables have been deployed
• Appropriate tests have been written
  • Bug fixes are accompanied by an updated or new test
  • New features are accompanied by a new test

[linear]

DSN-2619 Support streaming of responses using the new streaming API

[vercel]

The latest updates on your projects. Learn more about Vercel for Git ↗︎

Name	Status	Preview	Comments	Updated (UTC)
react-chat	✅ Ready (Inspect)	Visit Preview	💬 Add feedback	Dec 18, 2024 8:02pm

[graphite-app]

How to use the Graphite Merge Queue

Add either label to this PR to merge it via the merge queue:

• merge - adds this PR to the back of the merge queue
• hotfix - for urgent hot fixes, skip the queue and merge this PR next

You must have a Graphite account in order to use the merge queue. Sign up using this link.

An organization admin has required the Graphite Merge Queue in this repository.

Please do not merge from GitHub as this will restart CI on PRs being processed by the merge queue.