How can we implement seamlessly in current codebase ?

[AkashDoke]

Issue Description:

First of all, thank you for providing such great insights and helping us understand the usage of Azure AI services. We’ve based our product on the references provided by your app and are progressing well with the implementation.

As we move forward, we have a new requirement to integrate streaming functionality into our application. From what we understand, Blazor components do not offer direct support for streaming, which makes it challenging to achieve the desired streaming approach using the native Blazor features. To address this, we have implemented a custom solution using JavaScript Interop functions provided by Blazor WebAssembly.

While this approach has allowed us to implement streaming, we are encountering performance issues. After a few rounds of questions and answers, the app starts consuming more memory, becomes slower, and occasionally gets stuck. Specifically, our current streaming implementation involves creating a DOM element to write answers, filling the actual questionAndAnswer object, and then rendering the answer component.

Questions:

• Could you advise on how we can achieve seamless streaming in our current codebase without performance issues or lag?
• Are there any best practices or considerations we might be missing that would help us implement smooth streaming functionality?

Your guidance will be highly appreciated as we look to resolve these issues and enhance the performance of our application.

Thank you!