Streaming doesn't work on IDX

General
1

I was experimenting with some http streaming with ReadableStream until I realized it works on local but not when backend is running on idx.

The response gets buffered and then sent as one chunk.

2

That is interesting. Adding @ksat and @chandra for thoughts here. We are working on enabling streaming support for Flutter DevTools and for improving some of our AI responses, but I am not sure if that would also unblock your usecase here.

3

I think this is a needed feature for people building chat apps or anything similar that needs the server to stream text to client. If it’s not of your interest, adding a way to inform the user about this so they do not waste time debugging

4

We are hoping to add streaming support in the next few weeks, so stay tuned. This is very much a scenario we want to support.