When the workflow configuration becomes long, the stream output format is lost

[ITMeow]

Self Checks

• This is only for bug report, if you would like to ask a question, please head to Discussions.
• I have searched for existing issues search for existing issues, including closed ones.
• I confirm that I am using English to submit this report (我已阅读并同意 Language Policy).
• [FOR CHINESE USERS] 请务必使用英文提交 Issue，否则会被关闭。谢谢！:）
• Please do not modify this template :) and fill in all the required fields.

Dify version

0.14.1

Cloud or Self Hosted

Self Hosted (Docker)

Steps to reproduce

From the image, it can be seen that when there are many nodes configured in front, such as knowledge base retrieval and code execution, when the process reaches the last LLM node, the streaming output turns into a blocking mode output, including API output as well

✔️ Expected Behavior

When the last LLM node outputs, keep the streaming output

❌ Actual Behavior

Now in blocking output

[dosubot]

Hey @ITMeow! 👋 I'm here to help you with any bugs, questions, or contributions you may have while waiting for a human maintainer. Let's squash those bugs together!

To maintain the streaming output format in a self-hosted Dify workflow when the configuration becomes long and reaches the last LLM node, you should add a Direct Reply Node inside the iteration node. This setup allows for streaming output after each iteration, ensuring that the output is maintained in a streaming format even when the configuration is extensive ^[1].

To continue talking to Dosu, mention @dosu.

---

^{Help Dosu learn! Give it feedback: Great Response | Irrelevant Answer | Incorrect Sources | Too Verbose | Hallucination | Other}

[ITMeow]

Hey @ITMeow! 👋 I'm here to help you with any bugs, questions, or contributions you may have while waiting for a human maintainer. Let's squash those bugs together!

To maintain the streaming output format in a self-hosted Dify workflow when the configuration becomes long and reaches the last LLM node, you should add a Direct Reply Node inside the iteration node. This setup allows for streaming output after each iteration, ensuring that the output is maintained in a streaming format even when the configuration is extensive [1].

To continue talking to Dosu, mention @dosu.

Help Dosu learn! Give it feedback: Great Response | Irrelevant Answer | Incorrect Sources | Too Verbose | Hallucination | Other

I think you misunderstood me, I said that there are many nodes in chatflow, not long text, and I did not use iterative nodes, until update 0.14.0, llm output is able to display the streaming form well

[SingleKey]

After I removed the variable aggregator, the output is still blocking rather than streaming. Could you please guide me on how to modify the yml file to resolve this issue?

[oDoubleyz]

I encountered the same problem, simple workflows are normal, but complex workflows do not have streaming outputs. version:0.14.2

[yihong0618]

I encountered the same problem, simple workflows are normal, but complex workflows do not have streaming outputs. version:0.14.2

can you share the dsl or the prompt?

[Kevin9703]

I encountered the same problem, simple workflows are normal, but complex workflows do not have streaming outputs. version:0.14.2

+1 Experiencing exactly the same issue

[Kevin9703]

@laipz8200 Sorry to bother you. At your convenience, could you please review this issue? It's currently impacting our production business. Really appreciate your help.

[yihong0618]

@laipz8200 Sorry to bother you. At your convenience, could you please review this issue? It's currently impacting our production business. Really appreciate your help.

can you share your dsl I would like to give a look

[Kevin9703]

@laipz8200 Sorry to bother you. At your convenience, could you please review this issue? It's currently impacting our production business. Really appreciate your help.

can you share your dsl I would like to give a look

Sure, what's the best way to share it privately with you?

[yihong0618]

@laipz8200 Sorry to bother you. At your convenience, could you please review this issue? It's currently impacting our production business. Really appreciate your help.

can you share your dsl I would like to give a look

Sure, what's the best way to share it privately with you?

email is ok zouzou0208@gmail.com

[ritamariavermelho06]

@yihong0618 Same here, if we add a simple if node, the stream is lost! you can try that dsl on the cloud.

Gravacao.de.Tela.2025-01-03.as.12.11.37.mov

https://drive.google.com/file/d/1-8CWhWeC0p-BIDlzeDmvHd1JE3Q87hHJ/view?usp=sharing

[yihong0618]

can you try this patch @Kevin9703 @ritamariavermelho06
#12355

[Kevin9703]

can you try this patch @Kevin9703 @ritamariavermelho06 #12355

Works now! But wondering what was the root cause? ?

[yihong0618]

The logic here is a bit complicated, you can check the diff and the history,
for short answer is that, the answer node for streaming is kind of mess with the if else node
cc @laipz8200