Skip to content

perf(executor): stop re-parsing the whole structured output on every streamed token #40097

perf(executor): stop re-parsing the whole structured output on every streamed token

perf(executor): stop re-parsing the whole structured output on every streamed token #40097

Job Run time
24s
-1s
-1s
-1s
-1s
-1s
0s
-1s
0s
-1s
-1s
0s
0s
0s
0s
0s
0s
0s
0s
0s
0s
0s
0s
-1s
-11s
4m 43s
4m 50s
4m 10s
5m 37s
5m 53s
2m 22s
5m 54s
3m 53s
5m 33s
2m 25s
5m 11s
4m 16s
6m 19s
5m 7s
4m 57s
5m 0s
5m 9s
3m 33s
5m 40s
4m 9s
5m 49s
5m 37s
2m 18s
4m 15s
1m 54s
2m 32s
2m 29s
4m 10s
4m 11s
1m 55s
1m 42s
2m 25s
3m 29s
3m 5s
4m 57s
1m 32s
3m 46s
3m 40s
3m 59s
1m 28s
4m 41s
1m 26s
6s
2h 46m 11s