fix: improved caching by simply keeping groupings of tool calls by terminating a round on each tool merge into the bucket, rather than waiting for LLM narration to end a round.

This commit is contained in:
Dark-Alex-17 committed 2026-09-17 16:32:21 -06:00
1 parent dc6c176b4f
commit 3ee78a46df
6 files changed
+297 -15

No files matched your search

+1
View File
@@ -600,6 +600,7 @@ mod tests {
tool_results: vec![],
text: "leftover text".to_string(),
sequence: false,
round_starts: vec![],
}),
),
],