fix: improved caching by simply keeping groupings of tool calls by terminating a round on each tool merge into the bucket, rather than waiting for LLM narration to end a round.
This commit is contained in:
6 files changed
+297
-15
No files matched your search
@@ -600,6 +600,7 @@ mod tests {
|
||||
tool_results: vec![],
|
||||
text: "leftover text".to_string(),
|
||||
sequence: false,
|
||||
round_starts: vec![],
|
||||
}),
|
||||
),
|
||||
],
|
||||
|
||||
Reference in new issue
Block a user