Expand description
Tool execution engine with batching and streaming support.
Tools marked is_concurrency_safe are grouped into
concurrent batches; others run sequentially. Batches preserve the original
call order in their results so the model always sees deterministic output.
Structs§
- Tool
Execution Output - Buffered output of tool execution — events in chronological order, results in the original call order.
Enums§
- Tool
Execution Event - Lifecycle event emitted by the executor for one tool invocation.
- Tool
Execution Stream Item - Items yielded by the streaming executor — lifecycle events as they happen, and final results once each call completes.