Struct MockProvider 

pub struct MockProvider {
    pub requests: Mutex<Vec<CompletionRequest>>,
    /* private fields */
}

A ModelProvider that returns pre-configured responses from a queue.

Fields

requests: Mutex<Vec<CompletionRequest>>

All requests received, in arrival order. Public so tests can assert on them.

Implementations

impl MockProvider

pub fn new(responses: Vec<CompletionResponse>) -> Self

Build a mock that will reply with responses in FIFO order.

Trait Implementations

impl ModelProvider for MockProvider

fn complete<'life0, 'async_trait>( &'life0 self, request: CompletionRequest, ) -> Pin<Box<dyn Future<Output = Result<CompletionResponse, AgentError>> + Send + 'async_trait>>

where Self: 'async_trait, 'life0: 'async_trait,

Issue a single non-streaming completion request.

fn stream_complete<'a>( &'a self, request: CompletionRequest, ) -> Pin<Box<dyn Stream<Item = Result<ProviderEvent, AgentError>> + Send + 'a>>

Stream a completion as a sequence of ProviderEvents.

fn max_tokens(&self) -> u32

Return the maximum number of tokens that can be requested from this provider.

fn estimate_tokens(&self, text: &str) -> usize

Estimate the number of tokens for the given text.