Struct RoutedProvider 

pub struct RoutedProvider { /* private fields */ }

A ModelProvider that routes requests to different models based on ModelHint.

Providers are pre-created at construction time — one per unique model name in the config. Provider selection is a simple HashMap lookup with no allocation on the hot path.

Implementations

impl RoutedProvider

pub fn new(config: RoutedModelConfig) -> Self

Trait Implementations

impl ModelProvider for RoutedProvider

fn complete<'life0, 'async_trait>( &'life0 self, request: CompletionRequest, ) -> Pin<Box<dyn Future<Output = Result<CompletionResponse, AgentError>> + Send + 'async_trait>>

where Self: 'async_trait, 'life0: 'async_trait,

Issue a single non-streaming completion request.

fn stream_complete<'a>( &'a self, request: CompletionRequest, ) -> Pin<Box<dyn Stream<Item = Result<ProviderEvent, AgentError>> + Send + 'a>>

Stream a completion as a sequence of ProviderEvents.

fn estimate_tokens(&self, text: &str) -> usize

Estimate the number of tokens for the given text.

fn max_tokens(&self) -> u32

Return the maximum number of tokens that can be requested from this provider.