pub struct ErasedProvider<'a>(pub &'a (dyn ModelProvider + 'a));Expand description
A newtype that implements ModelProvider by delegating to an erased
&dyn ModelProvider reference. This is useful when adapting an existing
borrowed provider to APIs that require a concrete ModelProvider type.
Tuple Fields§
§0: &'a (dyn ModelProvider + 'a)Trait Implementations§
Source§impl ModelProvider for ErasedProvider<'_>
impl ModelProvider for ErasedProvider<'_>
Source§fn complete<'life0, 'async_trait>(
&'life0 self,
request: CompletionRequest,
) -> Pin<Box<dyn Future<Output = Result<CompletionResponse, AgentError>> + Send + 'async_trait>>where
Self: 'async_trait,
'life0: 'async_trait,
fn complete<'life0, 'async_trait>(
&'life0 self,
request: CompletionRequest,
) -> Pin<Box<dyn Future<Output = Result<CompletionResponse, AgentError>> + Send + 'async_trait>>where
Self: 'async_trait,
'life0: 'async_trait,
Issue a single non-streaming completion request.
Source§fn stream_complete<'a>(
&'a self,
request: CompletionRequest,
) -> Pin<Box<dyn Stream<Item = Result<ProviderEvent, AgentError>> + Send + 'a>>
fn stream_complete<'a>( &'a self, request: CompletionRequest, ) -> Pin<Box<dyn Stream<Item = Result<ProviderEvent, AgentError>> + Send + 'a>>
Stream a completion as a sequence of
ProviderEvents. Read moreSource§fn max_tokens(&self) -> u32
fn max_tokens(&self) -> u32
Return the maximum number of tokens that can be requested from this provider. Read more
Auto Trait Implementations§
impl<'a> Freeze for ErasedProvider<'a>
impl<'a> !RefUnwindSafe for ErasedProvider<'a>
impl<'a> Send for ErasedProvider<'a>
impl<'a> Sync for ErasedProvider<'a>
impl<'a> Unpin for ErasedProvider<'a>
impl<'a> UnsafeUnpin for ErasedProvider<'a>
impl<'a> !UnwindSafe for ErasedProvider<'a>
Blanket Implementations§
Source§impl<T> BorrowMut<T> for Twhere
T: ?Sized,
impl<T> BorrowMut<T> for Twhere
T: ?Sized,
Source§fn borrow_mut(&mut self) -> &mut T
fn borrow_mut(&mut self) -> &mut T
Mutably borrows from an owned value. Read more