Interface: LLM<AdditionalChatOptions>

Unified language model interface

Type parameters

Name	Type
AdditionalChatOptions	extends Record<string, unknown> = Record<string, unknown>

Hierarchy

• LLMChat<AdditionalChatOptions>

  ↳ LLM

Implemented by

• Ollama

Properties

metadata

• metadata: LLMMetadata

Defined in

packages/core/src/llm/types.ts:46

Methods

chat

▸ chat(params): Promise<AsyncIterable<ChatResponseChunk>>

Get a chat response from the LLM

Parameters

Name	Type
params	LLMChatParamsStreaming<AdditionalChatOptions>

Returns

Promise<AsyncIterable<ChatResponseChunk>>

Overrides

LLMChat.chat

Defined in

packages/core/src/llm/types.ts:50

▸ chat(params): Promise<ChatResponse>

Parameters

Name	Type
params	LLMChatParamsNonStreaming<AdditionalChatOptions>

Returns

Promise<ChatResponse>

Overrides

LLMChat.chat

Defined in

packages/core/src/llm/types.ts:53

---

complete

▸ complete(params): Promise<AsyncIterable<CompletionResponse>>

Get a prompt completion from the LLM

Parameters

Name	Type
params	LLMCompletionParamsStreaming

Returns

Promise<AsyncIterable<CompletionResponse>>

Defined in

packages/core/src/llm/types.ts:60

▸ complete(params): Promise<CompletionResponse>

Parameters

Name	Type
params	LLMCompletionParamsNonStreaming

Returns

Promise<CompletionResponse>

Defined in

packages/core/src/llm/types.ts:63