Package org.springframework.ai.ollama

Class OllamaChatModel

java.lang.Object

org.springframework.ai.ollama.OllamaChatModel

All Implemented Interfaces:

ChatModel, StreamingChatModel, Model<Prompt,ChatResponse>, StreamingModel<Prompt,ChatResponse>

public class OllamaChatModel
extends Object
implements ChatModel

ChatModel implementation for Ollama. Ollama allows developers to run large language models and generate embeddings locally. It supports open-source models available on [Ollama AI Library](...) and on Hugging Face. Please refer to the official Ollama website for the most up-to-date information on available models.

Since:

1.0.0

Author:

Christian Tzolov, luocongqiu, Thomas Vitale, Jihoon Kim, Alexandros Pappas, Ilayaperumal Gopinathan, Sun Yuhan

Nested Class Summary

Nested Classes

Modifier and Type	Class	Description
static final class	OllamaChatModel.Builder

Constructor Summary

Constructors

Constructor	Description
OllamaChatModel(OllamaApi ollamaApi, OllamaOptions defaultOptions, ToolCallingManager toolCallingManager, io.micrometer.observation.ObservationRegistry observationRegistry, ModelManagementOptions modelManagementOptions)
OllamaChatModel(OllamaApi ollamaApi, OllamaOptions defaultOptions, ToolCallingManager toolCallingManager, io.micrometer.observation.ObservationRegistry observationRegistry, ModelManagementOptions modelManagementOptions, ToolExecutionEligibilityPredicate toolExecutionEligibilityPredicate, org.springframework.retry.support.RetryTemplate retryTemplate)

Method Summary

Modifier and Type	Method	Description
static OllamaChatModel.Builder	builder()
ChatResponse	call(Prompt prompt)	Executes a method call to the AI model.
ChatOptions	getDefaultOptions()
void	setObservationConvention(ChatModelObservationConvention observationConvention)	Use the provided convention for reporting observation data
reactor.core.publisher.Flux<ChatResponse>	stream(Prompt prompt)	Executes a method call to the AI model.

Methods inherited from class java.lang.Object

clone, equals, finalize, getClass, hashCode, notify, notifyAll, toString, wait, wait, wait

Methods inherited from interface org.springframework.ai.chat.model.ChatModel

call, call

Methods inherited from interface org.springframework.ai.chat.model.StreamingChatModel

stream, stream

Constructor Details

OllamaChatModel

public OllamaChatModel(OllamaApi ollamaApi,
 OllamaOptions defaultOptions,
 ToolCallingManager toolCallingManager,
 io.micrometer.observation.ObservationRegistry observationRegistry,
 ModelManagementOptions modelManagementOptions)

OllamaChatModel

public OllamaChatModel(OllamaApi ollamaApi,
 OllamaOptions defaultOptions,
 ToolCallingManager toolCallingManager,
 io.micrometer.observation.ObservationRegistry observationRegistry,
 ModelManagementOptions modelManagementOptions,
 ToolExecutionEligibilityPredicate toolExecutionEligibilityPredicate,
 org.springframework.retry.support.RetryTemplate retryTemplate)

Method Details

builder

public static OllamaChatModel.Builder builder()

call

public ChatResponse call(Prompt prompt)

Description copied from interface: Model

Executes a method call to the AI model.

Specified by:

call in interface ChatModel

Specified by:

call in interface Model<Prompt,ChatResponse>

Parameters:

prompt - the request object to be sent to the AI model

Returns:

the response from the AI model

stream

public reactor.core.publisher.Flux<ChatResponse> stream(Prompt prompt)

Description copied from interface: StreamingModel

Executes a method call to the AI model.

Specified by:

stream in interface ChatModel

Specified by:

stream in interface StreamingChatModel

Specified by:

stream in interface StreamingModel<Prompt,ChatResponse>

Parameters:

prompt - the request object to be sent to the AI model

Returns:

the streaming response from the AI model

getDefaultOptions

public ChatOptions getDefaultOptions()

Specified by:

getDefaultOptions in interface ChatModel

setObservationConvention

public void setObservationConvention(ChatModelObservationConvention observationConvention)

Use the provided convention for reporting observation data

Parameters:

observationConvention - The provided convention