Package org.springframework.ai.azure.openai

Class AzureOpenAiChatModel

java.lang.Object

org.springframework.ai.chat.model.AbstractToolCallSupport

org.springframework.ai.azure.openai.AzureOpenAiChatModel

All Implemented Interfaces:

ChatModel, StreamingChatModel, Model<Prompt,ChatResponse>, StreamingModel<Prompt,ChatResponse>

public class AzureOpenAiChatModel
extends AbstractToolCallSupport
implements ChatModel

ChatModel implementation for Microsoft Azure AI backed by OpenAIClient.

Since:

1.0.0

Author:

Mark Pollack, Ueibin Kim, John Blum, Christian Tzolov, Grogdunn, Benoit Moussaud, Thomas Vitale, luocongqiu, timostark, Soby Chacko, Jihoon Kim, Ilayaperumal Gopinathan, Alexandros Pappas

See Also:

• ChatModel
• OpenAIClient

Field Summary

Fields inherited from class org.springframework.ai.chat.model.AbstractToolCallSupport

functionCallbackRegister, functionCallbackResolver, IS_RUNTIME_CALL

Constructor Summary

Constructors

Constructor	Description
AzureOpenAiChatModel(com.azure.ai.openai.OpenAIClientBuilder openAIClientBuilder)
AzureOpenAiChatModel(com.azure.ai.openai.OpenAIClientBuilder openAIClientBuilder, AzureOpenAiChatOptions options)
AzureOpenAiChatModel(com.azure.ai.openai.OpenAIClientBuilder openAIClientBuilder, AzureOpenAiChatOptions options, FunctionCallbackResolver functionCallbackResolver)
AzureOpenAiChatModel(com.azure.ai.openai.OpenAIClientBuilder openAIClientBuilder, AzureOpenAiChatOptions options, FunctionCallbackResolver functionCallbackResolver, List<FunctionCallback> toolFunctionCallbacks)
AzureOpenAiChatModel(com.azure.ai.openai.OpenAIClientBuilder openAIClientBuilder, AzureOpenAiChatOptions options, FunctionCallbackResolver functionCallbackResolver, List<FunctionCallback> toolFunctionCallbacks, io.micrometer.observation.ObservationRegistry observationRegistry)

Method Summary

Modifier and Type	Method	Description
ChatResponse	call(Prompt prompt)	Executes a method call to the AI model.
static ChatResponseMetadata	from(com.azure.ai.openai.models.ChatCompletions chatCompletions, PromptMetadata promptFilterMetadata)
static ChatResponseMetadata	from(com.azure.ai.openai.models.ChatCompletions chatCompletions, PromptMetadata promptFilterMetadata, com.azure.ai.openai.models.CompletionsUsage usage)
static ChatResponseMetadata	from(com.azure.ai.openai.models.ChatCompletions chatCompletions, PromptMetadata promptFilterMetadata, Usage usage)
static ChatResponseMetadata	from(ChatResponse chatResponse, Usage usage)
AzureOpenAiChatOptions	getDefaultOptions()
ChatResponse	internalCall(Prompt prompt, ChatResponse previousChatResponse)
reactor.core.publisher.Flux<ChatResponse>	internalStream(Prompt prompt, ChatResponse previousChatResponse)
void	setObservationConvention(ChatModelObservationConvention observationConvention)	Use the provided convention for reporting observation data
reactor.core.publisher.Flux<ChatResponse>	stream(Prompt prompt)	Executes a method call to the AI model.

Methods inherited from class org.springframework.ai.chat.model.AbstractToolCallSupport

buildToolCallConversation, executeFunctions, getFunctionCallbackRegister, handleToolCalls, isProxyToolCalls, isToolCall, isToolCall, resolveFunctionCallbacks, runtimeFunctionCallbackConfigurations

Methods inherited from class java.lang.Object

clone, equals, finalize, getClass, hashCode, notify, notifyAll, toString, wait, wait, wait

Methods inherited from interface org.springframework.ai.chat.model.ChatModel

call, call

Methods inherited from interface org.springframework.ai.chat.model.StreamingChatModel

stream, stream

Constructor Details

AzureOpenAiChatModel

public AzureOpenAiChatModel(com.azure.ai.openai.OpenAIClientBuilder openAIClientBuilder)

AzureOpenAiChatModel

public AzureOpenAiChatModel(com.azure.ai.openai.OpenAIClientBuilder openAIClientBuilder,
 AzureOpenAiChatOptions options)

AzureOpenAiChatModel

public AzureOpenAiChatModel(com.azure.ai.openai.OpenAIClientBuilder openAIClientBuilder,
 AzureOpenAiChatOptions options,
 FunctionCallbackResolver functionCallbackResolver)

AzureOpenAiChatModel

public AzureOpenAiChatModel(com.azure.ai.openai.OpenAIClientBuilder openAIClientBuilder,
 AzureOpenAiChatOptions options,
 FunctionCallbackResolver functionCallbackResolver,
 List<FunctionCallback> toolFunctionCallbacks)

AzureOpenAiChatModel

public AzureOpenAiChatModel(com.azure.ai.openai.OpenAIClientBuilder openAIClientBuilder,
 AzureOpenAiChatOptions options,
 FunctionCallbackResolver functionCallbackResolver,
 List<FunctionCallback> toolFunctionCallbacks,
 io.micrometer.observation.ObservationRegistry observationRegistry)

Method Details

from

public static ChatResponseMetadata from(com.azure.ai.openai.models.ChatCompletions chatCompletions,
 PromptMetadata promptFilterMetadata,
 Usage usage)

from

public static ChatResponseMetadata from(com.azure.ai.openai.models.ChatCompletions chatCompletions,
 PromptMetadata promptFilterMetadata)

from

public static ChatResponseMetadata from(com.azure.ai.openai.models.ChatCompletions chatCompletions,
 PromptMetadata promptFilterMetadata,
 com.azure.ai.openai.models.CompletionsUsage usage)

from

public static ChatResponseMetadata from(ChatResponse chatResponse,
 Usage usage)

getDefaultOptions

public AzureOpenAiChatOptions getDefaultOptions()

Specified by:

getDefaultOptions in interface ChatModel

call

public ChatResponse call(Prompt prompt)

Description copied from interface: Model

Executes a method call to the AI model.

Specified by:

call in interface ChatModel

Specified by:

call in interface Model<Prompt,ChatResponse>

Parameters:

prompt - the request object to be sent to the AI model

Returns:

the response from the AI model

internalCall

public ChatResponse internalCall(Prompt prompt,
 ChatResponse previousChatResponse)

stream

public reactor.core.publisher.Flux<ChatResponse> stream(Prompt prompt)

Description copied from interface: StreamingModel

Executes a method call to the AI model.

Specified by:

stream in interface ChatModel

Specified by:

stream in interface StreamingChatModel

Specified by:

stream in interface StreamingModel<Prompt,ChatResponse>

Parameters:

prompt - the request object to be sent to the AI model

Returns:

the streaming response from the AI model

internalStream

public reactor.core.publisher.Flux<ChatResponse> internalStream(Prompt prompt,
 ChatResponse previousChatResponse)

setObservationConvention

public void setObservationConvention(ChatModelObservationConvention observationConvention)

Use the provided convention for reporting observation data

Parameters:

observationConvention - The provided convention