Package org.springframework.ai.bedrock.llama2

Class BedrockLlama2ChatClient

java.lang.Object

org.springframework.ai.bedrock.llama2.BedrockLlama2ChatClient

All Implemented Interfaces:

ChatClient, StreamingChatClient, ModelClient<Prompt,ChatResponse>, StreamingModelClient<Prompt,ChatResponse>

public class BedrockLlama2ChatClient
extends Object
implements ChatClient, StreamingChatClient

Java ChatClient and StreamingChatClient for the Bedrock Llama2 chat generative.

Since:

0.8.0

Author:

Christian Tzolov

Constructor Summary

Constructors

Constructor	Description
BedrockLlama2ChatClient(Llama2ChatBedrockApi chatApi)
BedrockLlama2ChatClient(Llama2ChatBedrockApi chatApi, BedrockLlama2ChatOptions options)

Method Summary

Modifier and Type	Method	Description
ChatResponse	call(Prompt prompt)	Executes a method call to the AI model.
reactor.core.publisher.Flux<ChatResponse>	stream(Prompt prompt)	Executes a method call to the AI model.

Methods inherited from class java.lang.Object

clone, equals, finalize, getClass, hashCode, notify, notifyAll, toString, wait, wait, wait

Methods inherited from interface org.springframework.ai.chat.ChatClient

call

Constructor Details

BedrockLlama2ChatClient

public BedrockLlama2ChatClient(Llama2ChatBedrockApi chatApi)

BedrockLlama2ChatClient

public BedrockLlama2ChatClient(Llama2ChatBedrockApi chatApi,
 BedrockLlama2ChatOptions options)

Method Details

call

public ChatResponse call(Prompt prompt)

Description copied from interface: ModelClient

Executes a method call to the AI model.

Specified by:

call in interface ChatClient

Specified by:

call in interface ModelClient<Prompt,ChatResponse>

Parameters:

prompt - the request object to be sent to the AI model

Returns:

the response from the AI model

stream

public reactor.core.publisher.Flux<ChatResponse> stream(Prompt prompt)

Description copied from interface: StreamingModelClient

Executes a method call to the AI model.

Specified by:

stream in interface StreamingChatClient

Specified by:

stream in interface StreamingModelClient<Prompt,ChatResponse>

Parameters:

prompt - the request object to be sent to the AI model

Returns:

the streaming response from the AI model