Package org.springframework.ai.session.compaction

Class ChatModelSummarizer

java.lang.Object

org.springframework.ai.session.compaction.ChatModelSummarizer

All Implemented Interfaces:

CompactionSummarizer

public final class ChatModelSummarizer
extends Object
implements CompactionSummarizer

A CompactionSummarizer that asks a ChatModel for a rolling summary of the covered conversation: the prior summary is fed back as context, so each summary builds on its predecessors, and the first overlapSize preserved events are quoted for continuity. The summary comes back as a turn of two messages, a user "shadow prompt" and the assistant summary, so the model keeps seeing a user/assistant alternation. A failed model call or a null or blank reply declines: it is logged, the failure callback is called, and the view stays as it is.

Since:

2.1.0

Author:

Christian Tzolov

Nested Class Summary

Nested Classes

Modifier and Type	Class	Description
static final class	ChatModelSummarizer.Builder

Field Summary

Fields

Modifier and Type	Field	Description
static final int	DEFAULT_OVERLAP_SIZE	Default number of preserved events quoted in the prompt for continuity.
static final String	DEFAULT_SHADOW_PROMPT	The synthetic user message that opens each summary turn.

Method Summary

Modifier and Type	Method	Description
static ChatModelSummarizer.Builder	builder(ChatModel chatModel)
List<Message>	summarize(SummaryRequest request)	Summarizes the events that leave the view.

Methods inherited from class java.lang.Object

clone, equals, finalize, getClass, hashCode, notify, notifyAll, toString, wait, wait, wait

Field Details

DEFAULT_OVERLAP_SIZE

public static final int DEFAULT_OVERLAP_SIZE

Default number of preserved events quoted in the prompt for continuity.

See Also:

• Constant Field Values

DEFAULT_SHADOW_PROMPT

public static final String DEFAULT_SHADOW_PROMPT

The synthetic user message that opens each summary turn.

See Also:

• Constant Field Values

Method Details

builder

public static ChatModelSummarizer.Builder builder(ChatModel chatModel)

summarize

public List<Message> summarize(SummaryRequest request)

Description copied from interface: CompactionSummarizer

Summarizes the events that leave the view.

Specified by:

summarize in interface CompactionSummarizer

Parameters:

request - what to summarize, with the prior summary to build on and the kept events for continuity

Returns:

the messages of the summary turn, in order; empty to leave the view unchanged