Class ObservationChatModelListener

java.lang.Object

dev.langchain4j.observation.listener.ObservationChatModelListener

All Implemented Interfaces:

ChatModelListener

@Experimental
public class ObservationChatModelListener
extends Object
implements ChatModelListener

Will use observations and micrometer metrics to generate telemetry based on the ChatModelListener lifecycle.

Observations will handle request durations and tracing. Observation lifecycle and context management is handled here.

There is a Micrometer DistributionSummary responsible to record token usage.

Constructor Summary

Constructors

Constructor	Description
ObservationChatModelListener(io.micrometer.observation.ObservationRegistry observationRegistry, io.micrometer.core.instrument.MeterRegistry meterRegistry)

Method Summary

Modifier and Type	Method	Description
void	onError(ChatModelErrorContext errorContext)
void	onRequest(ChatModelRequestContext requestContext)
void	onResponse(ChatModelResponseContext responseContext)

Methods inherited from class Object

clone, equals, finalize, getClass, hashCode, notify, notifyAll, toString, wait, wait, wait

Constructor Details

ObservationChatModelListener

public ObservationChatModelListener(io.micrometer.observation.ObservationRegistry observationRegistry,
 io.micrometer.core.instrument.MeterRegistry meterRegistry)

Method Details

onRequest

public void onRequest(ChatModelRequestContext requestContext)

Specified by:

onRequest in interface ChatModelListener

onResponse

public void onResponse(ChatModelResponseContext responseContext)

Specified by:

onResponse in interface ChatModelListener

onError

public void onError(ChatModelErrorContext errorContext)

Specified by:

onError in interface ChatModelListener