Class LocalAiStreamingChatModel

java.lang.Object

dev.langchain4j.model.localai.LocalAiStreamingChatModel

All Implemented Interfaces:

dev.langchain4j.model.chat.StreamingChatModel

public class LocalAiStreamingChatModel
extends Object
implements dev.langchain4j.model.chat.StreamingChatModel

See LocalAI documentation for more details.

Nested Class Summary

Nested Classes

Modifier and Type	Class	Description
static class	LocalAiStreamingChatModel.LocalAiStreamingChatModelBuilder

Constructor Summary

Constructors

Constructor	Description
LocalAiStreamingChatModel(LocalAiStreamingChatModel.LocalAiStreamingChatModelBuilder builder)
LocalAiStreamingChatModel(String baseUrl, String modelName, Double temperature, Double topP, Integer maxTokens, Duration timeout, Boolean logRequests, Boolean logResponses)	Deprecated, for removal: This API element is subject to removal in a future version.

Method Summary

Modifier and Type	Method	Description
static LocalAiStreamingChatModel.LocalAiStreamingChatModelBuilder	builder()
void	chat(dev.langchain4j.model.chat.request.ChatRequest chatRequest, dev.langchain4j.model.chat.response.StreamingChatResponseHandler handler)

Methods inherited from class Object

clone, equals, finalize, getClass, hashCode, notify, notifyAll, toString, wait, wait, wait

Methods inherited from interface dev.langchain4j.model.chat.StreamingChatModel

chat, chat, defaultRequestParameters, doChat, listeners, provider, supportedCapabilities

Constructor Details

LocalAiStreamingChatModel

@Deprecated(forRemoval=true,
            since="1.5.0")
public LocalAiStreamingChatModel(String baseUrl,
 String modelName,
 Double temperature,
 Double topP,
 Integer maxTokens,
 Duration timeout,
 Boolean logRequests,
 Boolean logResponses)

Deprecated, for removal: This API element is subject to removal in a future version.

LocalAiStreamingChatModel

public LocalAiStreamingChatModel(LocalAiStreamingChatModel.LocalAiStreamingChatModelBuilder builder)

Method Details

chat

public void chat(dev.langchain4j.model.chat.request.ChatRequest chatRequest,
 dev.langchain4j.model.chat.response.StreamingChatResponseHandler handler)

Specified by:

chat in interface dev.langchain4j.model.chat.StreamingChatModel

builder

public static LocalAiStreamingChatModel.LocalAiStreamingChatModelBuilder builder()