Class LocalAiStreamingLanguageModel

java.lang.Object

dev.langchain4j.model.localai.LocalAiStreamingLanguageModel

All Implemented Interfaces:

dev.langchain4j.model.language.StreamingLanguageModel

public class LocalAiStreamingLanguageModel
extends Object
implements dev.langchain4j.model.language.StreamingLanguageModel

See LocalAI documentation for more details.

Nested Class Summary

Nested Classes

Modifier and Type	Class	Description
static class	LocalAiStreamingLanguageModel.LocalAiStreamingLanguageModelBuilder

Constructor Summary

Constructors

Constructor	Description
LocalAiStreamingLanguageModel(LocalAiStreamingLanguageModel.LocalAiStreamingLanguageModelBuilder builder)
LocalAiStreamingLanguageModel(String baseUrl, String modelName, Double temperature, Double topP, Integer maxTokens, Duration timeout, Boolean logRequests, Boolean logResponses)	Deprecated, for removal: This API element is subject to removal in a future version.

Method Summary

Modifier and Type	Method	Description
static LocalAiStreamingLanguageModel.LocalAiStreamingLanguageModelBuilder	builder()
void	generate(String prompt, dev.langchain4j.model.StreamingResponseHandler<String> handler)

Methods inherited from class Object

clone, equals, finalize, getClass, hashCode, notify, notifyAll, toString, wait, wait, wait

Methods inherited from interface dev.langchain4j.model.language.StreamingLanguageModel

generate

Constructor Details

LocalAiStreamingLanguageModel

@Deprecated(forRemoval=true,
            since="1.5.0")
public LocalAiStreamingLanguageModel(String baseUrl,
 String modelName,
 Double temperature,
 Double topP,
 Integer maxTokens,
 Duration timeout,
 Boolean logRequests,
 Boolean logResponses)

Deprecated, for removal: This API element is subject to removal in a future version.

LocalAiStreamingLanguageModel

public LocalAiStreamingLanguageModel(LocalAiStreamingLanguageModel.LocalAiStreamingLanguageModelBuilder builder)

Method Details

generate

public void generate(String prompt,
 dev.langchain4j.model.StreamingResponseHandler<String> handler)

Specified by:

generate in interface dev.langchain4j.model.language.StreamingLanguageModel

builder

public static LocalAiStreamingLanguageModel.LocalAiStreamingLanguageModelBuilder builder()