Class OpenAiStreamingLanguageModel

java.lang.Object

dev.langchain4j.model.openai.OpenAiStreamingLanguageModel

All Implemented Interfaces:

StreamingLanguageModel

public class OpenAiStreamingLanguageModel
extends Object
implements StreamingLanguageModel

Represents an OpenAI language model with a completion interface, such as gpt-3.5-turbo-instruct. The model's response is streamed token by token and should be handled with StreamingResponseHandler. However, it's recommended to use OpenAiStreamingChatModel instead, as it offers more advanced features like function calling, multi-turn conversations, etc.

Nested Class Summary

Nested Classes

Modifier and Type	Class	Description
static class	OpenAiStreamingLanguageModel.OpenAiStreamingLanguageModelBuilder

Constructor Summary

Constructors

Constructor	Description
OpenAiStreamingLanguageModel(OpenAiStreamingLanguageModel.OpenAiStreamingLanguageModelBuilder builder)

Method Summary

Modifier and Type	Method	Description
static OpenAiStreamingLanguageModel.OpenAiStreamingLanguageModelBuilder	builder()
void	generate(String prompt, StreamingResponseHandler<String> handler)
String	modelName()

Methods inherited from class Object

clone, equals, finalize, getClass, hashCode, notify, notifyAll, toString, wait, wait, wait

Methods inherited from interface StreamingLanguageModel

generate

Constructor Details

OpenAiStreamingLanguageModel

public OpenAiStreamingLanguageModel(OpenAiStreamingLanguageModel.OpenAiStreamingLanguageModelBuilder builder)

Method Details

modelName

public String modelName()

generate

public void generate(String prompt,
 StreamingResponseHandler<String> handler)

Specified by:

generate in interface StreamingLanguageModel

builder

public static OpenAiStreamingLanguageModel.OpenAiStreamingLanguageModelBuilder builder()