Class JlamaLanguageModel

java.lang.Object

dev.langchain4j.model.jlama.JlamaLanguageModel

All Implemented Interfaces:

dev.langchain4j.model.language.LanguageModel

public class JlamaLanguageModel
extends Object
implements dev.langchain4j.model.language.LanguageModel

Nested Class Summary

Nested Classes

Modifier and Type	Class	Description
static class	JlamaLanguageModel.JlamaLanguageModelBuilder

Constructor Summary

Constructors

Constructor	Description
JlamaLanguageModel(Path modelCachePath, String modelName, String authToken, Integer threadCount, Boolean quantizeModelAtRuntime, Path workingDirectory, com.github.tjake.jlama.safetensors.DType workingQuantizedType, Float temperature, Integer maxTokens)

Method Summary

Modifier and Type	Method	Description
static JlamaLanguageModel.JlamaLanguageModelBuilder	builder()
dev.langchain4j.model.output.Response<String>	generate(String prompt)
static dev.langchain4j.model.output.FinishReason	toFinishReason(com.github.tjake.jlama.model.functions.Generator.FinishReason reason)

Methods inherited from class Object

clone, equals, finalize, getClass, hashCode, notify, notifyAll, toString, wait, wait, wait

Methods inherited from interface dev.langchain4j.model.language.LanguageModel

generate

Constructor Details

JlamaLanguageModel

public JlamaLanguageModel(Path modelCachePath,
 String modelName,
 String authToken,
 Integer threadCount,
 Boolean quantizeModelAtRuntime,
 Path workingDirectory,
 com.github.tjake.jlama.safetensors.DType workingQuantizedType,
 Float temperature,
 Integer maxTokens)

Method Details

toFinishReason

public static dev.langchain4j.model.output.FinishReason toFinishReason(com.github.tjake.jlama.model.functions.Generator.FinishReason reason)

builder

public static JlamaLanguageModel.JlamaLanguageModelBuilder builder()

generate

public dev.langchain4j.model.output.Response<String> generate(String prompt)

Specified by:

generate in interface dev.langchain4j.model.language.LanguageModel