The ChatFriendli class is used to interact with Friendli inference Endpoint models. This requires your Friendli Token and Friendli Team which is autoloaded if not specified.

Hierarchy (view full)

Constructors

Properties

baseUrl: string = "https://inference.friendli.ai"
model: string = "meta-llama-3-8b-instruct"
frequencyPenalty?: number
friendliTeam?: string
friendliToken?: string
maxTokens?: number
modelKwargs?: Record<string, unknown>
stop?: string[]
temperature?: number
topP?: number