Friendli AI

FriendliAI enhances AI application performance and optimizes cost savings with scalable, efficient deployment options, tailored for high-demand AI workloads.

Installation and setup

Install the friendli-client python package.

pip install friendli-client

Sign in to Friendli Suite to create a Personal Access Token, and set it as the FRIENDLI_TOKEN environment variable.

Chat models

See a usage example.

from langchain_community.chat_models.friendli import ChatFriendli

API Reference:ChatFriendli

LLMs

See a usage example.

from langchain_community.llms.friendli import Friendli

API Reference:Friendli