Skip to main content

OctoAI

OctoAI offers easy access to efficient compute and enables users to integrate their choice of AI models into applications. The OctoAI compute service helps you run, tune, and scale AI applications easily.

Installation and Setup​

  • Install the openai Python package: 
    pip install openai
  • Register on OctoAI and get an API Token from your OctoAI account page.

Chat models​

See a usage example.

from langchain_community.chat_models import ChatOctoAI
API Reference:ChatOctoAI

LLMs​

See a usage example.

from langchain_community.llms.octoai_endpoint import OctoAIEndpoint
API Reference:OctoAIEndpoint

Embedding models​

from langchain_community.embeddings.octoai_embeddings import OctoAIEmbeddings
API Reference:OctoAIEmbeddings

Was this page helpful?