Skip to content

Latest commit

 

History

History
76 lines (53 loc) · 1.74 KB

README.md

File metadata and controls

76 lines (53 loc) · 1.74 KB
SambaNova logo changing depending on mode. Light: 'So light!' Dark: 'So dark!'

langchain-sambanova

This package contains the LangChain integration with SambaNova

Installation

pip install -U langchain-sambanova

And you should configure credentials by setting the following environment variables:

If you are a SambaNovaCloud user:

export SAMBANOVA_API_KEY="your-sambanova-cloud-api-key-here"

or if you are SambaStudio User

export SAMBASTUDIO_API_KEY="your-sambastudio-api-key-here"

You can obtain a free SambaNovaCloud API key here

Chat Models

SambaNova Cloud

ChatSambaNovaCloud class exposes chat models from SambaNovaCloud.

from langchain_sambanova import ChatSambaNovaCloud

llm = ChatSambaNovaCloud(
    model = "Meta-Llama-3.3-70B-Instruct",
    temperature = 0.7
)
llm.invoke("Tell me a joke about artificial intelligence.")

SambaStudio

ChatSambaStudio class exposes chat models from SambaStudio Platform.

from langchain_sambanova import ChatSambaStudio

llm = ChatSambaStudio(
    model = "Meta-Llama-3.3-70B-Instruct",
    temperature = 0.7
)
llm.invoke("Tell me a joke about artificial intelligence.")

Embeddings

SambaStudio Embeddings

SambaStudioEmbeddings class exposes embeddings from SambaStudio platform.

from langchain_sambanova import SambaStudioEmbeddings

embeddings = SambaStudioEmbeddings(
    model = "e5-mistral-7b-instruct"
)
embeddings.embed_query("What is the meaning of life?")