Pipeshift is a fine-tuning and inference platform for open-source LLMs

• You bring your datasets. Fine-tune multiple LLMs. Start inferencing in one-click and watch them scale to millions.

Installation and Setup​

• Install the Pipeshift integration package.

  pip install langchain-pipeshift
  

• Get your Pipeshift API key by signing up atPipeshift.

Authentication​

You can perform authentication using your Pipeshift API key in any of the following ways:

1. Adding API key to the environment variable asPIPESHIFT_API_KEY.

   os.environ["PIPESHIFT_API_KEY"]="<your_api_key>"
   

2. By passingapi_key to the pipeshift LLM module or chat module

   llm= Pipeshift(api_key="<your_api_key>", model="meta-llama/Meta-Llama-3.1-8B-Instruct", max_tokens=512)
   
                       OR
   
   chat= ChatPipeshift(api_key="<your_api_key>", model="meta-llama/Meta-Llama-3.1-8B-Instruct", max_tokens=512)
   

Chat models​

See anexample.

from langchain_pipeshiftimport ChatPipeshift

LLMs​

See anexample.

from langchain_pipeshiftimport Pipeshift