PromptLayer
PromptLayer is a platform for prompt engineering.It also helps with the LLM observability to visualize requests, version prompts, and track usage.
While
PromptLayer
does have LLMs that integrate directly with LangChain (e.g.PromptLayerOpenAI
),using a callback is the recommended way to integratePromptLayer
with LangChain.
Installation and Setup
To work withPromptLayer
, we have to:
- Create a
PromptLayer
account - Create an api token and set it as an environment variable (
PROMPTLAYER_API_KEY
)
Install a Python package:
pip install promptlayer
Callback
See ausage example.
import promptlayer# Don't forget this import!
from langchain.callbacksimport PromptLayerCallbackHandler
API Reference:PromptLayerCallbackHandler
LLM
See ausage example.
from langchain_community.llmsimport PromptLayerOpenAI
API Reference:PromptLayerOpenAI
Chat Models
See ausage example.
from langchain_community.chat_modelsimport PromptLayerChatOpenAI
API Reference:PromptLayerChatOpenAI