Label Studio is an open-source data labeling platform that provides LangChain with flexibility when it comes to labeling data for fine-tuning large language models (LLMs). It also enables the preparation of custom training data and the collection and evaluation of responses through human feedback.

Installation and Setup​

See theLabel Studio installation guide for installation options.

We need to install thelabel-studio andlabel-studio-sdk-python Python packages:

pip install label-studio label-studio-sdk

Callbacks​

See ausage example.

from langchain.callbacksimport LabelStudioCallbackHandler