Desktop Application

GPT4All runs LLMs as an application on your computer. Nomic's embedding models can bring information from your local documents and files into your chats. It's fast, on-device, and completelyprivate.

Python SDK

Use GPT4All in Python to program with LLMs implemented with thellama.cpp backend andNomic's C backend. Nomic contributes to open source software likellama.cpp to make LLMs accessible and efficientfor all.

pipinstallgpt4all

fromgpt4allimportGPT4Allmodel=GPT4All("Meta-Llama-3-8B-Instruct.Q4_0.gguf")# downloads / loads a 4.66GB LLMwithmodel.chat_session():print(model.generate("How can I run LLMs efficiently on my laptop?",max_tokens=1024))