gguf-models
Here are 7 public repositories matching this topic...
This custom_node for ComfyUI adds one-click "Virtual VRAM" for any GGUF UNet and CLIP loader, managing the offload of layers to DRAM or VRAM to maximize the latent space of your card. Also includes nodes for directly loading entire components (UNet, CLIP, VAE) onto the device you choose. Includes 16 examples covering common use cases.
- Updated
Mar 14, 2025 - Python
An algorithmic trading system based on FinGPT, demonstrating new applications of large pre-trained Language Models in quantitative finance.
- Updated
Feb 9, 2025 - Python
Experimental interface environment for open source LLM, designed to democratize the use of AI. Powered by llama-cpp, llama-cpp-python and Gradio.
- Updated
Mar 15, 2025 - Python
Simple Python Script that converts the Weight of a GGUF Model to a PyTorch Tensor
- Updated
Feb 6, 2025 - Python
This repository demonstrates how to use outlines and llama-cpp-python for structured JSON generation with streaming output, integrating llama.cpp for local model inference and outlines for schema-based text generation.
- Updated
Mar 4, 2025 - Python
Improve this page
Add a description, image, and links to thegguf-models topic page so that developers can more easily learn about it.
Add this topic to your repo
To associate your repository with thegguf-models topic, visit your repo's landing page and select "manage topics."