long-context
Here are 48 public repositories matching this topic...
Language:All
Sort:Most stars
Official release of InternLM series (InternLM, InternLM2, InternLM2.5, InternLM3).
- Updated
Feb 7, 2025 - Python
Code and documents of LongLoRA and LongAlpaca (ICLR 2024 Oral)
- Updated
Aug 14, 2024 - Python
[ICLR 2025] LongWriter: Unleashing 10,000+ Word Generation from Long Context LLMs
- Updated
Oct 29, 2024 - Python
Large Context Attention
- Updated
Jan 24, 2025 - Python
Implementation of MEGABYTE, Predicting Million-byte Sequences with Multiscale Transformers, in Pytorch
- Updated
Dec 27, 2024 - Python
Implementation of 💍 Ring Attention, from Liu et al. at Berkeley AI, in Pytorch
- Updated
Oct 25, 2024 - Python
LongCite: Enabling LLMs to Generate Fine-grained Citations in Long-context QA
- Updated
Dec 31, 2024 - Python
LLM KV cache compression made easy
- Updated
Mar 17, 2025 - Python
Implementation of Recurrent Memory Transformer, Neurips 2022 paper, in Pytorch
- Updated
Jan 6, 2025 - Python
The code of our paper "InfLLM: Unveiling the Intrinsic Capacity of LLMs for Understanding Extremely Long Sequences with Training-Free Memory"
- Updated
Apr 20, 2024 - Python
Codes for the paper "∞Bench: Extending Long Context Evaluation Beyond 100K Tokens":https://arxiv.org/abs/2402.13718
- Updated
Sep 25, 2024 - Python
PyTorch implementation of Infini-Transformer from "Leave No Context Behind: Efficient Infinite Context Transformers with Infini-attention" (https://arxiv.org/abs/2404.07143)
- Updated
May 4, 2024 - Python
✨✨Long-VITA: Scaling Large Multi-modal Models to 1 Million Tokens with Leading Short-Context Accuracy
- Updated
Mar 12, 2025 - Python
[COLM 2024] TriForce: Lossless Acceleration of Long Sequence Generation with Hierarchical Speculative Decoding
- Updated
Aug 31, 2024 - Python
[EMNLP 2024] LongAlign: A Recipe for Long Context Alignment of LLMs
- Updated
Dec 16, 2024 - Python
awesome llm plaza: daily tracking all sorts of awesome topics of llm, e.g. llm for coding, robotics, reasoning, multimod etc.
- Updated
Mar 17, 2025
open-source code for paper: Retrieval Head Mechanistically Explains Long-Context Factuality
- Updated
Aug 2, 2024 - Python
ACL 2024 | LooGLE: Long Context Evaluation for Long-Context Language Models
- Updated
Oct 8, 2024 - Python
LongQLoRA: Extent Context Length of LLMs Efficiently
- Updated
Nov 12, 2023 - Python
Improve this page
Add a description, image, and links to thelong-context topic page so that developers can more easily learn about it.
Add this topic to your repo
To associate your repository with thelong-context topic, visit your repo's landing page and select "manage topics."