OpenGVLab
We are a research group from Shanghai AI Lab focused on Vision-Centric AI research. The GV in our name, OpenGVLab, means general vision, a general understanding of vision, so little effort is needed to adapt to new vision-based tasks.
We develop model architecture and release pre-trained foundation models to the community to motivate further research in this area. We have made promising progress in general vision AI, with109 SOTA🚀. In 2022, our open-sourced foundation model 65.5 mAP on the COCO object detection benchmark, 91.1% Top1 accuracy in Kinetics 400, achieved landmarks for AI vision👀 tasks for image🖼️ and video📹 understanding. In 2023, we createdVideoChat🦜,llama-adapter🦙, 3D foundation modelPonder V2🧊 and many more wonderful works! InCVPR 2023, our vision foundation modelInternImage was listed as one of the most influential papers, and by benefiting from our partnerOpenDriveLab, we won theBest paper together🎉 .
In2024, we released thebest open-source VLMInternVL , video understanding foundation modelInternVideo2, which won 7 Champions onEgoVis challenges 🥇. Up to now, our brilliant team have open-sourced more than 70 works, pleasefind them here😃
Based on solid vision foundations, we have expanded to Multi-Modality models and. We aim to empower individuals and businesses by offering a higher starting point for developing vision-based AI products and lessening the burden of building an AI model from scratch.
Branches:Alpha (explore lattest advances in vision+language research),uni-medical (focus on medical AI),Vchitect (Generative AI)
Follow us: Twitter 🤗Hugging Face
Medium
WeChat
Zhihu
PinnedLoading
- InternVideo
InternVideo Public[ECCV2024] Video Foundation Models & Data for Multimodal Understanding
- Ask-Anything
Ask-Anything Public[CVPR2024 Highlight][VideoChatGPT] ChatGPT with video understanding! And many more supported LMs such as miniGPT4, StableLM, and MOSS.
- VideoMamba
VideoMamba Public[ECCV2024] VideoMamba: State Space Model for Efficient Video Understanding
- LLaMA-Adapter
LLaMA-Adapter Public[ICLR 2024] Fine-tuning LLaMA to follow Instructions within 1 Hour and 1.2M Parameters
Repositories
- UMMEvalKit Public
A unified, efficient, and extensible evaluation toolkit for unified multimodal models
OpenGVLab/UMMEvalKit’s past year of commit activity - MetaCaptioner Public
Uh oh!
There was an error while loading.Please reload this page.
OpenGVLab/MetaCaptioner’s past year of commit activity - GUI-Odyssey Public
[ICCV 2025] GUIOdyssey is a comprehensive dataset for training and evaluating cross-app navigation agents. GUIOdyssey consists of 8,834 episodes from 6 mobile devices, spanning 6 types of cross-app tasks, 212 apps, and 1.4K app combos.
OpenGVLab/GUI-Odyssey’s past year of commit activity - SDLM Public
Sequential Diffusion Language Model (SDLM) enhances pre-trained autoregressive language models by adaptively determining generation length and maintaining KV-cache compatibility, achieving high efficiency and throughput.
OpenGVLab/SDLM’s past year of commit activity