large-vision-language-models

Resources and paper list for "Thinking with Images for LVLMs". This repository accompanies our survey on how LVLMs can leverage visual information for complex reasoning, planning, and generation.

large-vision-language-models multimodal-reasoning-visual-reasoning thinking-with-images survey-awesome-list

UpdatedJul 4, 2025

MME-Benchmarks /Video-MME

Star595

✨✨[CVPR 2025] Video-MME: The First-Ever Comprehensive Evaluation Benchmark of Multi-modal LLMs in Video Analysis

video mme large-language-models large-vision-language-models multimodal-large-language-models video-mme

UpdatedMay 8, 2025

YingqingHe /Awesome-LLMs-meet-Multimodal-Generation

Star484

🔥🔥🔥 A curated list of papers on LLMs-based multimodal generation (image, video, 3D and audio).

text-to-speech multimodality text-to-image text-to-audio text-to-video text-to-music multimodal-models aigc large-language-models llm text-to-3d multimodal-generation mllm text-to-sound large-vision-language-models multimodal-large-language-models lvlm

UpdatedApr 4, 2025
HTML

Paranioar /Awesome_Matching_Pretraining_Transfering

Star424

The Paper List of Large Multi-Modality Model (Perception, Generation, Unification), Parameter-Efficient Finetuning, Vision-Language Pretraining, Conventional Image-Text Matching for Preliminary Insight.

tutorial awesome-list vision-and-language video-text-recognition text-to-image-synthesis cross-modal-retrieval visual-semantic-embedding image-text-matching video-text-retrieval image-text-retrieval multimodal-pretraining large-language-models text-to-image-generation large-language-model large-vision-language-models multimodal-large-language-models memory-efficient-tuning parameter-efficient-fine-tuning text-to-video-generation large-vision-models

UpdatedDec 15, 2024

burglarhobbit /Awesome-Medical-Large-Language-Models

Star336

Curated papers on Large Language Models in Healthcare and Medical domain

large-language-models large-vision-language-models multimodal-large-language-models

UpdatedMay 29, 2025

tianyi-lab /HallusionBench

Star289

[CVPR'24] HallusionBench: You See What You Think? Or You Think What You See? An Image-Context Reasoning Benchmark Challenging for GPT-4V(ision), LLaVA-1.5, and Other Multi-modality Models

benchmark benchmarks lmm hallucination gpt-4 large-language-models llm llava large-vision-language-models vlms gpt-4v

UpdatedNov 13, 2024
Python

ShareGPT4Omni /ShareGPT4V

Star225

[ECCV 2024] ShareGPT4V: Improving Large Multi-modal Models with Better Captions

gpt language-model large-language-models chatgpt instruction-tuning vision-language-model large-vision-language-models gpt4v large-multimodal-models gpt-4v eccv2024

UpdatedJul 1, 2024
Python

khuangaf /Awesome-Chart-Understanding

Star212

A curated list of recent and past chart understanding work based on our IEEE TKDE survey paper: From Pixels to Insights: A Survey on Automatic Chart Understanding in the Era of Large Foundation Models.

awesome-list large-vision-language-models chart-understanding chart-question-answering chart-captioning chart-summarization

UpdatedJun 17, 2025

MMStar-Benchmark /MMStar

Star185

[NeurIPS 2024] This repo contains evaluation code for the paper "Are We on the Right Way for Evaluating Large Vision-Language Models"

evaluation multimodality multimodal-learning visual-question-answering multimodal large-language-models llm llms large-vision-language-model large-vision-language-models large-multimodal-models lvlms lvlm

UpdatedSep 26, 2024
Python

NishilBalar /Awesome-LVLM-Hallucination

Star143

up-to-date curated list of state-of-the-art Large vision language models hallucinations research work, papers & resources

mlm hallucination large-language-models llm mllm large-vision-language-models multimodal-large-language-models hallucination-evaluation hallucination-detection vision-language-models lvlm hallucination-mitigation hallucination-survey hallucination-research hallucination-benchmark multimodal-language-model

UpdatedMay 10, 2025

llmbev /talk2bev

Star112

Talk2BEV: Language-Enhanced Bird's Eye View Maps (ICRA'24)

autonomous-driving occupancy-grid-map birds-eye-view gpt-4 large-language-models large-vision-language-models

UpdatedNov 4, 2024
Python

itsqyh /Awesome-LMMs-Mechanistic-Interpretability

Star102

A curated collection of resources focused on the Mechanistic Interpretability (MI) of Large Multimodal Models (LMMs). This repository aggregates surveys, blog posts, and research papers that explore how LMMs represent, transform, and align multimodal information internally.

generative-model generative paperlist vision-models large-language-models mechanistic-interpretability large-vision-language-models large-multimodal-models vision-foundation-model

UpdatedJun 19, 2025

mbzuai-oryx /GeoPixel

Star100

GeoPixel: A Pixel Grounding Large Multimodal Model for Remote Sensing is specifically developed for high-resolution remote sensing image analysis, offering advanced multi-target pixel grounding capabilities.

remote-sensing segmentation-models foundation-models large-vision-language-models large-multimodal-models vision-language-models grounding-llms