PinnedLoading

1. LRV-InstructionLRV-InstructionPublic

   [ICLR'24] Mitigating Hallucination in Large Multi-Modal Models via Robust Instruction Tuning

   Python 272 13

2. VisualNews-RepositoryVisualNews-RepositoryPublic

   [EMNLP'21] Visual News: Benchmark and Challenges in News Image Captioning

   Jupyter Notebook 93 9

3. MMCMMCPublic

   [NAACL 2024] MMC: Advancing Multimodal Chart Understanding with LLM Instruction Tuning

   Python 95 4

4. NVlabs/EAGLENVlabs/EAGLEPublic

   Eagle Family: Exploring Model Designs, Data Recipes and Training Strategies for Frontier-Class Multimodal LLMs

   Python 624 39

5. tianyi-lab/HallusionBenchtianyi-lab/HallusionBenchPublic

   [CVPR'24] HallusionBench: You See What You Think? Or You Think What You See? An Image-Context Reasoning Benchmark Challenging for GPT-4V(ision), LLaVA-1.5, and Other Multi-modality Models

   Python 270 8

6. DocumentCLIPDocumentCLIPPublic

   [ICPRAI 2024] DocumentCLIP: Linking Figures and Main Body Text in Reflowed Documents

   Python 16