hallucination

[CVPR'24] HallusionBench: You See What You Think? Or You Think What You See? An Image-Context Reasoning Benchmark Challenging for GPT-4V(ision), LLaVA-1.5, and Other Multi-modality Models

benchmark benchmarks lmm hallucination gpt-4 large-language-models llm llava large-vision-language-models vlms gpt-4v

UpdatedNov 13, 2024
Python

IAAR-Shanghai /ICSFSurvey

Star160

Explore concepts like Self-Correct, Self-Refine, Self-Improve, Self-Contradict, Self-Play, and Self-Knowledge, alongside o1-like reasoning elevation🍓 and hallucination alleviation🍄.

decoding self-improvement knowledge-distillation data-augmentation reasoning self-consistency preference-learning hallucination self-correction attention-head large-language-models chain-of-thought large-language-model internal-consistency self-feedback self-refine self-correct

UpdatedDec 7, 2024
Jupyter Notebook

IAAR-Shanghai /UHGEval

Star160

[ACL 2024] User-friendly evaluation framework: Eval Suite & Benchmarks: UHGEval, HaluEval, HalluQA, etc.

benchmark evaluation dataset openai hallucination huggingface huggingface-transformers ceval gpt-3 openai-api hallucinations gpt-4 large-language-models llm chatgpt qwen hallucination-evaluation hallucination-detection

UpdatedNov 12, 2024
Python

xieyuquanxx /awesome-Large-MultiModal-Hallucination

Star149

😎 curated list of awesome LMM hallucinations papers, methods & resources.

multi-modal multimodal lmm hallucination

UpdatedMar 23, 2024

ictnlp /TruthX

Star143

Code for ACL 2024 paper "TruthX: Alleviating Hallucinations by Editing Large Language Models in Truthful Space"

safety llama representation language-model mistral explainable-ai hallucination baichuan hallucinations gpt-4 truthfulness llm llms chatgpt chatglm llm-inference llama2 llama3

UpdatedMar 26, 2024
Python

zjunlp /KnowledgeCircuits

Star133

[NeurIPS 2024] Knowledge Circuits in Pretrained Transformers

natural-language-processing artificial-intelligence transformer circuit interpretability hallucination large-language-models model-editing knowledge-editing knowledge-edting knowledge-circuit

UpdatedFeb 20, 2025
Python

NishilBalar /Awesome-LVLM-Hallucination

Star106

up-to-date curated list of state-of-the-art Large vision language models hallucinations research work, papers & resources

mlm hallucination large-language-models llm mllm large-vision-language-models multimodal-large-language-models hallucination-evaluation hallucination-detection vision-language-models lvlm hallucination-mitigation hallucination-survey hallucination-research hallucination-benchmark multimodal-language-model

UpdatedFeb 22, 2025

AmourWaltz /Reliable-LLM

Star104

knowledge uncertainty reliable hallucination

UpdatedSep 10, 2024
JavaScript

zjunlp /FactCHD

Star86

[IJCAI 2024] FactCHD: Benchmarking Fact-Conflicting Hallucination Detection

benchmark natural-language-processing knowledge dataset factual hallucination large-language-models factchd

UpdatedApr 28, 2024
Python

yfzhang114 /LLaVA-Align

Star76

This is the official repo for Debiasing Large Visual Language Models, including a Post-Hoc debias method and Visual Debias Decoding strategy.

hallucination debiasing large-vision-language-models

UpdatedFeb 22, 2025
Python

HillZhang1999 /ICD

Star63

Code & Data for our Paper "Alleviating Hallucinations of Large Language Models through Induced Hallucinations"

decoding-algorithm hallucination large-language-models

UpdatedFeb 27, 2024
Python

Official repo for the paper PHUDGE: Phi-3 as Scalable Judge. Evaluate your LLMs with or without custom rubric, reference answer, absolute, relative and much more. It contains a list of all the available tool, methods, repo, code etc to detect hallucination, LLM evaluation, grading and much more.

nlp ai evaluation ml pytorch judge feedback-collection sota custom-dataset finetuning hallucination llm llm-evaluation hallucination-detection phi-3

UpdatedJul 10, 2024
Jupyter Notebook

anlp-team /LTI_Neural_Navigator

Star42

"Enhancing LLM Factual Accuracy with RAG to Counter Hallucinations: A Case Study on Domain-Specific Queries in Private Knowledge-Bases" by Jiarui Li and Ye Yuan and Zehua Zhang

nlp machine-learning web-crawler llama datasets dataset-generation system-design hallucination rag large-language-models llm