Movatterモバイル変換


[0]ホーム

URL:


Skip to content

Navigation Menu

Sign in
Appearance settings

Search code, repositories, users, issues, pull requests...

Provide feedback

We read every piece of feedback, and take your input very seriously.

Saved searches

Use saved searches to filter your results more quickly

Sign up
Appearance settings

✨✨Latest Advances on Neuro-Symbolic Learning in the era of Large Language Models

NotificationsYou must be signed in to change notification settings

LAMDASZ-ML/Awesome-LLM-Reasoning-with-NeSy

Folders and files

NameName
Last commit message
Last commit date

Latest commit

 

History

90 Commits
 
 
 
 
 
 

Repository files navigation

Towards Improving Reasoning & Planning Capabilities of LLMs with Neuro-Symbolic Learning

✨✨ Curated collection of papers and resources on latest advances on improving reasoning and planning abilities of LLM/MLLMs with neuro-symbolic learning

🗂️Table of Contents
  1. Awesome Tutorials & Workshops & Talks
  2. Awesome Survey
  3. Basic Neuro-Symbolic Frameworks
  4. Symbolic to LLM
  5. LLM to Symbolic
  6. LLM plus Symbolic
  7. Awesome Datasets & Benchmarks

📌 Awesome Tutorials & Workshops & Talks

🔍 Survey

Survey on LLM Reasoning

Survey on LLM Planning

Survey on Neuro-Symbolic Learning

📖 Basic Neuro-Symbolic Frameworks

TitleVenueDateCode
Semantic-based regularization for learning and inference
Artificial Intelligence2017-
DeepProbLog: Neural Probabilistic Logic Programming
NeurIPS2018Github
Learning Explanatory Rules from Noisy Data
Journal of Artificial Intelligence Research2018Github
Augmenting Neural Networks with First-order Logic
ACL2019-
Neural Logic Machines
ICLR2019Github
Bridging Machine Learning and Logical Reasoning by Abductive Learning
NeurIPS2019Github
SATNet: Bridging deep learning and logical reasoning using a differentiable satisfiability solver
ICML2019Github
DL2: Training and Querying Neural Networks with Logic
ICML2019Github
The Neuro-Symbolic Concept Learner: Interpreting Scenes, Words, and Sentences From Natural Supervision
ICLR2019Github
NeurASP: Embracing Neural Networks into Answer Set Programming
IJCAI2020Github
Learning programs by learning from failures
Machine Learning2020-
Logical Neural Networks
Arxiv2020Github
Closed Loop Neural-Symbolic Learning via Integrating Neural Perception, Grammar Parsing, and Symbolic Reasoning
ICML2020Github
Ontology Reasoning with Deep Neural Networks
Artificial Intelligence2020-
MultiplexNet: Towards Fully Satisfied Logical Constraints in Neural Networks
AAAI2022-
Neuro-Symbolic Hierarchical Rule Induction
ICML2022-
Logic Tensor Networks
Artificial Intelligence2022Github
Neuro-symbolic Learning Yielding Logical Constraints
NeurIPS2023Github
Neural-Symbolic Recursive Machine for Systematic Generalization
ICLR2024Github

📖 Symbolic to LLM

Symbolic Generation, LLM Imitation

TitleVenueDateDomainCode
Solving Olympiad geometry without human demonstrationsNature2024Geometric Math ReasoningGithub
Chain of Thought Imitation with Procedure Cloning
NeurIPS2022PlanningGithub
Plansformer: Generating Symbolic Plans using Transformers
Arxiv2022Planning-
Beyond A$^*$: Better Planning with Transformers via Search Dynamics BootstrappingArxiv2024PlanningGithub
Dualformer: Controllable Fast and Slow Thinking by Learning with Randomized Reasoning Traces
Arxiv2024PlanningGithub
Stream of Search (SoS): Learning to Search in Language
COLM2024ReasoningGithub
Step Back to Leap Forward: Self-Backtracking for Boosting Reasoning of Language ModelsArxiv2025ReasoningGithub
Language Models can be Deductive Solvers
NAACL2024Logical ReasoningGithub
INT: An Inequality Benchmark for Evaluating Generalization in Theorem ProvingICLR2021Theorem ProvingGithub
Generating Millions Of Lean Theorems With Proofs By Exploring State Transition GraphsArxiv2025Theorem Proving-
Enhancing Reasoning Capabilities of LLMs via Principled Synthetic Logic Corpus
NeurIPS2024Logical Reasoning-
A Symbolic Framework for Evaluating Mathematical Reasoning and Generalization with Transformers
NAACL2024Math ReasoningGithub
Proving Olympiad Algebraic Inequalities without Human Demonstrations
NeurIPS2024Theorem ProvingGithub
LogicAsker: Evaluating and Improving the Logical Reasoning Ability of Large Language Models
EMNLP2024Logical ReasoningGithub

LLM Formalize, Symbolic Augment

TitleVenueDateDomainCode
AMR-DA: Data Augmentation by Abstract Meaning Representation
ACL2022Logic ReasoningGithub
Abstract Meaning Representation-Based Logic-Driven Data Augmentation for Logical Reasoning
ACL2024Logic ReasoningGithub
Neuro-Symbolic Data Generation for Math Reasoning
NeurIPS2024Math Reasoning-
LawGPT: Knowledge-Guided Data Generation and Its Application to Legal LLM
SCI-FM Workshop @ ICLR2025Legal ReasoningGithub
AlphaIntegrator: Transformer Action Search for Symbolic Integration Proofs
Arxiv2024Theorem Proving-
Large Language Models Meet Symbolic Provers for Logical Reasoning Evaluation
ICLR2025Logic ReasoningGithub

📖 LLM to Symbolic

Symbolic Solver Aided Methods

TitleVenueDateDomainCode
MRKL Systems: A modular, Neuro-Symbolic Architecture that Combines Large Language models, External Knowledge Sources and Discrete Reasoning
Arxiv2022Reasoning-
Leveraging Large Language Models to Generate Answer Set Programs
KR2023ReasoningGithub
Logic-LM: Empowering Large Language Models with Symbolic Solvers for Faithful Logical Reasoning
EMNLP2023ReasoningGithub
LOGIC-LM++: Multi-Step Refinement for Symbolic Formulations
ACL2024Reasoning-
LINC: A Neurosymbolic Approach for Logical Reasoning by Combining Language Models with First-Order Logic Provers
EMNLP2023ReasoningGithub
Faithful Chain-of-Thought Reasoning
IJCNLP-AACL2023ReasoningGithub
SATLM: Satisfiability-Aided Language Models Using Declarative Prompting
NeurIPS2023Math ReasoningGithub
Faithful Logical Reasoning via Symbolic Chain-of-Thought
ACL2023ReasoningGithub
Verification and Refinement of Natural Language Explanations through LLM-Symbolic Theorem Proving
EMNLP2024Theorem ProvingGithub
StackSight: Unveiling WebAssembly through Large Language Models and Neurosymbolic Chain-of-Thought Decompilation
ICML2024Code Generation-
Monitor-Guided Decoding of Code LMs with Static Analysis of Repository Context
NeurIPS2023Code GenerationGithub
Solving Math Word Problems by Combining Language Models With Symbolic Solvers
Arxiv2023Math ReasoningGithub
AutoSAT: Automatically Optimize SAT Solvers via Large Language Models
Arxiv2024SAT ProblemGithub
Prototype-then-Refine: A Neuro-Symbolic Approach for Improved Logical Reasoning with LLMs
Arxiv2024Reasoning-
Neuro-Symbolic Integration Brings Causal and Reliable Reasoning Proofs
Arxiv2024ReasoningGithub
SymBa: Symbolic Backward Chaining for Structured Natural Language Reasoning
Arxiv2025ReasoningGithub
Frugal LMs Trained to Invoke Symbolic Solvers Achieve Parameter-Efficient Arithmetic Reasoning
AAAI2024Math Reasoning-
Lemur: Integrating Large Language Models in Automated Program Verification
ICLR2024Code Generation-
Symbol-LLM: Leverage Language Models for Symbolic System in Visual Human Activity Reasoning
NeurIPS2023RoboticsGithub
Parsel: Algorithmic Reasoning with Language Models by Composing Decompositions
NeurIPS2023RoboticsGithub
Disentangling Extraction and Reasoning in Multi-hop Spatial Reasoning
EMNLP2024Spatial Reasoning-
Generalized Planning in PDDL Domains with Pretrained Large Language Models
AAAI2024PlanningGithub
Leveraging Pre-trained Large Language Models to Construct and Utilize World Models for Model-based Task Planning
NeurIPS2023PlanningGithub
Coupling Large Language Models with Logic Programming for Robust and General Reasoning from Text
ACL Findings2023PlanningGithub
LLM+P: Empowering Large Language Models with Optimal Planning Proficiency
Arxiv2023Planning/RoboticsGithub
Dynamic Planning with a LLM
LanGame Workshop @ NeurIPS2023Planning/Robotics-
Neuro-Symbolic Procedural Planning with Commonsense Prompting
ICLR2023Planning/RoboticsGithub
Leveraging Environment Interaction for Automated PDDL Translation and Planning with Large Language Models
NeurIPS2024PlanningGithub
A Framework for Neurosymbolic Robot Action Planning using Large Language Models
Frontiers in Neurorobotics2024RoboticsGithub
ReKep: Spatio-Temporal Reasoning of Relational Keypoint Constraints for Robotic Manipulation
Arxiv2024Robotics-
LeanDojo: Theorem Proving with Retrieval-Augmented Language Models
NeurIPS D&B2023Theorem ProvingGithub
LEGO-Prover: Neural Theorem Proving with Growing Libraries
ICLR2024Theorem ProvingGithub
Proving Olympiad Inequalities by Synergizing LLMs and Symbolic Reasoning
ICLR2025Theorem ProvingGithub
Autoformalization with Large Language Models
NeurIPS2022Theorem Proving-
Autoformalizing Euclidean Geometry
ICML2024Geometry ReasoningGithub
Autoformalize Mathematical Statements by Symbolic Equivalence and Semantic Consistency
NeurIPS2024Theorem ProvingGithub
Draft, Sketch, and Prove: Guiding Formal Theorem Provers with Informal Proofs
ICLR2023Theorem ProvingGithub
Don't Trust: Verify -- Grounding LLM Quantitative Reasoning with Autoformalization
ICLR2024Theorem ProvingGithub
Large Language Models as Planning Domain Generators
ICAPS2024PlanningGithub
Generating Symbolic World Models via Test-time Scaling of Large Language Models
ICML2024Planning-

Program-Aided Methods

TitleVenueDateDomainCode
PAL: Program-aided Language Models
ICML2023ReasoningGithub
Program of Thoughts Prompting: Disentangling Computation from Reasoning for Numerical Reasoning Tasks
TMLR2023Math ReasoningGithub
Binding Language Models in Symbolic Languages
ICLR2023ReasoningGithub
Chain of Code: Reasoning with a Language Model-Augmented Code EmulatorICML2024ReasoningGithub
CODE4STRUCT: Code Generation for Few-Shot Event Structure PredictionACL2023ReasoningGithub
MathPrompter: Mathematical Reasoning using Large Language ModelsACL2023Math ReasoningGithub
Natural Language Embedded Programs for Hybrid Language Symbolic Reasoning
ACL2024ReasoningGithub
Towards Better Understanding of Program-of-Thought Reasoning in Cross-Lingual and Multilingual EnvironmentsArxiv2025Reasoning-
Code as Policies: Language Model Programs for Embodied Control
Arxiv2023RoboticsGithub

Tool-Aided Methods

TitleVenueDateCode
Visual Programming: Compositional visual reasoning without training
CVPR (Best Paper)2023Visual Reasoning
ViperGPT: Visual Inference via Python Execution for Reasoning
ICCV2023Visual Reasoning
GENOME: Generative Neuro-Symbolic Visual Reasoning by Growing and Reusing Modules
ICLR2024Visual Reasoning
Chameleon: Plug-and-Play Compositional Reasoning with Large Language Models
NeurIPS2023Multi-Modal Reasoning
HuggingGPT: Solving AI Tasks with ChatGPT and its Friends in Hugging Face
NeurIPS2023Visual Reasoning
ART: Automatic Multi-Step Reasoning and Tool-use for Large Language Models
Arxiv2023Reasoning
ChatCoT: Tool-Augmented Chain-of-Thought Reasoning on Chat-based Large Language Models
EMNLP2023Reasoning
ToRA: A Tool-Integrated Reasoning Agent for Mathematical Problem Solving
ICLR2024Math Reasoning
ToolkenGPT: Augmenting Frozen Language Models with Massive Tools via Tool Embeddings
NeurIPS2023Agent
TaskMatrix.AI: Completing Tasks by Connecting Foundation Models with Millions of APIs
Arxiv2023Agent
ToolLLM: Facilitating Large Language Models to Master 16000+ Real-world APIs
ICLR2024Agent
Multi-modal Agent Tuning: Building a VLM-Driven Agent for Efficient Tool Usage
ICLR2025Visual Reasoning
ToolPlanner: A Tool Augmented LLM for Multi Granularity Instructions with Path Planning and Feedback
EMNLP2024Reasoning
START: Self-taught Reasoner with Tools
Arxiv2025Reasoning

Search Augmented Methods

TitleVenueDateDomainCode
Self-Evaluation Guided Beam Search for Reasoning
NeurIPS2023ReasoningGithub
Deductive Beam Search: Decoding Deducible Rationale for Chain-of-Thought Reasoning
COLM2024ReasoningGithub
MindStar: Enhancing Math Reasoning in Pre-trained LLMs at Inference Time
Arxiv2024Reasoning-
NEUROLOGIC A*esque Decoding:Constrained Text Generation with Lookahead Heuristics
NAACL2022Reasoning-
Marco-o1: Towards Open Reasoning Models for Open-Ended Solutions
Arxiv2024ReasoningGithub
Monte Carlo Tree Search Boosts Reasoning via Iterative Preference Learning
Arxiv2024ReasoningGithub
LLaMA-Berry: Pairwise Optimization for Olympiad-level Mathematical Reasoning via O1-like Monte Carlo Tree Search
Arxiv2024ReasoningGithub
Mulberry: Empowering MLLM with o1-like Reasoning and Reflection via Collective Monte Carlo Tree Search
Arxiv2024Visual ReasoningGithub
Large Language Models as Commonsense Knowledge for Large-Scale Task Planning
NeurIPS2023PlanningGithub
Planning with Large Language Models for Code Generation
ICLR2023Code GenerationGithub
Tree of Thoughts: Deliberate Problem Solving with Large Language Models
NeurIPS2023ReasoningGithub
CodeTree: Agent-guided Tree Search for Code Generation with Large Language Models
Arxiv2024Code Generation-
Alphazero-like Tree-Search can Guide Large Language Model Decoding and Training
Arxiv2024Reasoning-
Reasoning with Language Model is Planning with World Model
EMNLP2023Reasoning-
Reasoning on Graphs: Faithful and Interpretable Large Language Model Reasoning
ICLR2024Reasoning-
SPaR: Self-Play with Tree-Search Refinement to Improve Instruction-Following in Large Language Models
ICLR2025ReasoningGithub
Leveraging Constrained Monte Carlo Tree Search to Generate Reliable Long Chain-of-Thought for Mathematical Reasoning
Arxiv2025Math Reasoning-
FGeo-DRL:Deductive Reasoning for Geometric Problems through Deep Reinforcement Learning
Arxiv2024Geometry ReasoningGithub
Interactive Evolution: A Neural-Symbolic Self-Training Framework For Large Language ModelsArxiv2024ReasoningGithub
AlphaMath Almost Zero: Process Supervision without ProcessNeurIPS2024Math ReasoningGithub
Math-Shepherd: Verify and Reinforce LLMs Step-by-step without Human Annotations
ACL2024Math ReasoningGithub
Improve Mathematical Reasoning in Language Models by Automated Process SupervisionDeepMind Report2024Math Reasoning-
ReST-MCTS: LLM Self-Training via Process Reward Guided Tree SearchNeurIPS2024Math/Chemistry/PhysicsGithub
rStar-Math: Small LLMs Can Master Math Reasoning with Self-Evolved Deep Thinking
ICLR2025Math ReasoningGithub
Enhancing Reasoning through Process Supervision with Monte Carlo Tree SearchNeurMAD Workshop @ AAAI2025Math Reasoning-
STP: Self-play LLM Theorem Provers with Iterative Conjecturing and ProvingArxiv2025Theorem ProvingGithub
SRA-MCTS: Self-driven Reasoning Augmentation with Monte Carlo Tree Search for Code GenerationArxiv2024ReasoningGithub

📖 LLM plus Symbolic

Symbolic Formatted Reasoning

TitleVenueDateDomainCode
Deductive Verification of Chain-of-Thought ReasoningNeurIPS2023ReasoningGithub
Show Your Work: Scratchpads for Intermediate Computation with Language Models
DL4C Workshop @ ICLR2022Code Generation-
Chain-of-Symbol Prompting Elicits Planning in Large Langauge ModelsCOLM2024Spatial Reasoning/Path PlanningGithub
Learning to Reason via Program Generation, Emulation, and SearchNeurIPS2024ReasoningGithub
Symbolic Working Memory Enhances Language Models for Complex Rule ApplicationEMNLP2024ReasoningGithub
CodeI/O: Condensing Reasoning Patterns via Code Input-Output PredictionArxiv2025ReasoningGithub
SKIntern: Internalizing Symbolic Knowledge for Distilling Better CoT Capabilities into Small Language ModelsCOLING2025ReasoningGithub
Improving Chain-of-Thought Reasoning via Quasi-Symbolic AbstractionsArxiv2025Reasoning-
ProgPrompt: Generating Situated Robot Task Plans using Large Language Models
ICRA2023RoboticsGithub
Programmatically Grounded, Compositionally Generalizable Robotic Manipulation
ICLR2023RoboticsGithub
CodePlan: Unlocking Reasoning Potential in Large Language Models by Scaling Code-form Planning
ICLR2025ReasoningGithub

Differential Symbolic Modules

TitleVenueDateDomainCode
Inferring and Executing Programs for Visual Reasoning
ICCV2017Visual ReasoningGithub
Neural-Symbolic VQA: Disentangling Reasoning from Vision and Language Understanding
NeurIPS2018Visual ReasoningGithub
The Neuro-Symbolic Concept Learner: Interpreting Scenes, Words, and Sentences From Natural Supervision
ICLR2019Visual ReasoningGithub
Visual Concept-Metaconcept Learning
NeurIPS2019Visual ReasoningGithub
Neuro-Symbolic Visual Reasoning: Disentangling “Visual” from “Reasoning”
ICML2020Visual ReasoningGithub
Dynamic Visual Reasoning by Learning Differentiable Physics Models from Video and Language
NeurIPS2021Visual ReasoningGithub
Grounding Physical Concepts of Objects and Events Through Dynamic Visual Reasoning
ICLR2021Visual ReasoningGithub
JARVIS: A Neuro-Symbolic Commonsense Reasoning Framework for Conversational Embodied Agents
Arxiv2022Robotics-
FALCON: Fast Visual Concept Learning by Integrating Images, Linguistic descriptions, and Conceptual Relations
ICLR2022Visual ReasoningGithub
NS3D: Neuro-Symbolic Grounding of 3D Objects and Relations
CVPR2023Visual ReasoningGithub
Interpretable Neural-Symbolic Concept Reasoning
ICML2023InterpretableGithub
Motion Question Answering via Modular Motion Programs
ICML2023Motion QAGithub
Learning Neuro-symbolic Programs for Language Guided Robot Manipulation
ICRA2023RoboticsGithub
\alpha ILP: thinking visual scenes as differentiable logic programs
Machine Learning2023Visual Reasoning
What's Left? Concept Grounding with Logic-Enhanced Foundation Models
NeurIPS2023Visual ReasoningGithub
Programmatically Grounded, Compositionally Generalizable Robotic Manipulation
ICLR2023RoboticsGithub
Neuro-Symbolic Predicate Invention:Learning Relational Concepts from Visual Scenes
NSAI2024Visual ReasoningGithub
Take A Step Back: Rethinking the Two Stages in Visual Reasoning
ECCV2024Visual ReasoningGithub
Learning Differentiable Logic Programs for Abstract Visual Reasoning
MLJ2024Visual Reasoning-
DiLA: Enhancing LLM Tool Learning with Differential Logic Layer
Arxiv2024Reasoning-
Mastering Symbolic Operations: Augmenting Language Models with Compiled Neural Networks
ICLR2024ReasoningGithub
Empowering Language Models with Knowledge Graph Reasoning for Question Answering
EMNLP2022Reasoning-
Neuro-symbolic Training for Spatial Reasoning over Natural Language
Arxiv2025Spatial ReasoningGithub
NeSyCoCo: A Neuro-Symbolic Concept Composer for Compositional Generalization
Arxiv2024Visual ReasoningGithub

Symbolic Feedback

TitleVenueDateDomainCode
CoTran: An LLM-based Code Translator using Reinforcement Learning with Feedback from Compiler and Symbolic Execution
ECAI2024Code Generation-
Position: LLMs Can’t Plan, But Can Help Planning in LLM-Modulo Frameworks
ICML2024Planning-
RLSF: Reinforcement Learning via Symbolic Feedback
Arxiv2025ReasoningGithub
Rule Based Rewards for Language Model Safety
NeurIPS2024-

Misc on Neuro-Symbolic Learning

TitleVenueDateCode
Neuro-Symbolic Entropy Regularization
UAI2022Github
RuleMatch: Matching Abstract Rules for Semi-supervised Learning of Human Standard Intelligence Tests
IJCAI2023Github
Learning with Logical Constraints but without Shortcut Satisfaction
ICLR2023Github
Neuro-Symbolic Continual Learning:Knowledge, Reasoning Shortcuts and Concept Rehearsal
ICML2023Github
Out-of-Distribution Generalization by Neural-Symbolic Joint Training
AAAI2023Github
Not All Neuro-Symbolic Concepts Are Created Equal: Analysis and Mitigation of Reasoning Shortcuts
NeurIPS2023-
Localized Symbolic Knowledge Distillation for Visual Commonsense Models
NeurIPS2023-
A-NeSI: A Scalable Approximate Method for Probabilistic Neurosymbolic Inference
NeurIPS2023-
Neuro-Symbolic Continual Learning:Knowledge, Reasoning Shortcuts and Concept Rehearsal
ICML2023Github
Out-of-Distribution Generalization by Neural-Symbolic Joint Training
AAAI2023Github
Large Language Models Are NeuroSymbolic Reasoners
AAAI2024Github
On the Hardness of Probabilistic Neurosymbolic Learning
ICML2024-
On the Independence Assumption in Neurosymbolic Learning
ICML2024-
Analysis for Abductive Learning and Neural-Symbolic Reasoning Shortcuts
ICML2024-
Convex and Bilevel Optimization for Neural-Symbolic Inference and Learning
ICML2024-
Bridging Neural and Symbolic Representations with Transitional Dictionary Learning
ICLR2024-
LogicMP: A Neuro-symbolic Approach for Encoding First-order Logic Constraints
ICLR2024-
Adaptable Logical Control for Large Language Models
NeurIPS2024-
Rule Extrapolation in Language Models: A Study of Compositional Generalization on OOD Prompts
NeurIPS2024-
Unlocking the Capabilities of Thought: A Reasoning Boundary Framework to Quantify and Optimize Chain-of-Thought
NeurIPS2024Github

🛠️ Awesome Datasets & Benchmarks

Mathematical Reasoning

Logical Reasoning

Code Generation

Visual Reasoning

Geometry Reasoning

Classical Planning

Game AI Planning

Robotic Planning

AI Agent Planning

Others

  • RSbench: A Neuro-Symbolic Benchmark Suite for Concept Quality and Reasoning Shortcuts

↑ Back to Top ↑


[8]ページ先頭

©2009-2025 Movatter.jp