Integrating LLMs with Knowledge Graphs: Enhancing AI Accuracy and Reliability

The recent developments in the research area highlight a significant shift towards integrating large language models (LLMs) with knowledge graphs (KGs) and other structured data sources to enhance the accuracy, reliability, and interpretability of AI systems. This integration aims to mitigate common issues such as hallucinations in LLMs by grounding their outputs in factual data, thereby improving their applicability in critical domains like healthcare, safety analysis, and complex decision-making processes. Innovations include the development of frameworks that leverage LLMs for semi-automated human reliability analysis, the creation of hybrid systems that combine KGs with LLMs for more accurate information retrieval and reasoning, and the introduction of novel methodologies for knowledge extraction and graph construction that minimize human intervention while ensuring high-quality outputs. Additionally, there is a growing emphasis on enhancing the reasoning capabilities of neural networks through open-book learning frameworks and modular architectures that decouple knowledge from reasoning, offering new insights into the interpretability and scalability of AI systems.

Noteworthy Papers

  • KRAIL: Introduces a two-stage framework integrating IDHEAS and LLMs for semi-automated computation of base human error probability, showcasing superior performance in reliability assessment.
  • From Hallucinations to Facts: Proposes integrating curated knowledge graphs with LLMs to reduce hallucinations, significantly improving the factual accuracy and context relevance of model outputs.
  • CypherBench: Addresses the inefficiency of modern RDF knowledge graphs for LLMs by proposing property graph views, introducing a benchmark for precise retrieval over full-scale knowledge graphs.
  • OneKE: A dockerized schema-guided LLM agent-based system for knowledge extraction, demonstrating adaptability and efficacy across various domains.
  • KARPA: A training-free method that leverages LLMs' global planning abilities for efficient and accurate knowledge graph reasoning, achieving state-of-the-art performance in KGQA tasks.
  • Open-Book Neural Algorithmic Reasoning: Challenges the standard supervised learning paradigm by enabling networks to access and utilize all training instances during reasoning, significantly enhancing neural reasoning capabilities.
  • CancerKG.ORG: Describes a web-scale, interactive, verifiable KG-LLM hybrid for assisting with optimal cancer treatment, showcasing the potential of combining KGs with LLMs in healthcare.
  • KnowRA: A knowledge retrieval augmented method for document-level relation extraction, demonstrating comprehensive reasoning abilities by integrating external knowledge.
  • Decoupling Knowledge and Reasoning in Transformers: Introduces a modular Transformer architecture that decouples knowledge and reasoning, offering enhanced interpretability, adaptability, and scalability.
  • Large Language Model-Enhanced Symbolic Reasoning for Knowledge Base Completion: Combines LLMs with rule-based reasoning to improve the flexibility and reliability of knowledge base completion, highlighting the robustness of the proposed framework.

Sources

KRAIL: A Knowledge-Driven Framework for Base Human Reliability Analysis Integrating IDHEAS and Large Language Models

From Hallucinations to Facts: Enhancing Language Models with Curated Knowledge Graphs

CypherBench: Towards Precise Retrieval over Full-scale Modern Knowledge Graphs in the LLM Era

A novel framework for MCDM based on Z numbers and soft likelihood function

OneKE: A Dockerized Schema-Guided LLM Agent-based Knowledge Extraction System

Relative Constructibility via Restricted Abstract State Machines

Ontology-grounded Automatic Knowledge Graph Construction by LLM under Wikidata schema

KARPA: A Training-free Method of Adapting Knowledge Graph as References for Large Language Model's Reasoning Path Aggregation

Open-Book Neural Algorithmic Reasoning

CancerKG.ORG A Web-scale, Interactive, Verifiable Knowledge Graph-LLM Hybrid for Assisting with Optimal Cancer Treatment and Care

Conceptual Modeling and Classification of Events

KnowRA: Knowledge Retrieval Augmented Method for Document-level Relation Extraction with Comprehensive Reasoning Abilities

Enhancing Transformers for Generalizable First-Order Logical Entailment

Reasoning-Oriented and Analogy-Based Methods for Locating and Editing in Zero-Shot Event-Relational Reasoning

Decoupling Knowledge and Reasoning in Transformers: A Modular Architecture with Generalized Cross-Attention

Reasoning based on symbolic and parametric knowledge bases: a survey

Large Language Model-Enhanced Symbolic Reasoning for Knowledge Base Completion

Built with on top of