AI Navigate

Automatic Paper Reviewing with Heterogeneous Graph Reasoning over LLM-Simulated Reviewer-Author Debates

arXiv cs.CL / 3/11/2026

Ideas & Deep AnalysisModels & Research

Key Points

  • The paper introduces ReViewGraph, a novel framework that improves automatic paper reviewing by simulating multi-round reviewer-author debates using large language models (LLMs).
  • ReViewGraph models diverse opinion relations such as acceptance, rejection, clarification, and compromise as typed edges in a heterogeneous graph, enabling structured reasoning over these interactions.
  • By leveraging graph neural networks to analyze this debate graph, the system captures nuanced argumentative dynamics often missed by prior methods reliant on superficial features or direct LLM outputs.
  • Experimental results show ReViewGraph achieves an average relative improvement of 15.73% over strong baselines across three datasets, validating the effectiveness of incorporating detailed debate structures in review prediction.
  • This approach addresses common issues in automated reviewing such as hallucination and biased scoring by explicitly modeling reviewer-author negotiation processes for more informed decision-making.

Computer Science > Computation and Language

arXiv:2511.08317 (cs)
[Submitted on 11 Nov 2025 (v1), last revised 10 Mar 2026 (this version, v2)]

Title:Automatic Paper Reviewing with Heterogeneous Graph Reasoning over LLM-Simulated Reviewer-Author Debates

View a PDF of the paper titled Automatic Paper Reviewing with Heterogeneous Graph Reasoning over LLM-Simulated Reviewer-Author Debates, by Shuaimin Li and 7 other authors
View PDF HTML (experimental)
Abstract:Existing paper review methods often rely on superficial manuscript features or directly on large language models (LLMs), which are prone to hallucinations, biased scoring, and limited reasoning capabilities. Moreover, these methods often fail to capture the complex argumentative reasoning and negotiation dynamics inherent in reviewer-author interactions. To address these limitations, we propose ReViewGraph (Reviewer-Author Debates Graph Reasoner), a novel framework that performs heterogeneous graph reasoning over LLM-simulated multi-round reviewer-author debates. In our approach, reviewer-author exchanges are simulated through LLM-based multi-agent collaboration. Diverse opinion relations (e.g., acceptance, rejection, clarification, and compromise) are then explicitly extracted and encoded as typed edges within a heterogeneous interaction graph. By applying graph neural networks to reason over these structured debate graphs, ReViewGraph captures fine-grained argumentative dynamics and enables more informed review decisions. Extensive experiments on three datasets demonstrate that ReViewGraph outperforms strong baselines with an average relative improvement of 15.73%, underscoring the value of modeling detailed reviewer-author debate structures.
Subjects: Computation and Language (cs.CL)
Cite as: arXiv:2511.08317 [cs.CL]
  (or arXiv:2511.08317v2 [cs.CL] for this version)
  https://doi.org/10.48550/arXiv.2511.08317
Focus to learn more
arXiv-issued DOI via DataCite
Journal reference: AAAI-2026

Submission history

From: Shuaimin Li [view email]
[v1] Tue, 11 Nov 2025 14:46:07 UTC (497 KB)
[v2] Tue, 10 Mar 2026 09:44:14 UTC (452 KB)
Full-text links:

Access Paper:

    View a PDF of the paper titled Automatic Paper Reviewing with Heterogeneous Graph Reasoning over LLM-Simulated Reviewer-Author Debates, by Shuaimin Li and 7 other authors
  • View PDF
  • HTML (experimental)
  • TeX Source
Current browse context:
cs.CL
< prev   |   next >
Change to browse by:
cs

References & Citations

export BibTeX citation Loading...

BibTeX formatted citation

×
Data provided by:

Bookmark

BibSonomy logo Reddit logo
Bibliographic Tools

Bibliographic and Citation Tools

Bibliographic Explorer Toggle
Bibliographic Explorer (What is the Explorer?)
Connected Papers Toggle
Connected Papers (What is Connected Papers?)
Litmaps Toggle
Litmaps (What is Litmaps?)
scite.ai Toggle
scite Smart Citations (What are Smart Citations?)
Code, Data, Media

Code, Data and Media Associated with this Article

alphaXiv Toggle
alphaXiv (What is alphaXiv?)
Links to Code Toggle
CatalyzeX Code Finder for Papers (What is CatalyzeX?)
DagsHub Toggle
DagsHub (What is DagsHub?)
GotitPub Toggle
Gotit.pub (What is GotitPub?)
Huggingface Toggle
Hugging Face (What is Huggingface?)
Links to Code Toggle
Papers with Code (What is Papers with Code?)
ScienceCast Toggle
ScienceCast (What is ScienceCast?)
Demos

Demos

Replicate Toggle
Replicate (What is Replicate?)
Spaces Toggle
Hugging Face Spaces (What is Spaces?)
Spaces Toggle
TXYZ.AI (What is TXYZ.AI?)
Related Papers

Recommenders and Search Tools

Link to Influence Flower
Influence Flower (What are Influence Flowers?)
Core recommender toggle
CORE Recommender (What is CORE?)
About arXivLabs

arXivLabs: experimental projects with community collaborators

arXivLabs is a framework that allows collaborators to develop and share new arXiv features directly on our website.

Both individuals and organizations that work with arXivLabs have embraced and accepted our values of openness, community, excellence, and user data privacy. arXiv is committed to these values and only works with partners that adhere to them.

Have an idea for a project that will add value for arXiv's community? Learn more about arXivLabs.