[D] Does seeing the identify of authors influence your scoring?

Reddit r/MachineLearning / 4/1/2026

💬 OpinionSignals & Early TrendsIdeas & Deep Analysis

共有:

Key Points

The post discusses whether reviewers’ awareness of authors’ identities—by searching papers on arXiv—could bias their scoring during a paper review batch.
The author notes that two of the top-scoring papers in their batch were the only ones available on arXiv in that set, raising questions about whether identity disclosure influenced the outcome.
The core issue is the potential for bias stemming from non-blinded or partially revealed information during peer review.
The author frames the situation as an uncertainty between possible influence and simple coincidence, implying a need for stronger safeguards or better evaluation of review processes.

Let's be honest, at some stage of the review process. A lot of us have gotten bored and tried to Google the papers we are reviewing. And sometimes those papers might have already been uploaded onto arXiv with the identity of the authors. Which we then tried to look them up.

As a first-time reviewer, I noticed the top 2 papers in my batch happened to be the only papers in my batch that is on arXiv. I am trying to work out if revealing the author's identity had influenced my decision. Or it's just a coincidence.

submitted by /u/d_edge_sword
[link] [comments]