AI Navigate

[D] Need advice on handling a difficult ACL ARR situation

Reddit r/MachineLearning / 3/14/2026

💬 OpinionIdeas & Deep AnalysisModels & Research

Key Points

  • The author faced conflicting reviewer feedback on ethics, openness of code, and topic suitability for ACL ARR, with some comments referencing the previous version.
  • They resubmitted in January after reframing the paper, strengthening the ethics section, obtaining IRB approval, and adding human evaluation.
  • Concerns include reviewers focusing on points from the older version and suspicions of a hidden agenda, as well as critiques that the code isn’t open source and that five evaluators may be insufficient.
  • The author is seeking guidance on whether to request a reviewer change and the potential risks if such a request is denied or exposed to the reviewer pool.
  • The post highlights the difficulty of navigating peer review for ethically sensitive ML research and balancing openness with safety considerations.

Hi everyone

I have been working on a paper about counter-narrative generation.

We first submitted to the October ARR cycle and tried to be as responsible as possible..... we open-sourced the code and masked the data to prevent any harmful applications. We got some constructive feedback(mostly around ethics). One reviewer thought open-sourcing the code could have a "negative impact", and another straight-up said the whole topic wasn't suitable for ACL (even though we cited tons of similar works from the ACL community).

For the January resubmission, we made major changes ... reframed the paper, strengthened the ethics section, added IRB approval, and included human evaluation.

What is frustrating now is that one reviewer seems to be criticizing points from the older version rather than the current paper, and also suggests there may be some hidden agenda in this research. Another reviewer says the code is not open source and also argues that 5 human evaluators are too few (where there are so many heavily cited works that have 3/5 human evaluators)

I am trying to understand what the best next step is. Has anyone dealt with such a situation?
Would requesting a reviewer change help in a case like this... or is that usually too risky? I have read that such requests may not be approved, and that there is also a chance the reviewer could see it, which makes me worried it could backfire

I would really appreciate any honest advice.

submitted by /u/Aloo_Ka_Pakoda
[link] [comments]