Asking primarily due to the NIPS deadline. I have always submitted code with my submissions to all conferences before. However, with how good new AI agents are nowadays, I wanted to gather feedback on whether we should stop sharing code in submissions and publish them after acceptance. However, what if the submission focuses on other parts of reproducibility, like the algorithm mentioned, the hyperparameter tuning protocol mentioned, as well as the number of repetitions?
Based on my prior experience, reviewers do not really look at code. But they seem to crib if it is not provided. But I saw a couple of my labmates not share code in the ICML cycle, and the reviewers did not crib about it. After hearing some horror stories of ideas being stolen based on code on this sub, is it reasonable not to submit code for submissions? I am simply curious.
[link] [comments]




