mcdok at SemEval-2026 Task 13: Finetuning LLMs for Detection of Machine-Generated Code

arXiv cs.LG / 4/24/2026

📰 NewsIdeas & Deep AnalysisModels & Research

Key Points

  • SemEval-2026 Task 13 focuses on detecting machine-generated code across multiple programming languages, including both binary detection and source attribution.
  • The task includes specialized subtasks such as detecting which generator LLM family produced the code, identifying code co-generated by humans and machines, and spotting adversarial edits meant to hide provenance.
  • The authors adapted the existing mdok approach from machine-generated text detection to machine-generated code by testing multiple base models better suited for code understanding.
  • Their submitted systems performed competitively on all three subtasks, but the gaps versus the top teams suggest there is still meaningful room for further performance improvements.

Abstract

Multi-domain detection of the machine-generated code snippets in various programming languages is a challenging task. SemEval-2026 Task~13 copes with this challenge in various angles, as a binary detection problem as well as attribution of the source. Specifically, its subtasks also cover generator LLM family detection, as well as a hybrid code co-generated by humans and machines, or adversarially modified codes hiding its origin. Our submitted systems adjusted the existing mdok approach (focused on machine-generated text detection) to these specific kinds of problems by exploring various base models, more suitable for code understanding. The results indicate that the submitted systems are competitive in all three subtasks. However, the margins from the top-performing systems are significant, and thus further improvements are possible.