Can You Make It Sound Like You? Post-Editing LLM-Generated Text for Personal Style

arXiv cs.CL / 4/28/2026

📰 NewsIdeas & Deep AnalysisModels & Research

Key Points

  • The study examines whether post-editing LLM-generated drafts (or translations) can reliably make the final text match an individual’s personal writing style.
  • Results from an online experiment (n=81) show post-editing increases embedding-based stylistic similarity to the participant’s own unaided writing while lowering similarity to fully LLM-generated output.
  • Even after editing, the post-edited text still appears more stylistically similar to LLM output than to the participant’s unaided control text, indicating lingering model “fingerprints.”
  • The researchers also find reduced stylistic diversity in post-edited text versus unaided human writing, alongside a mismatch where users perceive the writing as authentically personal even when model metrics detect LLM-style traces.

Abstract

Despite the growing use of large language models (LLMs) for writing tasks, users may hesitate to rely on LLMs when personal style is important. Post-editing LLM-generated drafts or translations is a common collaborative writing strategy, but it remains unclear whether users can effectively reshape LLM-generated text to reflect their personal style. We conduct a pre-registered online study (n=81) in which participants post-edit LLM-generated drafts for writing tasks where personal style matters to them. Using embedding-based style similarity metrics, we find that post-editing increases stylistic similarity to participants' unassisted writing and reduces similarity to fully LLM-generated output. However, post-edited text still remains stylistically closer in style to LLM text than to participants' unassisted control text, and it exhibits reduced stylistic diversity compared to unassisted human text. We find a gap between perceived stylistic authenticity and model-measured stylistic similarity, with post-edited text often perceived as representative of participants' personal style despite remaining detectable LLM stylistic traces.