TrajectoryMover: Generative Movement of Object Trajectories in Videos

arXiv cs.CV / 4/1/2026

💬 OpinionIdeas & Deep AnalysisModels & Research

Key Points

  • The paper introduces TrajectoryMover to perform generative video editing that moves an object’s 3D motion trajectory while preserving its relative 3D motion and identity.
  • It argues that prior approaches miss this capability due to the lack of paired video data where one trajectory can be modified without breaking realism and identity.
  • To address the pairing problem, the authors propose TrajectoryAtlas, a new large-scale synthetic data generation pipeline for creating suitable paired training examples.
  • TrajectoryMover is then fine-tuned on this synthetic paired dataset, and the authors report that the method successfully enables trajectory movement in videos.
  • The work positions generative movement of object trajectories as a missing piece in trajectory-based video editing workflows for both realism and controllability.

Abstract

Generative video editing has enabled several intuitive editing operations for short video clips that would previously have been difficult to achieve, especially for non-expert editors. Existing methods focus on prescribing an object's 3D or 2D motion trajectory in a video, or on altering the appearance of an object or a scene, while preserving both the video's plausibility and identity. Yet a method to move an object's 3D motion trajectory in a video, i.e., moving an object while preserving its relative 3D motion, is currently still missing. The main challenge lies in obtaining paired video data for this scenario. Previous methods typically rely on clever data generation approaches to construct plausible paired data from unpaired videos, but this approach fails if one of the videos in a pair can not easily be constructed from the other. Instead, we introduce TrajectoryAtlas, a new data generation pipeline for large-scale synthetic paired video data and a video generator TrajectoryMover fine-tuned with this data. We show that this successfully enables generative movement of object trajectories. Project page: https://chhatrekiran.github.io/trajectorymover