Sentiment Analysis of German Sign Language Fairy Tales

arXiv cs.CL / 4/20/2026

📰 NewsModels & Research

Key Points

  • The paper introduces a new dataset and study aimed at sentiment analysis of German Sign Language (DGS) fairy tales across negative, neutral, and positive valence categories.
  • It uses four large language models (LLMs) with majority voting to perform sentiment labeling on German text segments, achieving an inter-annotator agreement of 0.781 (Krippendorff’s alpha).
  • The work extracts facial and body motion features from DGS video segments using MediaPipe and then trains an explainable XGBoost model to predict sentiment from those video-based features.
  • The explainable analysis finds that, beyond facial cues such as eyebrow and mouth motion, body motions—including hips, elbows, and shoulders—also play a major role, suggesting both face and body are equally important for conveying sentiment in sign language.
  • The video-feature sentiment prediction model achieves an average balanced accuracy of 0.631, indicating promising but still moderate performance for this task.

Abstract

We present a dataset and a model for sentiment analysis of German sign language (DGS) fairy tales. First, we perform sentiment analysis for three levels of valence (negative, neutral, positive) on German fairy tales text segments using four large language models (LLMs) and majority voting, reaching an inter-annotator agreement of 0.781 Krippendorff's alpha. Second, we extract face and body motion features from each corresponding DGS video segment using MediaPipe. Finally, we train an explainable model (based on XGBoost) to predict negative, neutral or positive sentiment from video features. Results show an average balanced accuracy of 0.631. A thorough analysis of the most important features reveal that, in addition to eyebrows and mouth motion on the face, also the motion of hips, elbows, and shoulders considerably contribute in the discrimination of the conveyed sentiment, indicating an equal importance of face and body for sentiment communication in sign language.