Physics-Embedded Feature Learning for AI in Medical Imaging

arXiv cs.LG / 3/31/2026

💬 OpinionSignals & Early TrendsIdeas & Deep AnalysisModels & Research

Key Points

  • The paper introduces PhysNet, a physics-embedded deep learning framework that integrates tumor growth dynamics into CNN feature learning for more interpretable and robust medical imaging models.
  • Unlike output-level physics-informed approaches, PhysNet embeds a reaction-diffusion tumor growth model into intermediate representations of a ResNet backbone and trains end-to-end.
  • PhysNet performs multi-class brain MRI tumor classification while simultaneously learning a latent tumor density field, its temporal evolution, and biologically meaningful parameters such as diffusion and growth rates.
  • Experiments on a large brain MRI dataset show PhysNet outperforms several strong baselines, including MobileNetV2, VGG16/VGG19, and ensemble methods, with improved accuracy and F1-score.
  • The learned latent representations and physical parameters are reported to align with established medical knowledge, supporting the goal of increasing clinical trust in AI predictions.

Abstract

Deep learning (DL) models have achieved strong performance in an intelligence healthcare setting, yet most existing approaches operate as black boxes and ignore the physical processes that govern tumor growth, limiting interpretability, robustness, and clinical trust. To address this limitation, we propose PhysNet, a physics-embedded DL framework that integrates tumor growth dynamics directly into the feature learning process of a convolutional neural network (CNN). Unlike conventional physics-informed methods that impose physical constraints only at the output level, PhysNet embeds a reaction diffusion model of tumor growth within intermediate feature representations of a ResNet backbone. The architecture jointly performs multi-class tumor classification while learning a latent tumor density field, its temporal evolution, and biologically meaningful physical parameters, including tumor diffusion and growth rates, through end-to-end training. This design is necessary because purely data-driven models, even when highly accurate or ensemble-based, cannot guarantee physically consistent predictions or provide insight into tumor behavior. Experimental results on a large brain MRI dataset demonstrate that PhysNet outperforms multiple state-of-the-art DL baselines, including MobileNetV2, VGG16, VGG19, and ensemble models, achieving superior classification accuracy and F1-score. In addition to improved performance, PhysNet produces interpretable latent representations and learned bio-physical parameters that align with established medical knowledge, highlighting physics-embedded representation learning as a practical pathway toward more trustworthy and clinically meaningful medical AI systems.