AI Navigate

Modular Neural Computer

arXiv cs.LG / 3/17/2026

📰 NewsModels & Research

Key Points

  • The paper introduces the Modular Neural Computer (MNC), a memory-augmented neural architecture designed for exact algorithmic computation on inputs of varying length.
  • MNC combines an external associative memory with explicit read/write heads, a controller MLP, and a homogeneous set of modular neural components to achieve deterministic, programmable behavior.
  • Rather than learning an algorithm end-to-end from data, MNC realizes algorithms through analytically specified neural components with fixed interfaces and exact behavior, using one-hot module gates to control computation flow.
  • The architecture is demonstrated via three case studies (minimum of an array, in-place sorting, and A* search on a fixed instance) showing deterministic state evolution and explicit intermediate results.

Abstract

This paper introduces the Modular Neural Computer (MNC), a memory-augmented neural architecture for exact algorithmic computation on variable-length inputs. The model combines an external associative memory of scalar cells, explicit read and write heads, a controller multi-layer perceptron (MLP), and a homogeneous set of functional MLP modules. Rather than learning an algorithm end to end from data, it realizes a given algorithm through analytically specified neural components with fixed interfaces and exact behavior. The control flow is represented inside the neural computation through one-hot module gates, where inactive modules are inhibited. Computation unfolds as a sequence of memory transformations generated by a fixed graph. The architecture is illustrated through three case studies: computing the minimum of an array, sorting an array in place, and executing A* search on a fixed problem instance. These examples show that algorithmic procedures can be compiled into modular neural components with external memory while preserving deterministic behavior and explicit intermediate state.