Explore Capsule Networks (CapsNets) and how they preserve spatial hierarchies to solve the "Picasso problem" in AI. Learn about dynamic routing and vector neurons.
Capsule Networks, often abbreviated as CapsNets, represent an advanced architecture in the field of deep learning designed to overcome specific limitations found in traditional neural networks. Introduced by Geoffrey Hinton and his team, CapsNets attempt to mimic the biological neural organization of the human brain more closely than standard models. Unlike a typical convolutional neural network (CNN), which excels at detecting features but often loses spatial relationships due to downsampling, a Capsule Network organizes neurons into groups called "capsules." These capsules encode not just the probability of an object's presence, but also its specific properties, such as orientation, size, and texture, effectively preserving the hierarchical spatial relationships within visual data.
To understand the innovation of CapsNets, it is helpful to look at how standard computer vision models operate. A conventional CNN uses layers of feature extraction followed by pooling layers—specifically max pooling—to reduce computational load and achieve translational invariance. This means a CNN can identify a "cat" regardless of where it sits in the image.
However, this process often discards precise location data, leading to the "Picasso problem": a CNN might classify a face correctly even if the mouth is on the forehead, simply because all the necessary features are present. CapsNets address this by removing pooling layers and replacing them with a process that respects the spatial hierarchies of objects.
The core building block of this architecture is the capsule, a nested set of neurons that outputs a vector rather than a scalar value. In vector mathematics, a vector has both magnitude and direction. In a CapsNet:
Capsules in lower layers (detecting simple shapes like edges) predict the output of capsules in higher layers (detecting complex objects like eyes or tires). This communication is managed by an algorithm called "dynamic routing" or "routing by agreement." If a lower-level capsule's prediction aligns with the higher-level capsule's state, the connection between them is strengthened. This allows the network to recognize objects from different 3D viewpoints without requiring the massive data augmentation usually needed to teach CNNs about rotation and scale.
Aunque ambas arquitecturas son fundamentales para la visión artificial (CV), difieren en cómo procesan y representan los datos visuales:
Aunque las redes CapsNet suelen ser más costosas desde el punto de vista computacional que los modelos optimizados como YOLO26, ofrecen ventajas claras en ámbitos especializados:
Las redes Capsule son principalmente una arquitectura de clasificación. Aunque ofrecen solidez teórica, las aplicaciones industriales modernas a menudo prefieren las CNN o los Transformers de alta velocidad para obtener un rendimiento en tiempo real. Sin embargo, es útil comprender los puntos de referencia de clasificación utilizados para las CapsNets, como MNIST.
El siguiente ejemplo muestra cómo entrenar un modelo moderno.
Modelo YOLO en el MNIST utilizando el
ultralytics paquete. Esto es paralelo a la tarea de referencia principal utilizada para validar las redes de cápsulas.
from ultralytics import YOLO
# Load a YOLO26 classification model (optimized for speed and accuracy)
model = YOLO("yolo26n-cls.pt")
# Train the model on the MNIST dataset
# This dataset helps evaluate how well a model learns handwritten digit features
results = model.train(data="mnist", epochs=5, imgsz=32)
# Run inference on a sample image
# The model predicts the digit class (0-9)
predict = model("https://docs.ultralytics.com/datasets/classify/mnist/")
Los principios que sustentan las redes de cápsulas siguen influyendo en la investigación sobre la seguridad y la interpretabilidad de la IA. Al modelar explícitamente las relaciones entre las partes y el todo, las cápsulas ofrecen una alternativa de «caja de cristal» a la naturaleza de «caja negra» de las redes neuronales profundas, lo que hace que las decisiones sean más explicables. Los desarrollos futuros buscan combinar la robustez espacial de las cápsulas con la velocidad de inferencia de arquitecturas como YOLO11 o la más reciente YOLO26 para mejorar el rendimiento en la detección de objetos 3D y la robótica. Los investigadores también están explorando las cápsulas matriciales con enrutamiento EM para reducir aún más el coste computacional del algoritmo de acuerdo.
For developers looking to manage datasets and train models efficiently, the Ultralytics Platform provides a unified environment to annotate data, train in the cloud, and deploy models that balance the speed of CNNs with the accuracy required for complex vision tasks.