Graph Neural Networks
Images have a grid, sentences have an order, and a molecule has neither. Message passing is the generalization.
-
-
Self-Supervised Learning
Labels are the expensive part of supervised learning. These methods construct the supervision from the data itself.
-
Autoencoders and Representation Learning
Reconstruction is a pretext. What you actually want is the code in the middle.
-
Vision Transformers and Modern Vision Models
A transformer sees an image as a sequence of patches and assumes nothing about geometry. That is both its strength and its data requirement.