Projects / Generation & pattern formation
energy_transformer
A PyTorch port of the Energy Transformer, a transformer that runs attention alongside a Hopfield network and descends an energy function.
Possibly the only PyTorch implementation at the time. It ships with the paper’s masked image reconstruction example on CIFAR, and is reused in the JEPA and audio projects.