Brian Musuku
Videos Research Projects Models About Contact
All videos
Nov 10, 20261:23

Delta attention

An in-depth look at the delta rule used in linear attention.

An in-depth look at the delta rule used in linear attention.

Next: Linear attention explained
brayanmusuku@gmail.com GitHub Google Scholar
Updated October 2026