We presented GraphGPS about a year ago and it is pleasing to see many ICML papers building upon our framework and expanding GT capabilities even further.
Exphormer by Shirzad, Velingker, Venkatachalam et al adds a missing piece of graph-motivated sparse attenti...