Carlos Aguni

Highly motivated self-taught IT analyst. Always learning and ready to explore new skills. An eternal apprentice.


HPC Talk

24 Apr 2022 »

Attention to Rows and Columns: Altering Transformers’ Self-Attention Mechanism for Greater Efficiency

https://read.deeplearning.ai/the-batch/pale-transformer/?utm_campaign=The%20Batch&utm_content=220752275&utm_medium=social&utm_source=linkedin&hss_channel=lcp-18246783

Viz

https://twitter.com/bradyajohnston/status/1438840382385573890

https://twitter.com/DarkStarSystems/status/1373982932835127300