01 Sep 2021 |
sample
template
tutorial
Bubeck, Sebastien (Microsoft); Dobre, David (Mila); Gauthier, Charlie (Mila); Gidel, Gauthier (Mila); Vernade, Claire (DeepMind)
This post outlines a few more things you may need to know for creating and configuring your blog posts.
04 May 2021 |
deep learning
hopfield networks
associative memory
attention
transformer
Anonymous
The recent paper
Rethinking Attention with Performers constructs a new
efficient attention mechanism in an elegant way. It strongly reduces the computational cost for long sequences, while
keeping the intriguing properties of the original attention mechanism. In doing so, Performers have a complexity only
linear in the input length, in contrast to the quadratic complexity of standard Transformers. This is a major
breakthrough in the strive of improving Transformer models.
02 Apr 2020 |
test
tutorial
markdown
Doe, John, School of Life; Doe, Jane, A School
Howdy! This is an example blog post that shows several types of HTML content supported in this theme.