Will Transformers Take over Artificial Intelligence?

Deep Learning got an upgrade in 2017, now it's doing more than we expected.

Image: Alexey Dosovitskiy

Transformers are a type of neural network architecture that began to gain in popularity a few years ago.

The Meta trend here is that Self-attention technology is spreading beyond NLP to become a hot general-purpose architecture for machine learning.

What is a Transformer in A.I. Anyways?

A transformer is a deep learning model that…