Comparison
60 contributions
Newer version available
A newer published version of this comparison exists.A Catalog of Transformer Models
In the past few years we have seen the meteoric appearance of dozens of models of the Transformer
family. This ORKG comparison contrasts models from different families including BERT, GPT, T5, etc. on some salient aspects around their innovation and difference.
This comparison is inspired after the paper "Transformer models: an introduction and catalog" by Xavier Amatriain, while seeking to be an extendable list of new contributions in terms of transformer models as they continue to be introduced.
Comparison update
ORKG Comparisons have changed. We have added new features and improved the user interface. Comparisons might look slightly different, but the comparison data itself remains unchanged.