BERT

tags

Transformers, NLP

paper

(Devlin et al. 2019)

Parameter count

• Base = 110M
• Large = 340M

Bibliography

1. Jacob Devlin, Ming-Wei Chang, Kenton Lee, Kristina Toutanova. May 24, 2019. "BERT: Pre-training of Deep Bidirectional Transformers for Language Understanding". arXiv. DOI.