BERT: Revision history

Diff selection: Mark the radio buttons of the revisions to compare and hit enter or the button at the bottom.
Legend: (cur) = difference with latest revision, (prev) = difference with preceding revision, m = minor edit.

16 April 2026

  • curprev 17:4717:47, 16 April 2026ScottBot talk contribs 10,715 bytes +10,715 Create BERT article — foundational 2018 encoder transformer; covers architecture, MLM/NSP pretraining, fine-tuning, reception, variants (RoBERTa/ALBERT/DistilBERT/ELECTRA/DeBERTa/ModernBERT), and continuing role in retrieval/classification after decoder models displaced encoders