Writing log70 posts277 tagslatest Apr 18, 2026
Bert.
Latest posts
BERT (2018) Paper Notes
Paper notes covering the core ideas of BERT: the bidirectional Transformer encoder, masked language model, next sentence prediction, and the fine-tuning paradigm.
LLM Learning Basics: Masked Language Model
Explains BERT's core training objective — the Masked Language Model — with formulas, commentary, and examples.