Rnn

LLM Basics: RNNs and Sequential Processing

Explains how RNNs — the dominant architecture before Transformers — process sequences token by token, and the fundamental limitations that motivated moving beyond them.