sequence-models

RNNs and LSTMs: How Neural Networks Learned to Remember, Before Transformers Lesson

Recurrent neural networks process sequences one step at a time while carrying a memory, and LSTMs added gates to fix their forgetfulness; together they powered a decade of sequence modeling and set up exactly the problem transformers later solved.