history
Everything on Ground Truth tagged “history” — 2 items.
N-gram language models Lesson
An n-gram language model predicts the next word by counting how often each word followed the previous one or two words in a large corpus -- the simplest working language model there is, and the direct ancestor of everything that came after.
RNNs and LSTMs: How Neural Networks Learned to Remember, Before Transformers Lesson
Recurrent neural networks process sequences one step at a time while carrying a memory, and LSTMs added gates to fix their forgetfulness; together they powered a decade of sequence modeling and set up exactly the problem transformers later solved.