bert

Encoder, decoder, or both: the three ways to build a transformer Lesson

The same transformer block can be assembled three ways -- encoder-only, decoder-only, or encoder-decoder -- and the choice determines whether a model reads text, writes text, or converts one into the other.