Concepts You Should Know Before Getting Into Transformers

Learn about Input Embedding, Positional Encoding, Scaled Dot-Product Attention, Residual Connections, Mask, and Softmax function.