https://blog.sksoumik.com/series/nlp/ Recent content in NLP on Sadman Kabir Soumik Hugo -- gohugo.io en Copyright © 2022, Sadman Kabir Soumik Mon, 30 Jan 2023 00:00:00 +0000 https://blog.sksoumik.com/artificial-intelligence/from-rnn-to-transformers-without-math/ Mon, 30 Jan 2023 00:00:00 +0000 https://blog.sksoumik.com/artificial-intelligence/from-rnn-to-transformers-without-math/ Transformer-based models are a types of neural network architecture that uses self-attention mechanisms to process input data. They were introduced in the paper "Attention Is All You Need" by Ashish Vaswani, Noam Shazeer, Niki Parmar, Jakob Uszkoreit, Llion Jones, Aidan N. Gomez, Lukasz Kaiser, Illia Polosukhin in 2017, and have since become a popular choice for many natural language processing task. Prerequisite: Before going further, I assume that you have a basic understanding of how neural networks work.