Vector Representations of Words

One of the most significant advancements in the field of Natural Language Processing (NLP) over the past decade has been the development and adoption of vector representations…

Unigram Models

A Unigram model is a type of language model that considers each token to be independent of the tokens before it. It’s the simplest language model, in…

Word2Vec

Word2vec is a technique in natural language processing (NLP) for obtaining vector representations of words. These vectors capture information about the meaning of the word based on the surrounding words. The word2vec…

Bigram Models

A Bigram model is a language model in which we predict the probability of the correctness of a sequence of words by just predicting the occurrence of the…