What are the Advantages/Disadvantages of a n-gram model

Categories: NLP Data Preparation
Updated: October 3, 2023

Advantages:

  • Can provide useful information beyond just considering individual tokens, as sometimes the full context cannot be conveyed by words in isolation

Disadvantages:

  • Increase the dimensionality of the vocabulary, potentially leading to slower training time and higher risk of overfitting

Author

Help us improve this post by suggesting in comments below:

– modifications to the text, and infographics
– video resources that offer clear explanations for this question
– code snippets and case studies relevant to this concept
– online blogs, and research publications that are a “must read” on this topic

Leave the first comment

Partner Ad
Join us on:
Find out all the ways that you can
Contribute