FlashcardIntermediate
Tokenization
Tokenization splits text into smaller units like words or subwords.
Question
What is tokenization in NLP?
Click to reveal answer
Tokenization splits text into smaller units like words or subwords.
What is tokenization in NLP?