Text Preprocessing Basics

Text is tokenized and vectorized to become model-ready numbers.

What does tokenization do in text preprocessing?