Understanding Tokenization

Tokenization splits text into smaller units like words or subwords.

What does tokenization do in an NLP pipeline?