Language Models Predict Words

Language models estimate the probability of the next word given context.

What does a language model do in next-word prediction?