Tokenization

The process of converting raw text into tokens — the numerical units a model actually reads. Different models use different tokenization schemes.