Foundation Models & LLMsDevelopers
Top-p Sampling
Also: nucleus sampling
A sampling strategy that restricts the model to choosing from the most probable tokens until their cumulative probability reaches p — balances diversity and coherence.
Also: nucleus sampling
A sampling strategy that restricts the model to choosing from the most probable tokens until their cumulative probability reaches p — balances diversity and coherence.