Expand description
Logit Processing and Sampling
Functionality for modeling sampling strategies and logits processing in text generation with support for temperature-based sampling, top-k filtering, nucleus sampling (top-p), and combinations thereof.