ion7-llm / sampler.budget

module

sampler.budget

Functions

M.balanced_with_budget

Build a sampler whose first step is a reasoning-budget guard. The remaining steps mimic the `balanced` profile.

M.balanced_with_budget(model, budget, opts)
modelion7.core.Model|cdataModel handle (any form).
budgetintegerToken cap inside ``.
optstable?
→ ion7.core.Sampler

M.prepend

Compose a budget step on top of an arbitrary builder. Handy when a caller already configured a custom chain (penalties, mirostat, grammar, …) and wants to add the budget in front.

M.prepend(builder, model, budget)
builderion7.core.SamplerBuilderStarted but NOT built.
modelion7.core.Model|cdata
budgetinteger
→ ion7.core.SamplerBuilder