probLM-solver#
Overview
A Python library built on top of llama.cpp that allows for easy creation and application of token-by-token sampling methods and algorithms.
Quick links
API Reference — Full API reference
Tutorials — Tutorials and how to get started.
Background — Background info and motivation for this program.