Åpen kildekodeLokal44k
Text Generation WebUI
The "Gradio" Swiss-army UI for running and tinkering with local text models.
Text Generation WebUI (oobabooga) is a Gradio-based web interface for running large language models locally, supporting many backends including llama.cpp, Transformers, and ExLlamaV2. It offers chat, notebook, and instruct modes, model and LoRA loading, parameter tuning, and an OpenAI-compatible API extension. It is a long-standing community favorite for experimentation and fine-grained control over local inference.
Kodelager
oobabooga/text-generation-webuiSpråk
PythonDet du kan bygge med den
- Experimenting with quantized models, samplers, and LoRAs through a single configurable UI
- Switching between multiple inference backends without changing your workflow
- Serving local models to other apps via its OpenAI-compatible API extension
Tagger
uigradiobackendsexperimentation