Text Generation WebUI

The "Gradio" Swiss-army UI for running and tinkering with local text models.

Text Generation WebUI (oobabooga) is a Gradio-based web interface for running large language models locally, supporting many backends including llama.cpp, Transformers, and ExLlamaV2. It offers chat, notebook, and instruct modes, model and LoRA loading, parameter tuning, and an OpenAI-compatible API extension. It is a long-standing community favorite for experimentation and fine-grained control over local inference.