TECHSY.communityby techsy.io
Sign Up
All open source
Open SourceLocal44k

Text Generation WebUI

The "Gradio" Swiss-army UI for running and tinkering with local text models.

Text Generation WebUI (oobabooga) is a Gradio-based web interface for running large language models locally, supporting many backends including llama.cpp, Transformers, and ExLlamaV2. It offers chat, notebook, and instruct modes, model and LoRA loading, parameter tuning, and an OpenAI-compatible API extension. It is a long-standing community favorite for experimentation and fine-grained control over local inference.

View repo

Repository

oobabooga/text-generation-webui

Language

Python

What you'd build with it

  • Experimenting with quantized models, samplers, and LoRAs through a single configurable UI
  • Switching between multiple inference backends without changing your workflow
  • Serving local models to other apps via its OpenAI-compatible API extension

Tags

uigradiobackendsexperimentation