text-generation-webui

Text-generation-webui is an open-source project on GitHub that provides a web-based user interface for running large language models such as GPT-J 6B, OPT, GALACTICA 12, LLaMA, Pygmalion, and GPT-Neo through Gradio UI. The user interface allows users to input text prompts and generate text output from the language models. The tool can be run on Windows, Linux, or Google Colab and is easy to use even with models like LLaMA-30b 4bit mode via GPTQ-for-LLaMa on an RTX 3090 3.