liltom-eth / llama2-webui
Run any Llama 2 locally with gradio UI on GPU or CPU from anywhere (Linux/Windows/Mac). Use `llama2-wrapper` as your local llama2 backend for Generative Agents/Apps.
☆1,964Updated 7 months ago
Related projects ⓘ
Alternatives and complementary repositories for llama2-webui
- LLaMA v2 Chatbot☆1,391Updated last year
- An easy-to-use LLMs quantization package with user-friendly apis, based on GPTQ algorithm.☆4,458Updated last month
- A more memory-efficient rewrite of the HF transformers implementation of Llama for use with quantized weights.☆2,759Updated last year
- LLM as a Chatbot Service☆3,290Updated 11 months ago
- Simple UI for LLM Model Finetuning☆2,046Updated 10 months ago
- A fast inference library for running LLMs locally on modern consumer-class GPUs☆3,634Updated last week
- LLMs build upon Evol Insturct: WizardLM, WizardCoder, WizardMath☆9,258Updated 3 months ago
- 4 bits quantization of LLaMA using GPTQ☆2,993Updated 3 months ago
- Run any open-source LLMs, such as Llama, Gemma, as OpenAI compatible API endpoint in the cloud.☆10,006Updated this week
- Python bindings for llama.cpp☆8,072Updated this week
- Large language models (LLMs) made easy, EasyLM is a one stop solution for pre-training, finetuning, evaluating and serving LLMs in JAX/Fl…☆2,401Updated 2 months ago
- OpenChat: Advancing Open-source Language Models with Imperfect Data☆5,253Updated last month
- Large Language Model Text Generation Inference☆9,019Updated this week
- H2O LLM Studio - a framework and no-code GUI for fine-tuning LLMs. Documentation: https://docs.h2o.ai/h2o-llmstudio/☆4,002Updated last week
- [ICLR 2024] Fine-tuning LLaMA to follow Instructions within 1 Hour and 1.2M Parameters☆5,741Updated 7 months ago
- Let ChatGPT teach your own chatbot in hours with a single GPU!☆3,166Updated 7 months ago
- OpenLLaMA, a permissively licensed open source reproduction of Meta AI’s LLaMA 7B trained on the RedPajama dataset☆7,384Updated last year
- Running Llama 2 and other Open-Source LLMs on CPU Inference Locally for Document Q&A☆951Updated last year
- a state-of-the-art-level open visual language model | 多模态预训练模型