Troyanovsky / Local-LLM-Comparison-Colab-UI
Compare the performance of different LLM that can be deployed locally on consumer hardware. Run yourself with Colab WebUI.
☆986Updated last week
Related projects ⓘ
Alternatives and complementary repositories for Local-LLM-Comparison-Colab-UI
- Customizable implementation of the self-instruct paper.☆1,025Updated 8 months ago
- Python bindings for the Transformer models implemented in C/C++ using GGML library.☆1,816Updated 9 months ago
- TheBloke's Dockerfiles☆299Updated 8 months ago
- Convert Compute And Books Into Instruct-Tuning Datasets! Makes: QA, RP, Classifiers.☆1,038Updated 2 weeks ago
- Web UI for ExLlamaV2☆446Updated last month
- A more memory-efficient rewrite of the HF transformers implementation of Llama for use with quantized weights.☆2,765Updated last year
- Large-scale LLM inference engine☆1,146Updated this week
- Self-evaluating interview for AI coders☆541Updated this week
- A fast inference library for running LLMs locally on modern consumer-class GPUs☆3,685Updated this week
- A language for constraint-guided and efficient LLM programming.☆3,705Updated 5 months ago
- A llama.cpp drop-in replacement for OpenAI's GPT endpoints, allowing GPT-powered apps to run off local llama.cpp models instead of OpenAI…☆596Updated last year
- Plugin that lets you ask questions about your documents including audio and video files.☆289Updated last week
- A curated list of awesome Large Language Model (LLM) Web User Interfaces.☆310Updated 11 months ago
- Tune any FALCON in 4-bit☆468Updated last year
- ☆1,421Updated last year
- Curated list of useful LLM / Analytics / Datascience resources☆1,881Updated this week
- Falcon LLM ggml framework with CPU and GPU support☆245Updated 10 months ago
- Chat language model that can use tools and interpret the results☆1,433Updated this week
- ☆140Updated 4 months ago
- UI tool for fine-tuning and testing your own LoRA models base on LLaMA, GPT-J and more. One-click run on Google Colab. + A Gradio ChatGPT…☆444Updated last year
- ☆723Updated 2 months ago
- An Autonomous LLM Agent that runs on Wizcoder-15B☆338Updated last month
- ☆567Updated last month
- An OAI compatible exllamav2 API that's both lightweight and fast☆609Updated this week
- Convenience scripts to finetune (chat-)LLaMa3 and other models for any language☆282Updated 5 months ago
- Querying local documents, powered by LLM☆518Updated 2 weeks ago
- Automatically evaluate your LLMs in Google Colab☆560Updated 6 months ago
- The llama-cpp-agent framework is a tool designed for easy interaction with Large Language Models (LLMs). Allowing users to chat with LLM …☆496Updated 3 months ago
- Simple UI for LLM Model Finetuning☆2,045Updated 11 months ago
- Ship RAG based LLM web apps in seconds.☆976Updated 9 months ago