Troyanovsky / Local-LLM-Comparison-Colab-UI
Compare the performance of different LLM that can be deployed locally on consumer hardware. Run yourself with Colab WebUI.
☆1,033Updated last week
Alternatives and similar repositories for Local-LLM-Comparison-Colab-UI:
Users that are interested in Local-LLM-Comparison-Colab-UI are comparing it to the libraries listed below
- Customizable implementation of the self-instruct paper.☆1,040Updated last year
- Python bindings for the Transformer models implemented in C/C++ using GGML library.☆1,854Updated last year
- Web UI for ExLlamaV2☆486Updated last month
- Chat with your documents offline using AI.☆720Updated last year
- TheBloke's Dockerfiles☆305Updated last year
- An Autonomous LLM Agent that runs on Wizcoder-15B☆336Updated 5 months ago
- Self-evaluating interview for AI coders☆576Updated last month
- A llama.cpp drop-in replacement for OpenAI's GPT endpoints, allowing GPT-powered apps to run off local llama.cpp models instead of OpenAI…☆598Updated last year
- Convenience scripts to finetune (chat-)LLaMa3 and other models for any language☆300Updated 9 months ago
- Large-scale LLM inference engine☆1,366Updated this week
- A set of LLM Tutorials from my youtube channel☆846Updated last year
- ☆1,461Updated last year
- function calling-based LLM agents☆284Updated 6 months ago
- Convenient wrapper for fine-tuning and inference of Large Language Models (LLMs) with several quantization techniques (GTPQ, bitsandbytes…☆147Updated last year
- Compare open-source local LLM inference projects by their metrics to assess popularity and activeness.☆529Updated 2 months ago
- A collection of standardized JSON descriptors for Large Language Model (LLM) files.☆794Updated 7 months ago
- The llama-cpp-agent framework is a tool designed for easy interaction with Large Language Models (LLMs). Allowing users to chat with LLM …☆547Updated last month
- Dataset Crafting w/ RAG/Wikipedia ground truth and Efficient Fine-Tuning Using MLX and Unsloth. Includes configurable dataset annotation …☆177Updated 8 months ago
- Lord of LLMS☆287Updated last week
- Querying local documents, powered by LLM☆575Updated 2 months ago
- Run MemGPT-AutoGEN-Local LLM Together☆302Updated last year
- An AI code interpreter for sensitive data, powered by GPT-4 or Code Llama / Llama 2.☆443Updated last year
- A more memory-efficient rewrite of the HF transformers implementation of Llama for use with quantized weights.☆2,845Updated last year
- A curated list of awesome Large Language Model (LLM) Web User Interfaces.