Troyanovsky / Local-LLM-Comparison-Colab-UI
Compare the performance of different LLM that can be deployed locally on consumer hardware. Run yourself with Colab WebUI.
☆1,040Updated 2 weeks ago
Alternatives and similar repositories for Local-LLM-Comparison-Colab-UI:
Users that are interested in Local-LLM-Comparison-Colab-UI are comparing it to the libraries listed below
- A llama.cpp drop-in replacement for OpenAI's GPT endpoints, allowing GPT-powered apps to run off local llama.cpp models instead of OpenAI…☆598Updated last year
- UI tool for fine-tuning and testing your own LoRA models base on LLaMA, GPT-J and more. One-click run on Google Colab. + A Gradio ChatGPT…☆469Updated last year
- Web UI for ExLlamaV2☆493Updated 2 months ago
- Run AI ✨ assistant locally! with simple API for Node.js 🚀☆472Updated 10 months ago
- Python bindings for the Transformer models implemented in C/C++ using GGML library.☆1,859Updated last year
- LLM that combines the principles of wizardLM and vicunaLM☆717Updated last year
- Customizable implementation of the self-instruct paper.☆1,043Updated last year
- An Autonomous LLM Agent that runs on Wizcoder-15B☆335Updated 6 months ago
- Chat with your documents offline using AI.☆723Updated last year
- ☆168Updated last year
- The llama-cpp-agent framework is a tool designed for easy interaction with Large Language Models (LLMs). Allowing users to chat with LLM …☆552Updated 2 months ago
- function calling-based LLM agents☆285Updated 7 months ago
- Plugin that lets you ask questions about your documents including audio and video files.☆332Updated this week
- Querying local documents, powered by LLM☆588Updated 3 months ago
- Large-scale LLM inference engine☆1,395Updated this week
- An OAI compatible exllamav2 API that's both lightweight and fast☆920Updated this week
- Falcon LLM ggml framework with CPU and GPU support☆246Updated last year
- Self-evaluating interview for AI coders☆579Updated this week
- AgentLLM is a PoC for browser-native autonomous agents☆412Updated last year
- TheBloke's Dockerfiles☆303Updated last year
- LocalAGI is a powerful, self-hostable AI Agent platform designed for maximum privacy and flexibility. A complete drop-in replacement for …☆599Updated this week
- A fast inference library for running LLMs locally on modern consumer-class GPUs☆4,131Updated this week
- ☆622Updated last week
- An AI assistant beyond the chat box.☆326Updated last year
- Simple UI for LLM Model Finetuning☆2,061Updated last year
- A multimodal, function calling powered LLM webui.☆214Updated 7 months ago
- Resource list for generating JSON using LLMs via function calling, tools, CFG. Libraries, Models, Notebooks, etc.☆2,085Updated 2 months ago
- Compare open-source local LLM inference projects by their metrics to assess popularity and activeness.☆546Updated 3 months ago
- Build, customize and control you own LLMs. From data pre-processing to fine-tuning, xTuring provides an easy way to personalize open-sour…☆2,642Updated 7 months ago
- AIxplora is a open-source tool which let's you query all kind of files not limited to any length or format.☆272Updated last year