Troyanovsky / Local-LLM-Comparison-Colab-UILinks
Compare the performance of different LLM that can be deployed locally on consumer hardware. Run yourself with Colab WebUI.
☆1,095Updated 2 weeks ago
Alternatives and similar repositories for Local-LLM-Comparison-Colab-UI
Users that are interested in Local-LLM-Comparison-Colab-UI are comparing it to the libraries listed below
Sorting:
- Chat with your documents offline using AI.☆738Updated 2 years ago
- Python bindings for the Transformer models implemented in C/C++ using GGML library.☆1,876Updated 2 years ago
- LLM that combines the principles of wizardLM and vicunaLM☆716Updated 2 years ago
- Self-evaluating interview for AI coders☆597Updated 7 months ago
- TheBloke's Dockerfiles☆308Updated last year
- The llama-cpp-agent framework is a tool designed for easy interaction with Large Language Models (LLMs). Allowing users to chat with LLM …☆612Updated 11 months ago
- A llama.cpp drop-in replacement for OpenAI's GPT endpoints, allowing GPT-powered apps to run off local llama.cpp models instead of OpenAI…☆597Updated 2 years ago
- Convenience scripts to finetune (chat-)LLaMa3 and other models for any language☆314Updated last year
- An AI assistant beyond the chat box.☆329Updated last year
- Customizable implementation of the self-instruct paper.☆1,049Updated last year
- ☆674Updated 2 weeks ago
- Ship RAG based LLM web apps in seconds.☆1,005Updated 2 years ago
- Querying local documents, powered by LLM☆641Updated last week
- ☆168Updated 2 years ago
- Web UI for ExLlamaV2☆513Updated 11 months ago
- This repo is to showcase how you can run a model locally and offline, free of OpenAI dependencies.☆296Updated last year
- A more memory-efficient rewrite of the HF transformers implementation of Llama for use with quantized weights.☆2,906Updated 2 years ago
- UI tool for fine-tuning and testing your own LoRA models base on LLaMA, GPT-J and more. One-click run on Google Colab. + A Gradio ChatGPT…☆475Updated 2 years ago
- function calling-based LLM agents☆289Updated last year
- Tune any FALCON in 4-bit☆463Updated 2 years ago
- An AI code interpreter for sensitive data, powered by GPT-4 or Code Llama / Llama 2.☆440Updated 2 years ago
- A proof-of-concept project that showcases the potential for using small, locally trainable LLMs to create next-generation documentation t…☆541Updated 2 years ago
- An Autonomous LLM Agent that runs on Wizcoder-15B☆333Updated last year
- ☆161Updated 11 months ago
- Running Llama 2 and other Open-Source LLMs on CPU Inference Locally for Document Q&A☆973Updated 2 years ago
- Run any Large Language Model behind a unified API☆171Updated 2 years ago
- ☆276Updated 2 years ago
- Official supported Python bindings for llama.cpp + gpt4all☆1,016Updated 2 years ago
- AlwaysReddy is a LLM voice assistant that is always just a hotkey away.☆761Updated 10 months ago
- Large-scale LLM inference engine☆1,631Updated last week