Troyanovsky / Local-LLM-Comparison-Colab-UI
Compare the performance of different LLM that can be deployed locally on consumer hardware. Run yourself with Colab WebUI.
☆1,024Updated this week
Alternatives and similar repositories for Local-LLM-Comparison-Colab-UI:
Users that are interested in Local-LLM-Comparison-Colab-UI are comparing it to the libraries listed below
- TheBloke's Dockerfiles☆303Updated 11 months ago
- A llama.cpp drop-in replacement for OpenAI's GPT endpoints, allowing GPT-powered apps to run off local llama.cpp models instead of OpenAI…☆600Updated last year
- Web UI for ExLlamaV2☆481Updated last week
- UI tool for fine-tuning and testing your own LoRA models base on LLaMA, GPT-J and more. One-click run on Google Colab. + A Gradio ChatGPT…☆458Updated last year
- An Autonomous LLM Agent that runs on Wizcoder-15B☆337Updated 3 months ago
- An OAI compatible exllamav2 API that's both lightweight and fast☆783Updated this week
- Run any Large Language Model behind a unified API☆163Updated last year
- A curated list of awesome Large Language Model (LLM) Web User Interfaces.☆387Updated last month
- The llama-cpp-agent framework is a tool designed for easy interaction with Large Language Models (LLMs). Allowing users to chat with LLM …☆528Updated this week
- Customizable implementation of the self-instruct paper.☆1,038Updated 11 months ago
- Lord of LLMS☆284Updated this week
- function calling-based LLM agents☆282Updated 5 months ago
- Curated list of useful LLM / Analytics / Datascience resources☆2,139Updated last week
- Chat with your documents offline using AI.☆717Updated last year
- ☆145Updated last week
- A set of LLM Tutorials from my youtube channel☆750Updated last year
- Convenience scripts to finetune (chat-)LLaMa3 and other models for any language☆297Updated 8 months ago
- Convenient wrapper for fine-tuning and inference of Large Language Models (LLMs) with several quantization techniques (GTPQ, bitsandbytes…☆147Updated last year
- 💬 Chatbot web app + HTTP and Websocket endpoints for LLM inference with the Petals client☆308Updated 9 months ago
- A multimodal, function calling powered LLM webui.☆214Updated 4 months ago
- Chat language model that can use tools and interpret the results☆1,516Updated this week
- Self-evaluating interview for AI coders☆569Updated 3 weeks ago
- An easy way to host your own AI API and expose alternative models, while being compatible with "open" AI clients.☆329Updated 7 months ago
- A collection of open source, actively maintained web apps for LLM applications☆486Updated 8 months ago
- The universal tool suite for vector database management. Manage Pinecone, Chroma, Qdrant, Weaviate and more vector databases with ease.☆1,667Updated last week
- Ship RAG based LLM web apps in seconds.☆982Updated last year
- Large-scale LLM inference engine☆1,290Updated this week
- An AI assistant beyond the chat box.☆319Updated 11 months ago
- This repo is to showcase how you can run a model locally and offline, free of OpenAI dependencies.☆261Updated 7 months ago
- A prompt/context management system☆169Updated last year