GGUF Quantization of any LLM.
☆42Mar 4, 2024Updated 2 years ago
Alternatives and similar repositories for GGUF-Quantization-of-any-LLM
Users that are interested in GGUF-Quantization-of-any-LLM are comparing it to the libraries listed below. We may earn a commission when you buy through links labeled 'Ad' on this page.
Sorting:
- Code Llama GGUF Demo☆10Aug 28, 2023Updated 2 years ago
- Chrome Extension powered by LLM☆17Feb 29, 2024Updated 2 years ago
- Medical Mixture of Experts LLM using Mergekit.☆21Mar 6, 2024Updated 2 years ago
- An easy-to-use ML pipeline package for Python inspired by scikit-learn pipeline and PyTorch layers.☆12Aug 27, 2023Updated 2 years ago
- Multimodal AI App using Llava 7B and Gradio.☆39Apr 30, 2024Updated 2 years ago
- Deploy on Railway without the complexity - Free Credits Offer • AdConnect your repo and Railway handles the rest with instant previews. Quickly provision container image services, databases, and storage volumes.
- SLIM Models by LLMWare. A streamlit app showing the capabilities for AI Agents and Function Calls.☆21Feb 11, 2024Updated 2 years ago
- 部署大模型到Android设备☆20Nov 16, 2023Updated 2 years ago
- ☆17Updated this week
- SQLGPT is an advanced SQL query generator powered by natural language processing. Seamlessly transforming plain English queries into comp…☆10Oct 24, 2023Updated 2 years ago
- Tools for CrewAI☆30May 12, 2024Updated 2 years ago
- Run 🦙 @ollama and 🐬 TinyDolphin, 🦙 TinyLlama and other small LLMs on a Raspberry Pi 5 with @Docker #Compose☆29Mar 24, 2024Updated 2 years ago
- Create your own Android RTMP/RTMPS/SRT live streaming application in less than 5 minutes!☆28Apr 29, 2026Updated last month
- Raw source code from Lions' Commentary on UNIX 6th Edition☆16Mar 27, 2013Updated 13 years ago
- Run models distributed as GGUF files using LLM☆89Nov 21, 2024Updated last year
- 1-Click AI Models by DigitalOcean Gradient • AdDeploy popular AI models on DigitalOcean Gradient GPU virtual machines with just a single click. Zero configuration with optimized deployments.
- GGUF parser for Go☆14Mar 8, 2026Updated 2 months ago
- On-device real-time RAG App built using Jina Reader, Mediapipe, Gemma 2b IT LLM.☆15Apr 15, 2024Updated 2 years ago
- Node.js, Express, and PostgreSQL based web server with simple user authentication, to be used as a template or starting off point for bac…☆10Apr 14, 2023Updated 3 years ago
- Port of Facebook's LLaMA model in C/C++☆32Mar 7, 2024Updated 2 years ago
- exmemo obsidian plugin☆13Aug 1, 2025Updated 10 months ago
- Plugging LLMs into Android's Assistant API☆13Jun 4, 2025Updated 11 months ago
- PathRAG System - A Path-based Retrieval-Augmented Generation implementation with knowledge graph visualization and Ollama integration for…☆13Mar 3, 2025Updated last year
- Ask Poddy: Run Open Source LLMs and Embeddings as OpenAI-Compatible Serverless Endpoints (Tutorial)☆11Jul 19, 2024Updated last year
- Actually Helpful Digital Assistant: let AI control your PC☆14Mar 5, 2025Updated last year
- Virtual machines for every use case on DigitalOcean • AdGet dependable uptime with 99.99% SLA, simple security tools, and predictable monthly pricing with DigitalOcean's virtual machines, called Droplets.
- My Gen AI research☆11Jun 3, 2024Updated last year
- A Windows tool to query various LLM AIs. Supports branched conversations, history and summaries among others.☆36May 11, 2026Updated 2 weeks ago
- A simple website to manage your Hyper-V VMs and IIS sites☆12Jan 19, 2023Updated 3 years ago
- ☆14Sep 18, 2024Updated last year
- automatically quant GGUF models☆227Dec 23, 2025Updated 5 months ago
- ☆10May 29, 2020Updated 6 years ago
- Streaming AI assistant with ChatGPT, FastAPI, WebSockets and React ✨🤖🚀☆26Nov 12, 2023Updated 2 years ago
- Finetuning a codegen model with python instruction set using QLORA technique for better efficacy☆11Aug 31, 2023Updated 2 years ago
- A vllm proxy server to add security and multi model management for vllm servers☆12May 30, 2024Updated 2 years ago
- 1-Click AI Models by DigitalOcean Gradient • AdDeploy popular AI models on DigitalOcean Gradient GPU virtual machines with just a single click. Zero configuration with optimized deployments.
- Official PyTorch implementation of "GuidedQuant: Large Language Model Quantization via Exploiting End Loss Guidance" (ICML 2025)☆51Apr 13, 2026Updated last month
- Anonymously check if an email sender has ever been compromised in a security breach. Service provided by https://hacked-emails.com/☆14Apr 13, 2018Updated 8 years ago
- Retrieval augmented generation demos with open-source DeepSeek, Llama, Qwen, Mistral, Gemma☆42Aug 18, 2025Updated 9 months ago
- A tool for extracting plain text and internal Wikipedia links from Wikipedia dumps☆11Apr 18, 2019Updated 7 years ago
- ☆14Apr 23, 2024Updated 2 years ago
- /r/Excel Reddit Add-In☆23Jun 25, 2015Updated 10 years ago
- Example of Langchain-Elasticsearch integrations & RAG.☆12Sep 20, 2024Updated last year