Alternatives and similar repositories for GGUF-Quantization-of-any-LLM

Users that are interested in GGUF-Quantization-of-any-LLM are comparing it to the libraries listed below

• monk1337 / auto-ollama
  run ollama & gguf easily with a single command
  ☆52Updated last year
• githubpradeep / notebooks
  ☆55Updated 3 months ago
• AIAnytime / Zephyr-7B-beta-RAG-Demo
  Zephyr 7B beta RAG Demo inside a Gradio app powered by BGE Embeddings, ChromaDB, and Zephyr 7B Beta LLM.
  ☆36Updated 2 years ago
• louisbrulenaudet / ragoon
  High level library for batched embeddings generation, blazingly-fast web-based RAG and quantized indexes processing ⚡
  ☆68Updated 3 weeks ago
• nodematiclabs / llama-3-finetune-unsloth
  ☆14Updated last year
• Aesthisia / LLMinator
  Gradio based tool to run opensource LLM models directly from Huggingface
  ☆96Updated last year
• deep-diver / gradio-chat
  HuggingChat like UI in Gradio
  ☆70Updated 2 years ago
• AIAnytime / Function-Calling-Mistral-7B
  Function Calling Mistral 7B. Learn how to make functions call for open source LLMs.
  ☆48Updated last year
• l4b4r4b4b4 / AIDocks
  LLM-Training-API: Including Embeddings & ReRankers, mergekit, LaserRMT
  ☆27Updated last year
• Cerebras / DocChat
  GPT-4 Level Conversational QA Trained In a Few Hours
  ☆66Updated last year
• run-llama / mixtral_ollama
  ☆46Updated last year
• langchain-ai / prompt-eval-recommendation
  Streamlit app for recommending eval functions using prompt diffs
  ☆30Updated last year
• JakeFurtaw / Chat-RAG
  Advanced Coding AI Assistant that uses a Gradio interface to stream coding related responses. ChatRAG supports local and API inference an…
  ☆23Updated 7 months ago
• AIAnytime / agent-watch
  Agent Watch is an AgentOps monitoring library designed for Crew AI applications.
  ☆21Updated last year
• ritabratamaiti / AnyModal
  AnyModal is a Flexible Multimodal Language Model Framework for PyTorch
  ☆103Updated 11 months ago
• Ashufet / Superior-RAG-for-Complex-PDFs-using-LlamaParse
  I have explained how to create superior RAG pipeline for complex pdfs using LlamaParse. We can extract text and tables from pdf and QA on…
  ☆48Updated last year
• deshwalmahesh / PHUDGE
  Official repo for the paper PHUDGE: Phi-3 as Scalable Judge. Evaluate your LLMs with or without custom rubric, reference answer, absolute…
  ☆51Updated last year
• thad0ctor / unsloth-5090-multiple
  unsloth-5090-multiple
  ☆59Updated 6 months ago
• sudarshan-koirala / langchain-gemma-ollama-chainlit
  Simple Chainlit UI for running llms locally using Ollama and LangChain
  ☆46Updated last year
• shivamsanju / ragswift
  🚀 Scale your RAG pipeline using Ragswift: A scalable centralized embeddings management platform
  ☆38Updated last year
• QuixiAI / SystemChat
  ☆31Updated last year
• kesamet / retrieval-augmented-generation
  Retrieval augmented generation demos with open-source DeepSeek, Llama, Qwen, Mistral, Gemma
  ☆42Updated 3 months ago
• TuanaCelik / unstructuredio-haystack
  💙 Unstructured Data Connectors for Haystack 2.0
  ☆17Updated 2 years ago
• Luxadevi / Ollama-Companion
  Webinterface for administrating Ollama and model Quantization with public endpoints and automized OPENAI proxy
  ☆49Updated 9 months ago
• iulia-b10 / multilingual-embedding-models
  ☆20Updated last year
• Rivridis / LLM-Assistant
  Locally running LLM with internet access
  ☆97Updated 5 months ago
• OpenPipe / rl-experiments
  OpenPipe Reinforcement Learning Experiments
  ☆32Updated 9 months ago
• mourad-ghafiri / OpenMindedChatbot
  OpenMindedChatbot is a Proof Of Concept that leverages the power of Open source Large Language Models (LLM) with Function Calling capabil…
  ☆30Updated last year
• AIAnytime / On-device-real-time-RAG-App
  On-device real-time RAG App built using Jina Reader, Mediapipe, Gemma 2b IT LLM.
  ☆15Updated last year
• Xalp / ECHO
  Official homepage for "Self-Harmonized Chain of Thought" (NAACL 2025)
  ☆91Updated 10 months ago