Alternatives and similar repositories for GGUF-Quantization-of-any-LLM

Users that are interested in GGUF-Quantization-of-any-LLM are comparing it to the libraries listed below

• monk1337 / auto-ollama
  run ollama & gguf easily with a single command
  ☆51Updated last year
• JakeFurtaw / Chat-RAG
  Advanced Coding AI Assistant that uses a Gradio interface to stream coding related responses. ChatRAG supports local and API inference an…
  ☆22Updated last month
• TuanaCelik / unstructuredio-haystack
  💙 Unstructured Data Connectors for Haystack 2.0
  ☆17Updated last year
• nodematiclabs / llama-3-finetune-unsloth
  ☆14Updated last year
• nicknochnack / PyReft
  ☆16Updated last year
• AIAnytime / Zephyr-7B-beta-RAG-Demo
  Zephyr 7B beta RAG Demo inside a Gradio app powered by BGE Embeddings, ChromaDB, and Zephyr 7B Beta LLM.
  ☆34Updated last year
• AIAnytime / Multimodal-AI-App-using-Llava-7B
  Multimodal AI App using Llava 7B and Gradio.
  ☆38Updated last year
• DAMO-NLP-SG / Multipurpose-Chatbot
  A chatbot UI for RAG, multimodal, text completion. (support Transformers, llama.cpp, MLX, vLLM)
  ☆19Updated last year
• AIAnytime / Groq-Whisper-Fast-Transcription-App
  Groq-Whisper Fast Transcription App built using Groq API and Streamlit.
  ☆23Updated 9 months ago
• deshwalmahesh / PHUDGE
  Official repo for the paper PHUDGE: Phi-3 as Scalable Judge. Evaluate your LLMs with or without custom rubric, reference answer, absolute…
  ☆49Updated 11 months ago
• shivamsanju / ragswift
  🚀 Scale your RAG pipeline using Ragswift: A scalable centralized embeddings management platform
  ☆38Updated last year
• AIAnytime / On-device-real-time-RAG-App
  On-device real-time RAG App built using Jina Reader, Mediapipe, Gemma 2b IT LLM.
  ☆14Updated last year
• AIAnytime / Chat-With-Your-Data-Chatbot
  Chat with Your Data App using Langchain, ChromaDB, Sentence Transformers, and LaMiNi LM Model. This Chatbot is completely powered by Open…
  ☆17Updated 2 years ago
• CVxTz / llm-serve-tutorial
  ☆20Updated last year
• AIAnytime / Function-Calling-Mistral-7B
  Function Calling Mistral 7B. Learn how to make functions call for open source LLMs.
  ☆48Updated last year
• deep-diver / gradio-chat
  HuggingChat like UI in Gradio
  ☆71Updated 2 years ago
• AIAnytime / agent-watch
  Agent Watch is an AgentOps monitoring library designed for Crew AI applications.
  ☆18Updated 6 months ago
• AIAnytime / Medical-Mixture-of-Experts-LLM
  Medical Mixture of Experts LLM using Mergekit.
  ☆20Updated last year
• truemagic-coder / nemo-agent
  Your Python AI Coder!
  ☆34Updated last month
• langchain-ai / adaptive-rag-101
  101 for setting up adaptive RAG
  ☆16Updated 9 months ago
• AIAnytime / RAG-Tool-using-Haystack-Mistral-and-Chainlit
  RAG Tool using Haystack, Mistral, and Chainlit. All open source stack on CPU.
  ☆23Updated last year
• gradio-app / sambanova-gradio
  ☆21Updated 7 months ago
• willydouhard / data-analyst
  ☆12Updated last year
• AIAnytime / SLIM-Models-by-LLMWare
  SLIM Models by LLMWare. A streamlit app showing the capabilities for AI Agents and Function Calls.
  ☆20Updated last year
• run-llama / image-generation-agent
  An agent to generate stunning images :)
  ☆19Updated last month
• githubpradeep / notebooks
  ☆54Updated 4 months ago
• gilfernandes / chat_functions
  Simple playground chat app that interacts with OpenAI's functions with memory and custom tools.
  ☆18Updated last year
• AI-ANK / C3-Voice-Assistant-UI
  A project that brings the power of Large Language Models (LLM) and Retrieval-Augmented Generation (RAG) within reach of everyone, particu…
  ☆34Updated last year
• The-Swarm-Corporation / OmniParse
  Transform unstructured documents into actionable, structured data with enterprise-grade precision and reliability, ready for large-scale …
  ☆19Updated this week
• AstraBert / PrAIvateSearch
  Own your AI, search the web with it🌐😎
  ☆87Updated 5 months ago