Alternatives and similar repositories for GGUF-Quantization-of-any-LLM

Users that are interested in GGUF-Quantization-of-any-LLM are comparing it to the libraries listed below

• nodematiclabs / llama-3-finetune-unsloth
  ☆14Updated last year
• monk1337 / auto-ollama
  run ollama & gguf easily with a single command
  ☆52Updated last year
• githubpradeep / notebooks
  ☆55Updated 2 months ago
• deep-diver / gradio-chat
  HuggingChat like UI in Gradio
  ☆70Updated 2 years ago
• JakeFurtaw / Chat-RAG
  Advanced Coding AI Assistant that uses a Gradio interface to stream coding related responses. ChatRAG supports local and API inference an…
  ☆22Updated 6 months ago
• AIAnytime / Zephyr-7B-beta-RAG-Demo
  Zephyr 7B beta RAG Demo inside a Gradio app powered by BGE Embeddings, ChromaDB, and Zephyr 7B Beta LLM.
  ☆36Updated 2 years ago
• gilfernandes / chat_functions
  Simple playground chat app that interacts with OpenAI's functions with memory and custom tools.
  ☆18Updated 2 years ago
• Aesthisia / LLMinator
  Gradio based tool to run opensource LLM models directly from Huggingface
  ☆96Updated last year
• sudarshan-koirala / langchain-gemma-ollama-chainlit
  Simple Chainlit UI for running llms locally using Ollama and LangChain
  ☆46Updated last year
• AIAnytime / agent-watch
  Agent Watch is an AgentOps monitoring library designed for Crew AI applications.
  ☆21Updated 11 months ago
• Cerebras / DocChat
  GPT-4 Level Conversational QA Trained In a Few Hours
  ☆65Updated last year
• shivamsanju / ragswift
  🚀 Scale your RAG pipeline using Ragswift: A scalable centralized embeddings management platform
  ☆38Updated last year
• AIAnytime / CrewAI-AgentOps
  CrewAI AgentOps: Monitor your AI Agents
  ☆19Updated last year
• Rivridis / LLM-Assistant
  Locally running LLM with internet access
  ☆97Updated 4 months ago
• gabrielchua / groq-st-demo
  ☆22Updated last year
• Doriandarko / OraclesGPT
  ☆11Updated 2 years ago
• fw-ai / cookbook
  Recipes and resources for building, deploying, and fine-tuning generative AI with Fireworks.
  ☆128Updated 3 weeks ago
• AIAnytime / Function-Calling-Mistral-7B
  Function Calling Mistral 7B. Learn how to make functions call for open source LLMs.
  ☆48Updated last year
• AstraBert / PrAIvateSearch
  Own your AI, search the web with it🌐😎
  ☆92Updated 10 months ago
• run-llama / mixtral_ollama
  ☆47Updated last year
• edumunozsala / llama-2-7B-4bit-python-coder
  Fine-tune and quantize Llama-2-like models to generate Python code using QLoRA, Axolot,..
  ☆64Updated last year
• langchain-ai / prompt-eval-recommendation
  Streamlit app for recommending eval functions using prompt diffs
  ☆30Updated last year
• Ashufet / Superior-RAG-for-Complex-PDFs-using-LlamaParse
  I have explained how to create superior RAG pipeline for complex pdfs using LlamaParse. We can extract text and tables from pdf and QA on…
  ☆48Updated last year
• langchain-ai / langchain-cohere
  ☆43Updated 2 weeks ago
• Ashufet / Complex-PDF-RAG-Agent-using-QueryPipeline-from-Scratch_Llamaparse_OS-LLM
  ☆43Updated last year
• AIAnytime / Small-Multimodal-Vision-Model
  Small Multimodal Vision Model "Imp-v1-3b" trained using Phi-2 and Siglip.
  ☆17Updated last year
• TuanaCelik / unstructuredio-haystack
  💙 Unstructured Data Connectors for Haystack 2.0
  ☆17Updated 2 years ago
• attashe / ModifiedBeamSampler
  Modified Beam Search with periodical restart
  ☆12Updated last year
• nicknochnack / PyReft
  ☆17Updated last year
• AIAnytime / On-device-real-time-RAG-App
  On-device real-time RAG App built using Jina Reader, Mediapipe, Gemma 2b IT LLM.
  ☆15Updated last year