Alternatives and similar repositories for GGUF-Quantization-of-any-LLM

Users that are interested in GGUF-Quantization-of-any-LLM are comparing it to the libraries listed below

• AIAnytime / Zephyr-7B-beta-RAG-Demo
  Zephyr 7B beta RAG Demo inside a Gradio app powered by BGE Embeddings, ChromaDB, and Zephyr 7B Beta LLM.
  ☆34Updated last year
• AIAnytime / Function-Calling-Mistral-7B
  Function Calling Mistral 7B. Learn how to make functions call for open source LLMs.
  ☆48Updated last year
• githubpradeep / notebooks
  ☆52Updated 3 months ago
• AIAnytime / On-device-real-time-RAG-App
  On-device real-time RAG App built using Jina Reader, Mediapipe, Gemma 2b IT LLM.
  ☆13Updated last year
• AIAnytime / Multimodal-AI-App-using-Llava-7B
  Multimodal AI App using Llava 7B and Gradio.
  ☆38Updated last year
• sudarshan-koirala / langchain-gemma-ollama-chainlit
  Simple Chainlit UI for running llms locally using Ollama and LangChain
  ☆44Updated last year
• AIAnytime / RAG-Tool-using-Haystack-Mistral-and-Chainlit
  RAG Tool using Haystack, Mistral, and Chainlit. All open source stack on CPU.
  ☆23Updated last year
• JakeFurtaw / Chat-RAG
  Advanced Coding AI Assistant that uses a Gradio interface to stream coding related responses. ChatRAG supports local and API inference an…
  ☆21Updated last week
• AIAnytime / YouTube-Video-Summarization-App
  YouTube Video Summarization App built using open source LLM and Framework like Llama 2, Haystack, Whisper, and Streamlit. This app smooth…
  ☆56Updated last year
• AIAnytime / Medical-Mixture-of-Experts-LLM
  Medical Mixture of Experts LLM using Mergekit.
  ☆20Updated last year
• AIAnytime / Training-Small-Language-Model
  Training Small Language Model
  ☆24Updated last year
• nodematiclabs / llama-3-finetune-unsloth
  ☆14Updated last year
• deshwalmahesh / PHUDGE
  Official repo for the paper PHUDGE: Phi-3 as Scalable Judge. Evaluate your LLMs with or without custom rubric, reference answer, absolute…
  ☆49Updated 10 months ago
• AIAnytime / Metadata-Enrichment-using-KeyBERT
  Metadata Enrichment using KeyBERT for advanced and improved RAG.
  ☆10Updated last year
• nicknochnack / PyReft
  ☆16Updated last year
• l4b4r4b4b4 / AIDocks
  LLM-Training-API: Including Embeddings & ReRankers, mergekit, LaserRMT
  ☆27Updated last year
• gabrielchua / groq-st-demo
  ☆22Updated last year
• gradio-app / sambanova-gradio
  ☆21Updated 6 months ago
• monk1337 / auto-ollama
  run ollama & gguf easily with a single command
  ☆50Updated last year
• DAMO-NLP-SG / Multipurpose-Chatbot
  A chatbot UI for RAG, multimodal, text completion. (support Transformers, llama.cpp, MLX, vLLM)
  ☆19Updated last year
• InsightEdge01 / MultiPDFchatMistral-7B
  ☆32Updated last year
• AIAnytime / Chat-With-Your-Data-Chatbot
  Chat with Your Data App using Langchain, ChromaDB, Sentence Transformers, and LaMiNi LM Model. This Chatbot is completely powered by Open…
  ☆17Updated last year
• sudarshan-koirala / RAG-chat-with-documents
  Chainlit app for advanced RAG. Uses llamaparse, langchain, qdrant and models from groq.
  ☆45Updated 11 months ago
• deep-diver / gradio-chat
  HuggingChat like UI in Gradio
  ☆72Updated last year
• louisbrulenaudet / ragoon
  High level library for batched embeddings generation, blazingly-fast web-based RAG and quantized indexes processing ⚡
  ☆66Updated 6 months ago
• mshumer / gpt-carrot-image-understanding
  Using GPT-3 and Carrot (GPT-3 for computer vision) to create detailed descriptions of images.
  ☆13Updated 3 years ago
• AIAnytime / agent-watch
  Agent Watch is an AgentOps monitoring library designed for Crew AI applications.
  ☆17Updated 5 months ago
• AIAnytime / rag-evaluator
  A library for evaluating Retrieval-Augmented Generation (RAG) systems (The traditional ways).
  ☆35Updated 9 months ago
• AIAnytime / SLIM-Models-by-LLMWare
  SLIM Models by LLMWare. A streamlit app showing the capabilities for AI Agents and Function Calls.
  ☆20Updated last year
• AIAnytime / Design-to-Website-App-using-Generative-AI
  Design to Website App using Generative AI. It is a streamlit application that uses OCR and LLM to generate code/website from design.
  ☆20Updated last year