Alternatives and similar repositories for GGUF-Quantization-of-any-LLM:

Users that are interested in GGUF-Quantization-of-any-LLM are comparing it to the libraries listed below

• AIAnytime / RAG-Tool-using-Haystack-Mistral-and-Chainlit
  RAG Tool using Haystack, Mistral, and Chainlit. All open source stack on CPU.
  ☆23Updated last year
• AIAnytime / Multimodal-AI-App-using-Llava-7B
  Multimodal AI App using Llava 7B and Gradio.
  ☆38Updated 10 months ago
• AIAnytime / Function-Calling-Mistral-7B
  Function Calling Mistral 7B. Learn how to make functions call for open source LLMs.
  ☆48Updated last year
• AIAnytime / Medical-Mixture-of-Experts-LLM
  Medical Mixture of Experts LLM using Mergekit.
  ☆20Updated last year
• JakeFurtaw / Chat-RAG
  Uses a Gradio interface to stream coding related responses from local and cloud based large language models. Pulls context from GitHub Re…
  ☆20Updated last week
• monk1337 / auto-ollama
  run ollama & gguf easily with a single command
  ☆49Updated 10 months ago
• AIAnytime / Groq-Whisper-Fast-Transcription-App
  Groq-Whisper Fast Transcription App built using Groq API and Streamlit.
  ☆23Updated 6 months ago
• mshumer / gpt-carrot-image-understanding
  Using GPT-3 and Carrot (GPT-3 for computer vision) to create detailed descriptions of images.
  ☆13Updated 3 years ago
• githubpradeep / notebooks
  ☆52Updated last month
• AIAnytime / On-device-real-time-RAG-App
  On-device real-time RAG App built using Jina Reader, Mediapipe, Gemma 2b IT LLM.
  ☆13Updated 11 months ago
• AIAnytime / Zephyr-7B-beta-RAG-Demo
  Zephyr 7B beta RAG Demo inside a Gradio app powered by BGE Embeddings, ChromaDB, and Zephyr 7B Beta LLM.
  ☆34Updated last year
• AIAnytime / Chrome-Extension-powered-by-LLM
  Chrome Extension powered by LLM
  ☆17Updated last year
• DAMO-NLP-SG / Multipurpose-Chatbot
  A chatbot UI for RAG, multimodal, text completion. (support Transformers, llama.cpp, MLX, vLLM)
  ☆19Updated 11 months ago
• AIAnytime / Small-Multimodal-Vision-Model
  Small Multimodal Vision Model "Imp-v1-3b" trained using Phi-2 and Siglip.
  ☆17Updated last year
• nodematiclabs / llama-3-finetune-unsloth
  ☆14Updated 11 months ago
• deshwalmahesh / PHUDGE
  Official repo for the paper PHUDGE: Phi-3 as Scalable Judge. Evaluate your LLMs with or without custom rubric, reference answer, absolute…
  ☆49Updated 8 months ago
• louisbrulenaudet / ragoon
  High level library for batched embeddings generation, blazingly-fast web-based RAG and quantized indexes processing ⚡
  ☆67Updated 4 months ago
• Ashufet / Superior-RAG-for-Complex-PDFs-using-LlamaParse
  I have explained how to create superior RAG pipeline for complex pdfs using LlamaParse. We can extract text and tables from pdf and QA on…
  ☆43Updated last year
• TuanaCelik / unstructuredio-haystack
  💙 Unstructured Data Connectors for Haystack 2.0
  ☆16Updated last year
• AIAnytime / PubMed-Healthcare-Chatbot
  PubMed Healthcare Chatbot. LLM Augmented Q&A over PubMed Search Engine.
  ☆22Updated last year
• AIAnytime / agent-watch
  Agent Watch is an AgentOps monitoring library designed for Crew AI applications.
  ☆17Updated 3 months ago
• gradio-app / sambanova-gradio
  ☆21Updated 4 months ago
• Doriandarko / OraclesGPT
  ☆11Updated last year
• AIAnytime / Fine-Tuning-Multimodal-LLM
  Fine Tuning Multimodal LLM "Idefics 9B" on Pokemon Go Dataset available on Hugging Face.
  ☆19Updated last year
• AIAnytime / Medical-Help-App-using-GPT-4V
  Medical Help App using GPT-4V
  ☆25Updated last year
• AIAnytime / Question-Answer-Generation-App-using-Mistral-7B
  Question Answer Generation App using Mistral 7B, Langchain, and FastAPI.
  ☆64Updated last year
• run-llama / mixtral_ollama
  ☆46Updated last year
• AIAnytime / Chat-With-Your-Data-Chatbot
  Chat with Your Data App using Langchain, ChromaDB, Sentence Transformers, and LaMiNi LM Model. This Chatbot is completely powered by Open…
  ☆17Updated last year
• Daethyra / Build-RAGAI
  Interactive notes (Jupyter Notebooks) for building AI-powered applications
  ☆31Updated 10 months ago
• AIAnytime / Medical-RAG-using-Bio-Mistral-7B
  This is a RAG implementation using Open Source stack. BioMistral 7B has been used to build this app along with PubMedBert as an embedding…
  ☆68Updated this week