Alternatives and similar repositories for GGUF-Quantization-of-any-LLM:

Users that are interested in GGUF-Quantization-of-any-LLM are comparing it to the libraries listed below

• JakeFurtaw / Chat-RAG
  Uses a Gradio interface to stream coding related responses from local and cloud based large language models. Pulls context from GitHub Re…
  ☆19Updated 4 months ago
• AIAnytime / CrewAI-AgentOps
  CrewAI AgentOps: Monitor your AI Agents
  ☆14Updated 6 months ago
• AIAnytime / On-device-real-time-RAG-App
  On-device real-time RAG App built using Jina Reader, Mediapipe, Gemma 2b IT LLM.
  ☆12Updated 9 months ago
• AIAnytime / Medical-Help-App-using-GPT-4V
  Medical Help App using GPT-4V
  ☆24Updated last year
• nicknochnack / PyReft
  ☆16Updated 8 months ago
• AIAnytime / Zephyr-7B-beta-RAG-Demo
  Zephyr 7B beta RAG Demo inside a Gradio app powered by BGE Embeddings, ChromaDB, and Zephyr 7B Beta LLM.
  ☆34Updated last year
• nodematiclabs / llama-3-finetune-unsloth
  ☆15Updated 8 months ago
• AIAnytime / Medical-Mixture-of-Experts-LLM
  Medical Mixture of Experts LLM using Mergekit.
  ☆20Updated 10 months ago
• AIAnytime / Function-Calling-Mistral-7B
  Function Calling Mistral 7B. Learn how to make functions call for open source LLMs.
  ☆48Updated 10 months ago
• ddh0 / easy-llama
  Text generation in Python, as easy as possible
  ☆48Updated this week
• githubpradeep / notebooks
  ☆50Updated 3 weeks ago
• AIAnytime / RAG-Tool-using-Haystack-Mistral-and-Chainlit
  RAG Tool using Haystack, Mistral, and Chainlit. All open source stack on CPU.
  ☆23Updated last year
• yip-kl / llm_dspy_tutorial
  Tutorial for DSPy
  ☆22Updated 8 months ago
• sudarshan-koirala / RAG-chat-with-documents
  Chainlit app for advanced RAG. Uses llamaparse, langchain, qdrant and models from groq.
  ☆40Updated 7 months ago
• monk1337 / auto-ollama
  run ollama & gguf easily with a single command
  ☆49Updated 8 months ago
• deshwalmahesh / PHUDGE
  Official repo for the paper PHUDGE: Phi-3 as Scalable Judge. Evaluate your LLMs with or without custom rubric, reference answer, absolute…
  ☆48Updated 6 months ago
• AIAnytime / SLIM-Models-by-LLMWare
  SLIM Models by LLMWare. A streamlit app showing the capabilities for AI Agents and Function Calls.
  ☆19Updated 11 months ago
• The-Swarm-Corporation / OmniParse
  Transform unstructured documents into actionable, structured data with enterprise-grade precision and reliability, ready for large-scale …
  ☆15Updated this week
• AIAnytime / Groq-Whisper-Fast-Transcription-App
  Groq-Whisper Fast Transcription App built using Groq API and Streamlit.
  ☆21Updated 3 months ago
• AIAnytime / YouTube-Video-Summarization-App
  YouTube Video Summarization App built using open source LLM and Framework like Llama 2, Haystack, Whisper, and Streamlit. This app smooth…
  ☆55Updated 8 months ago
• l4b4r4b4b4 / AIDocks
  LLM-Training-API: Including Embeddings & ReRankers, mergekit, LaserRMT
  ☆26Updated 11 months ago
• fabiomatricardi / How-I-Built-a-Chatbot-that-Crushed-ChatGPT
  Repo of the code from the Medium article
  ☆19Updated 7 months ago
• sudarshan-koirala / langchain-gemma-ollama-chainlit
  Simple Chainlit UI for running llms locally using Ollama and LangChain
  ☆41Updated 10 months ago
• AIAnytime / Agentic-RAG-using-Crew-AI
  Agentic RAG using Crew AI.
  ☆23Updated 6 months ago
• benitomartin / crewai-rag-langchain-qdrant
  Agentic RAG with Langchain, Qdrant and CrewAI
  ☆43Updated 8 months ago
• AIAnytime / On-device-LLM-Inference-using-Mediapipe
  On-device LLM Inference using Mediapipe LLM Inference API.
  ☆20Updated 9 months ago
• InsightEdge01 / RAGGemmaModel
  ☆15Updated 10 months ago
• InsightEdge01 / GroqPDFFastChatbot
  ☆15Updated 10 months ago
• AIAnytime / agent-watch
  Agent Watch is an AgentOps monitoring library designed for Crew AI applications.
  ☆13Updated last month
• AIAnytime / Training-Small-Language-Model
  Training Small Language Model
  ☆22Updated last year