AIAnytime / GGUF-Quantization-of-any-LLM
GGUF Quantization of any LLM.
☆31Updated 8 months ago
Related projects ⓘ
Alternatives and complementary repositories for GGUF-Quantization-of-any-LLM
- Uses a Gradio interface to stream coding related responses from local and cloud based large language models. Pulls context from GitHub Re…☆15Updated 2 months ago
- Zephyr 7B beta RAG Demo inside a Gradio app powered by BGE Embeddings, ChromaDB, and Zephyr 7B Beta LLM.☆35Updated last year
- ☆15Updated 6 months ago
- Medical Mixture of Experts LLM using Mergekit.☆20Updated 8 months ago
- Repo of the code from the Medium article☆19Updated 5 months ago
- run ollama & gguf easily with a single command☆48Updated 6 months ago
- Tutorial for DSPy☆21Updated 6 months ago
- Medical Help App using GPT-4V☆23Updated 10 months ago
- SLIM Models by LLMWare. A streamlit app showing the capabilities for AI Agents and Function Calls.☆18Updated 9 months ago
- Simple Chainlit UI for running llms locally using Ollama and LangChain☆42Updated 8 months ago
- A library for evaluating Retrieval-Augmented Generation (RAG) systems (The traditional ways).☆24Updated 3 months ago
- ☆14Updated 7 months ago
- On-device real-time RAG App built using Jina Reader, Mediapipe, Gemma 2b IT LLM.☆11Updated 7 months ago
- ☆49Updated this week
- OpenMindedChatbot is a Proof Of Concept that leverages the power of Open source Large Language Models (LLM) with Function Calling capabil…☆28Updated 11 months ago
- Testing the different LLM and RAG Tests while I learn along the way☆17Updated 2 months ago
- ☆31Updated 8 months ago
- LLM reads a paper and produce a working prototype☆36Updated 2 weeks ago
- On-device LLM Inference using Mediapipe LLM Inference API.☆20Updated 7 months ago
- CrewAI AgentOps: Monitor your AI Agents☆12Updated 4 months ago
- RAG Tool using Haystack, Mistral, and Chainlit. All open source stack on CPU.☆23Updated last year
- Chat with Your Data App using Langchain, ChromaDB, Sentence Transformers, and LaMiNi LM Model. This Chatbot is completely powered by Open…☆17Updated last year
- A project that brings the power of Large Language Models (LLM) and Retrieval-Augmented Generation (RAG) within reach of everyone, particu…☆32Updated 10 months ago
- RAG example using DSPy, Gradio, FastAPI☆66Updated 7 months ago
- This is a RAG implementation using Open Source stack. BioMistral 7B has been used to build this app along with PubMedBert as an embedding…☆62Updated 9 months ago
- YouTube Video Summarization App built using open source LLM and Framework like Llama 2, Haystack, Whisper, and Streamlit. This app smooth…☆52Updated 6 months ago
- A collection of pre-build wrappers over common RAG systems like ChromaDB, Weaviate, Pinecone, and othersz!☆20Updated last week
- ☆78Updated this week
- 💙 Unstructured Data Connectors for Haystack 2.0☆16Updated last year