simonw / llm-gguf
Run models distributed as GGUF files using LLM
☆57Updated 3 months ago
Alternatives and similar repositories for llm-gguf:
Users that are interested in llm-gguf are comparing it to the libraries listed below
- Plugin for LLM adding a Markov chain generating model☆18Updated 7 months ago
- Create embeddings for LLM using the Nomic API☆22Updated 2 months ago
- An interface for llama.cpp, ChatGPT, and Gemini☆24Updated this week
- Conduct in-depth research with AI-driven insights : DeepDive is a command-line tool that leverages web searches and AI models to generate…☆36Updated 5 months ago
- YouTube Transcript Cleaner is a simple web-based application that improves the readability of YouTube transcripts.☆25Updated last year
- A Model Context Protocol (MCP) server that helps read GitHub repository structure and important files.☆36Updated 3 weeks ago
- Some tough questions to test new models.☆26Updated 10 months ago
- The official Python library for Formulaic☆16Updated 9 months ago
- LLM plugin providing access to Mistral models using the Mistral API☆167Updated 3 weeks ago
- Plugin for LLM adding support for Anthropic's Claude models☆36Updated 3 months ago
- GPT-4o-Realtime based AI Podcast Generator☆27Updated 4 months ago
- Embedding models from Jina AI☆58Updated last year
- Create an LLM XML context document from an llms.txt file☆14Updated 5 months ago
- "llm python" is a command to run a Python interpreter in the LLM virtual environment☆31Updated last year
- LLM plugin for models hosted by Anyscale Endpoints☆32Updated 9 months ago
- Dagger functions to import Hugging Face GGUF models into a local ollama instance and optionally push them to ollama.com.☆114Updated 8 months ago
- Python module that creates a context map for AI code generation☆19Updated 6 months ago
- codellama on CPU without Docker☆25Updated last year
- Examples of calling OpenRouter models from Python code☆50Updated 10 months ago
- Falcon40B and 7B (Instruct) with streaming, top-k, and beam search☆40Updated last year
- 360M model running in the browser on WebGPU☆21Updated 6 months ago
- LLM plugin for embeddings using sentence-transformers☆48Updated last week
- Web Interface for Vision Language Models Including InternVLM2☆17Updated 6 months ago
- Flexible Python package for managing and extending LLM based agents☆25Updated last year
- A QT GUI for large language models☆30Updated last year
- Access the Cohere Command R family of models☆34Updated 10 months ago
- Building LLM apps with Text Tensors using PyTorch concepts and text gradients☆36Updated 5 months ago
- LLM plugin adding support for the MPT-30B language model☆33Updated last year
- Chat Markup Language conversation library☆55Updated last year