simonw / llm-ggufLinks
Run models distributed as GGUF files using LLM
☆68Updated 7 months ago
Alternatives and similar repositories for llm-gguf
Users that are interested in llm-gguf are comparing it to the libraries listed below
Sorting:
- ☆22Updated 10 months ago
- LLM plugin for asking questions of LLM's own documentation, and related packages☆18Updated last month
- LLM plugin for embeddings using sentence-transformers☆66Updated 2 months ago
- Plugin for LLM adding a Markov chain generating model☆19Updated 11 months ago
- LLM plugin adding support for the MPT-30B language model☆34Updated last year
- Access the Cohere Command R family of models☆37Updated 3 months ago
- Conduct in-depth research with AI-driven insights : DeepDive is a command-line tool that leverages web searches and AI models to generate…☆42Updated 10 months ago
- Create an LLM XML context document from an llms.txt file☆21Updated 10 months ago
- This repository is designed for deploying and managing server processes that handle embeddings using the Infinity Embedding model or Larg…☆23Updated 3 months ago
- Create embeddings for LLM using the Nomic API☆23Updated 7 months ago
- Embedding models from Jina AI☆60Updated last year
- Run transcriptions using the OpenAI Whisper API☆24Updated 8 months ago
- Smart reproducible analytical pipeline inspection☆17Updated 2 months ago
- "llm python" is a command to run a Python interpreter in the LLM virtual environment☆34Updated last year
- A Chrome extension that saves conversations with Claude to GitHubGists or your clipboard.☆86Updated 7 months ago
- Plugin for LLM adding support for Anthropic's Claude models☆37Updated 7 months ago
- Hubcap is an autonomous AI agent in 25 lines of code: a small Autobot that you can't trust☆39Updated last year
- Extract structured data from local or remote LLM models☆42Updated last year
- Load LLM templates from Fabric☆29Updated 2 months ago
- Serving LLMs in the HF-Transformers format via a PyFlask API☆71Updated 9 months ago
- An interface for llama.cpp, ChatGPT, and Gemini☆26Updated this week
- LLM access to pplx-api☆31Updated 3 weeks ago
- Answer questions against collections stored in LLM using Retrieval Augmented Generation☆27Updated last year
- A collection of prompts for use with the LLM CLI tool☆16Updated 2 years ago
- A QT GUI for large language models☆35Updated last year
- Some tough questions to test new models.☆28Updated last year
- Make tool-calling schemas for existing tools☆14Updated 3 months ago
- A text-to-SQL prototype on the northwind sqlite dataset☆12Updated 9 months ago
- A conversational UI for chatbots using the llama.cpp server☆14Updated last month
- CLI that queries multiple language models in parallel using prompts from a CSV file☆26Updated last month