cyan2k / llama.cpp
LLM inference in C/C++
☆20Updated last month
Related projects ⓘ
Alternatives and complementary repositories for llama.cpp
- LlamaCards is a web application that provides a dynamic interface for interacting with LLM models in real-time. This app allows users to …☆35Updated 2 months ago
- Loader extension for tabbyAPI in SillyTavern☆21Updated 3 months ago
- HTTP proxy for on-demand model loading with llama.cpp (or other OpenAI compatible backends)☆38Updated this week
- A simple speech-to-text and text-to-speech AI chatbot that can be run fully offline.☆42Updated 9 months ago
- 4 million public stable diffusion prompts -- interactive neural search and llama chat☆19Updated 2 months ago
- klmbr - a prompt pre-processing technique to break through the barrier of entropy while generating text with LLMs☆58Updated last month
- 33B Chinese LLM, DPO QLORA, 100K context, AirLLM 70B inference with single 4GB GPU☆12Updated 6 months ago
- Note about running ollama 🦙☆30Updated 6 months ago
- SLOP Detector and analyzer based on dictionary for shareGPT JSON and text☆44Updated last week
- Large Model Proxy is designed to make it easy to run multiple resource-heavy Large Models (LM) on the same machine with limited amount of…☆46Updated last month
- ☆17Updated 3 weeks ago
- LLM backed Fantasy Tribe Game☆17Updated last week
- No-messing-around sh client for llama.cpp's server☆27Updated 3 months ago
- ☆30Updated 6 months ago
- A web-app to explore topics using LLM (less typing and more clicks)☆65Updated 10 months ago
- This small API downloads and exposes access to NeuML's txtai-wikipedia and full wikipedia datasets, taking in a query and returning full …☆46Updated 3 months ago
- A simple light terminal style chat app that lets you use connect to your local llama.cpp server☆27Updated 4 months ago
- Draft42 - Streamlit chatbot with function calling☆29Updated 7 months ago
- Demo of an "always-on" AI assistant.☆23Updated 9 months ago
- Cohere Toolkit is a collection of prebuilt components enabling users to quickly build and deploy RAG applications.☆25Updated 2 weeks ago
- Chat WebUI is an easy-to-use user interface for interacting with AI, and it comes with multiple useful built-in tools.☆12Updated this week
- ☆20Updated 2 months ago
- ☆24Updated last week
- Small tools to enhance your AI app with little effort.☆11Updated 10 months ago
- Text generation in Python, as easy as possible☆42Updated last week
- Mistral7B playing DOOM☆27Updated 7 months ago
- ☆31Updated 10 months ago
- After my server ui improvements were successfully merged, consider this repo a playground for experimenting, tinkering and hacking around…☆56Updated 2 months ago
- "a towel is about the most massively useful thing an interstellar AI hitchhiker can have"☆46Updated last month
- RetroChat is a powerful command-line interface for interacting with various AI language models. It provides a seamless experience for eng…☆65Updated 2 months ago