silphendio / sliced_llamaLinks
Simple LLM inference server
☆20Updated last year
Alternatives and similar repositories for sliced_llama
Users that are interested in sliced_llama are comparing it to the libraries listed below
Sorting:
- Experimental sampler to make LLMs more creative☆31Updated 2 years ago
- Local LLM inference & management server with built-in OpenAI API☆31Updated last year
- Yet Another (LLM) Web UI, made with Gemini☆12Updated 8 months ago
- ☆61Updated 2 months ago
- The hearth of The Pulsar App, fast, secure and shared inference with modern UI☆57Updated 9 months ago
- A sleek, customizable interface for managing LLMs with responsive design and easy agent personalization.☆16Updated last year
- Glyphs, acting as collaboratively defined symbols linking related concepts, add a layer of multidimensional semantic richness to user-AI …☆52Updated 7 months ago
- A Python library to orchestrate LLMs in a neural network-inspired structure☆50Updated 11 months ago
- ☆27Updated 2 years ago
- Adding a multi-text multi-speaker script (diffe) that is based on a script from asiff00 on issue 61 for Sesame: A Conversational Speech G…☆25Updated 5 months ago
- Who needs o1 anyways. Add CoT to any OpenAI compatible endpoint.☆44Updated 11 months ago
- ☆23Updated 10 months ago
- Steer LLM outputs towards a certain topic/subject and enhance response capabilities using activation engineering by adding steering vecto…☆43Updated last year
- Accepts a Hugging Face model URL, automatically downloads and quantizes it using Bits and Bytes.☆38Updated last year
- LLM backed Fantasy Tribe Game☆19Updated 9 months ago
- "a towel is about the most massively useful thing an interstellar AI hitchhiker can have"☆48Updated 11 months ago
- run ollama & gguf easily with a single command☆52Updated last year
- ☆40Updated last year
- Port of Facebook's LLaMA model in C/C++☆22Updated last year
- OpenPipe Reinforcement Learning Experiments☆31Updated 5 months ago
- Smart proxy for LLM APIs that enables model-specific parameter control, automatic mode switching (like Qwen3's /think and /no_think), and…☆50Updated 3 months ago
- Attend - to what matters.☆17Updated 6 months ago
- Yet another frontend for LLM, written using .NET and WinUI 3☆10Updated 9 months ago
- Chatbot-to-speech using Orpheus TTS model. Interactive console app.☆19Updated 4 months ago
- Large-Language-Model to Machine Interface project.☆19Updated last year
- 5X faster 60% less memory QLoRA finetuning☆21Updated last year
- Chat WebUI is an easy-to-use user interface for interacting with AI, and it comes with multiple useful built-in tools such as web search …☆43Updated 2 weeks ago
- Tcurtsni: Reverse Instruction Chat, ever wonder what your LLM wants to ask you?☆22Updated last year
- ☆16Updated 2 years ago
- ☆51Updated 10 months ago