silphendio / sliced_llamaLinks
Simple LLM inference server
☆20Updated last year
Alternatives and similar repositories for sliced_llama
Users that are interested in sliced_llama are comparing it to the libraries listed below
Sorting:
- Experimental sampler to make LLMs more creative☆31Updated 2 years ago
- Yet Another (LLM) Web UI, made with Gemini☆12Updated 11 months ago
- run ollama & gguf easily with a single command☆52Updated last year
- Steer LLM outputs towards a certain topic/subject and enhance response capabilities using activation engineering by adding steering vecto…☆43Updated last year
- A sleek, customizable interface for managing LLMs with responsive design and easy agent personalization.☆17Updated last year
- ☆27Updated 2 years ago
- Modified Beam Search with periodical restart☆12Updated last year
- The hearth of The Pulsar App, fast, secure and shared inference with modern UI☆58Updated last year
- 5X faster 60% less memory QLoRA finetuning☆21Updated last year
- Local LLM inference & management server with built-in OpenAI API☆31Updated last year
- Run Vision LLMs, TTS and STT APIs. Website and API for https://text-generator.io☆38Updated 2 months ago
- BH hackathon☆14Updated last year
- ☆62Updated 4 months ago
- A Python library to orchestrate LLMs in a neural network-inspired structure☆51Updated last year
- Accepts a Hugging Face model URL, automatically downloads and quantizes it using Bits and Bytes.☆38Updated last year
- The Benefits of a Concise Chain of Thought on Problem Solving in Large Language Models☆22Updated last year
- Parameter-Efficient Sparsity Crafting From Dense to Mixture-of-Experts for Instruction Tuning on General Tasks☆31Updated last year
- Glyphs, acting as collaboratively defined symbols linking related concepts, add a layer of multidimensional semantic richness to user-AI …☆54Updated 9 months ago
- Complex RAG backend☆29Updated last year
- entropix style sampling + GUI☆27Updated last year
- Adding a multi-text multi-speaker script (diffe) that is based on a script from asiff00 on issue 61 for Sesame: A Conversational Speech G…☆25Updated 8 months ago
- LLM backed Fantasy Tribe Game☆19Updated last year
- ☆23Updated last year
- ☆50Updated last year
- GRDN.AI app for garden optimization☆70Updated last week
- ☆16Updated 2 years ago
- An OpenAI API compatible LLM inference server based on ExLlamaV2.☆25Updated last year
- AnyModal is a Flexible Multimodal Language Model Framework for PyTorch☆103Updated 11 months ago
- Who needs o1 anyways. Add CoT to any OpenAI compatible endpoint.☆44Updated last year
- ☆67Updated last year