silphendio / sliced_llamaLinks
Simple LLM inference server
☆20Updated 11 months ago
Alternatives and similar repositories for sliced_llama
Users that are interested in sliced_llama are comparing it to the libraries listed below
Sorting:
- Glyphs, acting as collaboratively defined symbols linking related concepts, add a layer of multidimensional semantic richness to user-AI …☆48Updated 3 months ago
- Local LLM inference & management server with built-in OpenAI API☆31Updated last year
- Experimental sampler to make LLMs more creative☆31Updated last year
- ☆28Updated 9 months ago
- Adding a multi-text multi-speaker script (diffe) that is based on a script from asiff00 on issue 61 for Sesame: A Conversational Speech G…☆23Updated 2 months ago
- Yet Another (LLM) Web UI, made with Gemini☆12Updated 5 months ago
- Steer LLM outputs towards a certain topic/subject and enhance response capabilities using activation engineering by adding steering vecto…☆42Updated last year
- ☆30Updated last year
- ☆39Updated last year
- Parameter-Efficient Sparsity Crafting From Dense to Mixture-of-Experts for Instruction Tuning on General Tasks☆31Updated last year
- A sleek, customizable interface for managing LLMs with responsive design and easy agent personalization.☆15Updated 9 months ago
- run ollama & gguf easily with a single command☆50Updated last year
- ☆19Updated 2 months ago
- Accepts a Hugging Face model URL, automatically downloads and quantizes it using Bits and Bytes.☆38Updated last year
- ☆26Updated last year
- Large-Language-Model to Machine Interface project.☆18Updated last year
- LLM backed Fantasy Tribe Game☆18Updated 6 months ago
- Build HTML artefacts with Ollama☆11Updated 5 months ago
- Generate visual podcasts about novels using open source models☆25Updated 2 years ago
- Serving LLMs in the HF-Transformers format via a PyFlask API☆72Updated 8 months ago
- A guidance compatibility layer for llama-cpp-python☆34Updated last year
- Complex RAG backend☆28Updated last year
- 5X faster 60% less memory QLoRA finetuning☆21Updated last year
- ☆24Updated 4 months ago
- Cog wrapper for collabora/WhisperSpeech☆24Updated last year
- ☆22Updated 11 months ago
- The hearth of The Pulsar App, fast, secure and shared inference with modern UI☆56Updated 5 months ago
- Attend - to what matters.☆15Updated 3 months ago
- a lightweight, open-source blueprint for building powerful and scalable LLM chat applications☆28Updated 11 months ago
- Simple, Fast, Parallel Huggingface GGML model downloader written in python☆24Updated last year