silphendio / sliced_llama
Simple LLM inference server
☆19Updated 7 months ago
Alternatives and similar repositories for sliced_llama:
Users that are interested in sliced_llama are comparing it to the libraries listed below
- Experimental sampler to make LLMs more creative☆30Updated last year
- ☆27Updated last year
- A sleek, customizable interface for managing LLMs with responsive design and easy agent personalization.☆12Updated 4 months ago
- Steer LLM outputs towards a certain topic/subject and enhance response capabilities using activation engineering by adding steering vecto…☆42Updated 9 months ago
- 5X faster 60% less memory QLoRA finetuning☆21Updated 7 months ago
- ☆31Updated last year
- ☆25Updated 4 months ago
- Proteus is an experimental platform that combines the power of Large Language Models with the Genesis physics engine☆18Updated 3 weeks ago
- A Python library to orchestrate LLMs in a neural network-inspired structure☆46Updated 3 months ago
- Large-Language-Model to Machine Interface project.☆17Updated last year
- Yet Another (LLM) Web UI, made with Gemini☆11Updated 3 weeks ago
- Create text chunks which end at natural stopping points without using a tokenizer☆26Updated last month
- Host LLM via text-generation-inference☆15Updated last year
- Easily convert HuggingFace models to GGUF-format for llama.cpp☆21Updated 5 months ago
- implementation of https://arxiv.org/pdf/2312.09299☆20Updated 6 months ago
- A QT GUI for large language models☆26Updated last year
- ☆37Updated 5 months ago
- The hearth of The Pulsar App, fast, secure and shared inference with modern UI☆42Updated last month
- Accepts a Hugging Face model URL, automatically downloads and quantizes it using Bits and Bytes.☆38Updated 10 months ago
- ☆21Updated 4 months ago
- The original BabyAGI, updated with LiteLLM and no vector database reliance (csv instead)☆21Updated 3 months ago
- Local LLM inference & management server with built-in OpenAI API☆31Updated 8 months ago
- Easy to use, High Performant Knowledge Distillation for LLMs☆38Updated last week
- A Windows tool to query various LLM AIs. Supports branched conversations, history and summaries among others.☆28Updated this week
- a lightweight, open-source blueprint for building powerful and scalable LLM chat applications☆30Updated 7 months ago
- AI web agent to find answers to any question☆21Updated last week
- Generate visual podcasts about novels using open source models☆24Updated last year
- ☆21Updated 7 months ago
- A minimalist Docker project to help people getting started with Node, WizardCoder, CTransformers, Python, Express and TypeScript. Ready t…☆14Updated last year