fairydreaming / llama.cpp
LLM inference in C/C++
☆11Updated 2 months ago
Related projects ⓘ
Alternatives and complementary repositories for llama.cpp
- entropix style sampling + GUI☆25Updated 2 weeks ago
- cli tool to quantize gguf, gptq, awq, hqq and exl2 models☆62Updated last month
- BUD-E (Buddy) is an open-source voice assistant framework that facilitates seamless interaction with AI models and APIs, enabling the cre…☆28Updated 3 months ago
- LLM backed Fantasy Tribe Game☆17Updated last week
- Large Model Proxy is designed to make it easy to run multiple resource-heavy Large Models (LM) on the same machine with limited amount of…☆46Updated last month
- ☆53Updated 5 months ago
- Course Project for COMP4471 on RWKV☆16Updated 9 months ago
- Terminal Voice Assistant is a powerful and flexible tool designed to help users interact with their terminal using natural language comma…☆16Updated 5 months ago
- 5X faster 60% less memory QLoRA finetuning☆21Updated 5 months ago
- Yet another frontend for LLM, written using .NET and WinUI 3☆11Updated this week
- Model REVOLVER, a human in the loop model mixing system.☆33Updated last year
- All the world is a play, we are but actors in it.☆47Updated 4 months ago
- QuIP quantization☆46Updated 7 months ago
- Very basic framework for parameterized large language model (Q)LoRa fine-tuning using mlx, mlx_lm, and OgbujiPT. Architecture for system…☆34Updated this week
- ☆18Updated 3 weeks ago
- ☆25Updated last month
- ☆24Updated this week
- LLM inference server implementation based on llama.cpp.☆25Updated this week
- The simplest, fastest repository for training/finetuning medium-sized xLSTMs.☆38Updated 5 months ago
- Tcurtsni: Reverse Instruction Chat, ever wonder what your LLM wants to ask you?☆20Updated 4 months ago
- Easily view and modify JSON datasets for large language models☆62Updated last month
- ☆27Updated last year
- After my server ui improvements were successfully merged, consider this repo a playground for experimenting, tinkering and hacking around…☆56Updated 2 months ago
- ☆17Updated 3 weeks ago
- a set of scripts to easily convert all training data from huggingface into alpaca instruct or sharegpt format, which should allow for eas…☆12Updated 6 months ago
- Parameter-Efficient Sparsity Crafting From Dense to Mixture-of-Experts for Instruction Tuning on General Tasks☆31Updated 5 months ago
- Cortex.Tensorrt-LLM is a C++ inference library that can be loaded by any server at runtime. It submodules NVIDIA’s TensorRT-LLM for GPU a…☆39Updated last month
- ☆104Updated 7 months ago
- Who needs o1 anyways. Add CoT to any OpenAI compatible endpoint.☆39Updated last month
- A python package for serving LLM on OpenAI-compatible API endpoints with prompt caching using MLX.☆53Updated this week