xaedes / llama.cppLinks
Port of Facebook's LLaMA model in C/C++
☆21Updated 2 years ago
Alternatives and similar repositories for llama.cpp
Users that are interested in llama.cpp are comparing it to the libraries listed below
Sorting:
- Parameter-Efficient Sparsity Crafting From Dense to Mixture-of-Experts for Instruction Tuning on General Tasks☆31Updated last year
- Steer LLM outputs towards a certain topic/subject and enhance response capabilities using activation engineering by adding steering vecto…☆44Updated last year
- Simple LLM inference server☆20Updated last year
- BH hackathon☆14Updated last year
- GPT-4 Level Conversational QA Trained In a Few Hours☆65Updated last year
- Trying to deconstruct RWKV in understandable terms☆14Updated 2 years ago
- An open source replication of the stawberry method that leverages Monte Carlo Search with PPO and or DPO☆29Updated last week
- A library for simplifying training with multi gpu setups in the HuggingFace / PyTorch ecosystem.☆16Updated 3 weeks ago
- ☆27Updated 2 years ago
- Zeus LLM Trainer is a rewrite of Stanford Alpaca aiming to be the trainer for all Large Language Models☆70Updated 2 years ago
- Fast approximate inference on a single GPU with sparsity aware offloading☆39Updated 2 years ago
- RWKV-7: Surpassing GPT☆104Updated last year
- ☆63Updated last year
- ☆137Updated last year
- The Benefits of a Concise Chain of Thought on Problem Solving in Large Language Models☆24Updated last year
- [WIP] Transformer to embed Danbooru labelsets☆13Updated last year
- ☆41Updated last year
- Finetune any model on HF in less than 30 seconds☆56Updated last week
- Very minimal (and stateless) agent framework☆44Updated last year
- Experiments with BitNet inference on CPU☆55Updated last year
- Data preparation code for CrystalCoder 7B LLM☆45Updated last year
- Run Vision LLMs, TTS and STT APIs. Website and API for https://text-generator.io☆38Updated 3 weeks ago
- ☆56Updated last year
- Data preparation code for Amber 7B LLM☆94Updated last year
- ☆62Updated 6 months ago
- Rust bindings for CTranslate2☆14Updated 2 years ago
- ☆62Updated 2 years ago
- ☆20Updated 2 years ago
- Demonstration that finetuning RoPE model on larger sequences than the pre-trained model adapts the model context limit☆63Updated 2 years ago
- ☆68Updated last year