KohakuBlueleaf / guanaco-lora
Instruct-tune LLaMA on consumer hardware
โ73Updated last year
Alternatives and similar repositories for guanaco-lora:
Users that are interested in guanaco-lora are comparing it to the libraries listed below
- Train llama with lora on one 4090 and merge weight of lora to work as stanford alpaca.โ50Updated last year
- QLoRA: Efficient Finetuning of Quantized LLMsโ77Updated 11 months ago
- ๐ โ Notebooks related to RWKVโ59Updated last year
- 4 bits quantization of SantaCoder using GPTQโ51Updated last year
- Image Diffusion block merging technique applied to transformers based Language Models.โ54Updated last year
- A finetuning pipeline for instruct tuning Raven 14bn using QLORA 4bit and the Ditty finetuning libraryโ28Updated 9 months ago
- Load multiple LoRA modules simultaneously and automatically switch the appropriate combination of LoRA modules to generate the best answeโฆโ150Updated last year
- SparseGPT + GPTQ Compression of LLMs like LLaMa, OPT, Pythiaโ41Updated 2 years ago
- Demonstration that finetuning RoPE model on larger sequences than the pre-trained model adapts the model context limitโ63Updated last year
- 8-bit CUDA functions for PyTorch in Windows 10โ68Updated last year
- An unsupervised model merging algorithm for Transformers-based language models.โ106Updated 10 months ago
- ChatGPT-like Web UI for RWKVsticโ100Updated last year
- This is a text generation method which returns a generator, streaming out each token in real-time during inference, based on Huggingface/โฆโ95Updated last year
- โ42Updated last year
- A high-throughput and memory-efficient inference and serving engine for LLMsโ130Updated 8 months ago
- This project is established for real-time training of the RWKV model.โ49Updated 10 months ago
- 4 bits quantization of LLaMa using GPTQโ130Updated last year
- MultilingualShareGPT, the free multi-language corpus for LLM trainingโ73Updated last year
- โ53Updated 2 years ago
- 8-bit CUDA functions for PyTorchโ44Updated last year
- Code and models for BERT on STILTsโ53Updated 2 years ago
- Zeus LLM Trainer is a rewrite of Stanford Alpaca aiming to be the trainer for all Large Language Modelsโ69Updated last year
- โ83Updated last year
- kimi-chat ๆต่ฏๆฐๆฎโ7Updated last year
- โ82Updated 10 months ago
- zero้ถ่ฎญ็ปllm่ฐๅโ31Updated last year
- FuseAI Projectโ84Updated last month
- โ27Updated last year
- Train Llama Loras Easilyโ31Updated last year
- Inference script for Meta's LLaMA models using Hugging Face wrapperโ110Updated last year