Alternatives and similar repositories for guanaco-lora:

Users that are interested in guanaco-lora are comparing it to the libraries listed below

• jondurbin / qlora
  QLoRA: Efficient Finetuning of Quantized LLMs
  ☆77Updated 9 months ago
• oobabooga / GPTQ-for-LLaMa
  4 bits quantization of LLaMa using GPTQ
  ☆131Updated last year
• resloved / RWKV-notebooks
  📖 — Notebooks related to RWKV
  ☆59Updated last year
• clcarwin / alpaca-weight
  Train llama with lora on one 4090 and merge weight of lora to work as stanford alpaca.
  ☆50Updated last year
• mrsteyk / RWKV-LM-deepspeed
  ☆42Updated last year
• iantbutler01 / rwkv-raven-qlora-4bit-instruct
  A finetuning pipeline for instruct tuning Raven 14bn using QLORA 4bit and the Ditty finetuning library
  ☆28Updated 7 months ago
• ArEnSc / Production-RWKV
  This project aims to make RWKV Accessible to everyone using a Hugging Face like interface, while keeping it close to the R and D RWKV bra…
  ☆64Updated last year
• hizkifw / WebChatRWKVstic
  ChatGPT-like Web UI for RWKVstic
  ☆100Updated last year
• Keith-Hon / bitsandbytes-windows
  8-bit CUDA functions for PyTorch in Windows 10
  ☆69Updated last year
• RWKV / RWKV-infctx-trainer
  RWKV infctx trainer, for training arbitary context sizes, to 10k and beyond!
  ☆141Updated 5 months ago
• acpopescu / bitsandbytes
  8-bit CUDA functions for PyTorch
  ☆44Updated last year
• zsc / llama_infer
  Inference script for Meta's LLaMA models using Hugging Face wrapper
  ☆111Updated last year
• aspctu / alpaca-lora
  Instruct-tuning LLaMA on consumer hardware
  ☆66Updated last year
• eugenepentland / landmark-attention-qlora
  Landmark Attention: Random-Access Infinite Context Length for Transformers QLoRA
  ☆123Updated last year
• Durham / RWKV-finetune-script
  Script and instruction how to fine-tune large RWKV model on your data for Alpaca dataset
  ☆31Updated last year
• cedrickchee / llama
  Inference code for LLaMA 2 models
  ☆31Updated 6 months ago
• neromous / RWKV-Ouroboros
  This project is established for real-time training of the RWKV model.
  ☆49Updated 8 months ago
• rmihaylov / mpttune
  Tune MPTs
  ☆84Updated last year
• tpoisonooo / kimi-chat-testdata
  kimi-chat 测试数据
  ☆7Updated last year
• Abel2076 / json2binidx_tool
  ☆81Updated 8 months ago
• zphang / transformers
  Code and models for BERT on STILTs
  ☆53Updated last year
• kaiokendev / cutoff-len-is-context-len
  Demonstration that finetuning RoPE model on larger sequences than the pre-trained model adapts the model context limit
  ☆63Updated last year
• harrisonvanderbyl / rwkvstic
  Framework agnostic python runtime for RWKV models
  ☆145Updated last year
• NolanoOrg / llama-int4-quant
  ☆26Updated last year
• BBuf / RWKV-World-HF-Tokenizer
  ☆33Updated 6 months ago
• chu-tianxiang / vllm-gptq
  A high-throughput and memory-efficient inference and serving engine for LLMs
  ☆130Updated 7 months ago
• RWKV-Wiki / MultilingualShareGPT
  MultilingualShareGPT, the free multi-language corpus for LLM training
  ☆73Updated last year
• liutiedong / goat
  a Fine-tuned LLaMA that is Good at Arithmetic Tasks
  ☆177Updated last year
• Guanaco-Model / Guanaco-Model.github.io
  ☆122Updated last year
• LAION-AI / riverbed
  Tools for content datamining and NLP at scale
  ☆42Updated 7 months ago