KohakuBlueleaf / guanaco-lora

Related projects ⓘ

Alternatives and complementary repositories for guanaco-lora

• Gryphe / MergeMonster
  An unsupervised model merging algorithm for Transformers-based language models.
  ☆99Updated 6 months ago
• oobabooga / GPTQ-for-LLaMa
  4 bits quantization of LLaMa using GPTQ
  ☆130Updated last year
• jondurbin / qlora
  QLoRA: Efficient Finetuning of Quantized LLMs
  ☆77Updated 6 months ago
• clcarwin / alpaca-weight
  Train llama with lora on one 4090 and merge weight of lora to work as stanford alpaca.
  ☆50Updated last year
• kaiokendev / cutoff-len-is-context-len
  Demonstration that finetuning RoPE model on larger sequences than the pre-trained model adapts the model context limit
  ☆63Updated last year
• mayank31398 / GPTQ-for-SantaCoder
  4 bits quantization of SantaCoder using GPTQ
  ☆53Updated last year
• Keith-Hon / bitsandbytes-windows
  8-bit CUDA functions for PyTorch in Windows 10
  ☆71Updated last year
• acpopescu / bitsandbytes
  8-bit CUDA functions for PyTorch
  ☆45Updated last year
• hizkifw / WebChatRWKVstic
  ChatGPT-like Web UI for RWKVstic
  ☆100Updated last year
• TehVenomm / LM_Transformers_BlockMerge
  Image Diffusion block merging technique applied to transformers based Language Models.
  ☆54Updated last year
• harubaru / convogpt
  Conversational Language model toolkit for training against human preferences.
  ☆40Updated 7 months ago
• Durham / RWKV-finetune-script
  Script and instruction how to fine-tune large RWKV model on your data for Alpaca dataset
  ☆31Updated last year
• BBuf / RWKV-World-HF-Tokenizer
  ☆33Updated 3 months ago
• mrsteyk / RWKV-LM-deepspeed
  ☆42Updated last year
• zarakiquemparte / zaraki-tools
  ☆27Updated last year
• neromous / RWKV-Ouroboros
  This project is established for real-time training of the RWKV model.
  ☆50Updated 5 months ago
• zsc / llama_infer
  Inference script for Meta's LLaMA models using Hugging Face wrapper
  ☆111Updated last year
• CoffeeVampir3 / ez-trainer
  Train Llama Loras Easily
  ☆29Updated last year
• resloved / RWKV-notebooks
  📖 — Notebooks related to RWKV
  ☆59Updated last year
• camenduru / Qwen-VL-Chat-colab
  ☆79Updated 11 months ago
• chu-tianxiang / vllm-gptq
  A high-throughput and memory-efficient inference and serving engine for LLMs
  ☆129Updated 4 months ago
• rmihaylov / mpttune
  Tune MPTs
  ☆84Updated last year
• qwopqwop200 / gptqlora
  GPTQLoRA: Efficient Finetuning of Quantized LLMs with GPTQ
  ☆96Updated last year
• RWKV / RWKV-infctx-trainer
  RWKV infctx trainer, for training arbitary context sizes, to 10k and beyond!
  ☆133Updated 2 months ago
• eugenepentland / landmark-attention-qlora
  Landmark Attention: Random-Access Infinite Context Length for Transformers QLoRA
  ☆124Updated last year
• tdrussell / qlora-pipe
  A pipeline parallel training script for LLMs.
  ☆83Updated 3 weeks ago
• kyegomez / Finetuning-Suite
  Finetune any model on HF in less than 30 seconds
  ☆56Updated this week
• harrisonvanderbyl / rwkvstic
  Framework agnostic python runtime for RWKV models
  ☆145Updated last year
• the-crypt-keeper / the-muse
  Experimental sampler to make LLMs more creative
  ☆30Updated last year