Alternatives and similar repositories for bitsandbytes-windows

Users that are interested in bitsandbytes-windows are comparing it to the libraries listed below

• oobabooga / GPTQ-for-LLaMa
  4 bits quantization of LLaMa using GPTQ
  ☆129Updated 2 years ago
• acpopescu / bitsandbytes
  8-bit CUDA functions for PyTorch
  ☆44Updated 2 years ago
• jllllll / bitsandbytes-windows-webui
  Windows compile of bitsandbytes for use in text-generation-webui.
  ☆355Updated last year
• KohakuBlueleaf / guanaco-lora
  Instruct-tune LLaMA on consumer hardware
  ☆74Updated 2 years ago
• Blealtan / RWKV-LM-LoRA
  RWKV is a RNN with transformer-level LLM performance. It can be directly trained like a GPT (parallelizable). So it's combining the best …
  ☆412Updated 2 years ago
• Abel2076 / json2binidx_tool
  ☆82Updated last year
• Silver267 / pytorch-to-safetensor-converter
  A simple converter which converts pytorch bin files to safetensor, intended to be used for LLM conversion.
  ☆69Updated last year
• hizkifw / WebChatRWKVstic
  ChatGPT-like Web UI for RWKVstic
  ☆100Updated 2 years ago
• recursal / ai-town-rwkv-proxy
  Run a large AI town, locally, via RWKV !
  ☆156Updated last year
• Gryphe / MergeMonster
  An unsupervised model merging algorithm for Transformers-based language models.
  ☆105Updated last year
• DeXtmL / bitsandbytes-win-prebuilt
  ☆75Updated 2 years ago
• johnsmith0031 / alpaca_lora_4bit
  ☆535Updated last year
• jllllll / llama-cpp-python-cuBLAS-wheels
  Wheels for llama-cpp-python compiled with cuBLAS support
  ☆97Updated last year
• neromous / RWKV-Ouroboros
  This project is established for real-time training of the RWKV model.
  ☆49Updated last year
• georgesung / llm_qlora
  Fine-tuning LLMs using QLoRA
  ☆258Updated last year
• wawawario2 / long_term_memory
  A gradio web UI for running Large Language Models like GPT-J 6B, OPT, GALACTICA, LLaMA, and Pygmalion.
  ☆309Updated last year
• 0cc4m / GPTQ-for-LLaMa
  4 bits quantization of LLMs using GPTQ
  ☆49Updated last year
• camenduru / Qwen-VL-Chat-colab
  ☆82Updated last year
• chrisociepa / allamo
  Simple, hackable and fast implementation for training/finetuning medium-sized LLaMA-based models
  ☆176Updated last week
• iantbutler01 / rwkv-raven-qlora-4bit-instruct
  A finetuning pipeline for instruct tuning Raven 14bn using QLORA 4bit and the Ditty finetuning library
  ☆28Updated last year
• UranusSeven / llama_generative_agent
  A generative agent implementation for LLaMA based models, derived from langchain's implementation.
  ☆176Updated last year
• jondurbin / qlora
  QLoRA: Efficient Finetuning of Quantized LLMs
  ☆78Updated last year
• Gryphe / BlockMerge_Gradient
  Merge Transformers language models by use of gradient parameters.
  ☆206Updated 11 months ago
• eugenepentland / landmark-attention-qlora
  Landmark Attention: Random-Access Infinite Context Length for Transformers QLoRA
  ☆123Updated 2 years ago
• ChuloAI / BrainChulo
  Harnessing the Memory Power of the Camelids
  ☆146Updated last year
• teknium1 / alpaca-roleplay-discordbot
  A discord bot that roleplays!
  ☆149Updated last year
• chu-tianxiang / vllm-gptq
  A high-throughput and memory-efficient inference and serving engine for LLMs
  ☆131Updated last year
• thomasantony / llamacpp-python
  Python bindings for llama.cpp
  ☆197Updated 2 years ago
• harrisonvanderbyl / rwkvstic
  Framework agnostic python runtime for RWKV models
  ☆147Updated last year
• FartyPants / Playground
  Text WebUI extension to add clever Notebooks to Chat mode
  ☆141Updated last month