Alternatives and similar repositories for bitsandbytes-windows:

Users that are interested in bitsandbytes-windows are comparing it to the libraries listed below

• acpopescu / bitsandbytes
  8-bit CUDA functions for PyTorch
  ☆44Updated last year
• oobabooga / GPTQ-for-LLaMa
  4 bits quantization of LLaMa using GPTQ
  ☆130Updated last year
• jllllll / bitsandbytes-windows-webui
  Windows compile of bitsandbytes for use in text-generation-webui.
  ☆351Updated last year
• DeXtmL / bitsandbytes-win-prebuilt
  ☆75Updated 2 years ago
• Silver267 / pytorch-to-safetensor-converter
  A simple converter which converts pytorch bin files to safetensor, intended to be used for LLM conversion.
  ☆65Updated last year
• hizkifw / WebChatRWKVstic
  ChatGPT-like Web UI for RWKVstic
  ☆100Updated 2 years ago
• resloved / RWKV-notebooks
  📖 — Notebooks related to RWKV
  ☆59Updated last year
• KohakuBlueleaf / guanaco-lora
  Instruct-tune LLaMA on consumer hardware
  ☆74Updated last year
• Gryphe / MergeMonster
  An unsupervised model merging algorithm for Transformers-based language models.
  ☆105Updated 11 months ago
• Blealtan / RWKV-LM-LoRA
  RWKV is a RNN with transformer-level LLM performance. It can be directly trained like a GPT (parallelizable). So it's combining the best …
  ☆414Updated last year
• sdbds / audiocraft-webui
  ☆49Updated last year
• Abel2076 / json2binidx_tool
  ☆82Updated 11 months ago
• chu-tianxiang / vllm-gptq
  A high-throughput and memory-efficient inference and serving engine for LLMs
  ☆131Updated 10 months ago
• iantbutler01 / rwkv-raven-qlora-4bit-instruct
  A finetuning pipeline for instruct tuning Raven 14bn using QLORA 4bit and the Ditty finetuning library
  ☆28Updated 10 months ago
• harrisonvanderbyl / rwkv_chatbot
  rwkv_chatbot
  ☆62Updated 2 years ago
• jllllll / exllama
  A more memory-efficient rewrite of the HF transformers implementation of Llama for use with quantized weights.
  ☆64Updated last year
• neromous / RWKV-Ouroboros
  This project is established for real-time training of the RWKV model.
  ☆49Updated 11 months ago
• minemo / text-generation-webui-barktts
  A simple extension that uses Bark Text-to-Speech for audio output
  ☆35Updated last year
• harrisonvanderbyl / rwkvstic
  Framework agnostic python runtime for RWKV models
  ☆146Updated last year
• gururise / rwkv_gradio
  Gradio UI for RWKV LLM
  ☆29Updated 2 years ago
• CoffeeVampir3 / ez-trainer
  Train Llama Loras Easily
  ☆31Updated last year
• Dhaladom / TALIS
  Simple and fast server for GPTQ-quantized LLaMA inference
  ☆24Updated last year
• theubie / complex_memory
  A KoboldAI-like memory extension for oobabooga's text-generation-webui
  ☆108Updated 5 months ago
• jondurbin / qlora
  QLoRA: Efficient Finetuning of Quantized LLMs
  ☆78Updated last year
• jllllll / GPTQ-for-LLaMa-Wheels
  Precompiled Wheels for GPTQ-for-LLaMa
  ☆18Updated last year
• clcarwin / alpaca-weight
  Train llama with lora on one 4090 and merge weight of lora to work as stanford alpaca.
  ☆51Updated last year
• TheBloke / AutoGPTQ
  An easy-to-use LLMs quantization package with user-friendly apis, based on GPTQ algorithm.
  ☆37Updated last year
• UranusSeven / llama_generative_agent
  A generative agent implementation for LLaMA based models, derived from langchain's implementation.
  ☆177Updated last year
• kyegomez / Finetuning-Suite
  Finetune any model on HF in less than 30 seconds
  ☆58Updated 2 weeks ago
• cryscan / eloise
  A QQ Chatbot based on RWKV (W.I.P.)
  ☆80Updated last year