Alternatives and similar repositories for bitsandbytes-windows

Users that are interested in bitsandbytes-windows are comparing it to the libraries listed below

• acpopescu / bitsandbytes
  8-bit CUDA functions for PyTorch
  ☆42Updated 2 years ago
• oobabooga / GPTQ-for-LLaMa
  4 bits quantization of LLaMa using GPTQ
  ☆131Updated 2 years ago
• jllllll / bitsandbytes-windows-webui
  Windows compile of bitsandbytes for use in text-generation-webui.
  ☆361Updated 2 years ago
• Abel2076 / json2binidx_tool
  ☆81Updated last year
• Silver267 / pytorch-to-safetensor-converter
  A simple converter which converts pytorch bin files to safetensor, intended to be used for LLM conversion.
  ☆72Updated last year
• Blealtan / RWKV-LM-LoRA
  RWKV is a RNN with transformer-level LLM performance. It can be directly trained like a GPT (parallelizable). So it's combining the best …
  ☆412Updated 2 years ago
• recursal / ai-town-rwkv-proxy
  Run a large AI town, locally, via RWKV !
  ☆154Updated 2 years ago
• DeXtmL / bitsandbytes-win-prebuilt
  ☆75Updated 3 years ago
• hizkifw / WebChatRWKVstic
  ChatGPT-like Web UI for RWKVstic
  ☆100Updated 2 years ago
• neromous / RWKV-Ouroboros
  This project is established for real-time training of the RWKV model.
  ☆50Updated last year
• KohakuBlueleaf / guanaco-lora
  Instruct-tune LLaMA on consumer hardware
  ☆72Updated 2 years ago
• resloved / RWKV-notebooks
  📖 — Notebooks related to RWKV
  ☆58Updated 2 years ago
• Gryphe / MergeMonster
  An unsupervised model merging algorithm for Transformers-based language models.
  ☆108Updated last year
• johnsmith0031 / alpaca_lora_4bit
  ☆535Updated 2 years ago
• jllllll / llama-cpp-python-cuBLAS-wheels
  Wheels for llama-cpp-python compiled with cuBLAS support
  ☆99Updated last year
• UranusSeven / llama_generative_agent
  A generative agent implementation for LLaMA based models, derived from langchain's implementation.
  ☆178Updated 2 years ago
• chu-tianxiang / vllm-gptq
  A high-throughput and memory-efficient inference and serving engine for LLMs
  ☆132Updated last year
• RWKV / RWKV-infctx-trainer
  RWKV infctx trainer, for training arbitary context sizes, to 10k and beyond!
  ☆147Updated last year
• iantbutler01 / rwkv-raven-qlora-4bit-instruct
  A finetuning pipeline for instruct tuning Raven 14bn using QLORA 4bit and the Ditty finetuning library
  ☆28Updated last year
• TheBloke / AutoGPTQ
  An easy-to-use LLMs quantization package with user-friendly apis, based on GPTQ algorithm.
  ☆38Updated 2 years ago
• clcarwin / alpaca-weight
  Train llama with lora on one 4090 and merge weight of lora to work as stanford alpaca.
  ☆52Updated 2 years ago
• wannaphong / ttsmms
  TTS with The Massively Multilingual Speech (MMS) project
  ☆231Updated last year
• gururise / rwkv_gradio
  Gradio UI for RWKV LLM
  ☆29Updated 2 years ago
• minemo / text-generation-webui-barktts
  A simple extension that uses Bark Text-to-Speech for audio output
  ☆33Updated 2 years ago
• camenduru / Qwen-VL-Chat-colab
  ☆82Updated 2 years ago
• ElliottDyson / OSGA
  Open-Source Generative Agents is a community-driven fork of 'Generative Agents,' aimed at enabling compatibility with open-source Large L…
  ☆61Updated last year
• wawawario2 / long_term_memory
  A gradio web UI for running Large Language Models like GPT-J 6B, OPT, GALACTICA, LLaMA, and Pygmalion.
  ☆309Updated 2 years ago
• jllllll / exllama
  A more memory-efficient rewrite of the HF transformers implementation of Llama for use with quantized weights.
  ☆64Updated 2 years ago
• WeberJulian / AI-voice-chat
  ☆175Updated 2 years ago
• harrisonvanderbyl / rwkvstic
  Framework agnostic python runtime for RWKV models
  ☆147Updated 2 years ago