Alternatives and similar repositories for bitsandbytes-windows

Users that are interested in bitsandbytes-windows are comparing it to the libraries listed below

• oobabooga / GPTQ-for-LLaMa
  4 bits quantization of LLaMa using GPTQ
  ☆130Updated 2 years ago
• acpopescu / bitsandbytes
  8-bit CUDA functions for PyTorch
  ☆42Updated 2 years ago
• jllllll / bitsandbytes-windows-webui
  Windows compile of bitsandbytes for use in text-generation-webui.
  ☆360Updated 2 years ago
• jllllll / llama-cpp-python-cuBLAS-wheels
  Wheels for llama-cpp-python compiled with cuBLAS support
  ☆97Updated last year
• KohakuBlueleaf / guanaco-lora
  Instruct-tune LLaMA on consumer hardware
  ☆72Updated 2 years ago
• DeXtmL / bitsandbytes-win-prebuilt
  ☆74Updated 3 years ago
• recursal / ai-town-rwkv-proxy
  Run a large AI town, locally, via RWKV !
  ☆153Updated last year
• ChuloAI / BrainChulo
  Harnessing the Memory Power of the Camelids
  ☆147Updated 2 years ago
• TheBloke / AutoGPTQ
  An easy-to-use LLMs quantization package with user-friendly apis, based on GPTQ algorithm.
  ☆38Updated 2 years ago
• Blealtan / RWKV-LM-LoRA
  RWKV is a RNN with transformer-level LLM performance. It can be directly trained like a GPT (parallelizable). So it's combining the best …
  ☆412Updated 2 years ago
• minemo / text-generation-webui-barktts
  A simple extension that uses Bark Text-to-Speech for audio output
  ☆33Updated 2 years ago
• theubie / complex_memory
  A KoboldAI-like memory extension for oobabooga's text-generation-webui
  ☆108Updated last year
• Silver267 / pytorch-to-safetensor-converter
  A simple converter which converts pytorch bin files to safetensor, intended to be used for LLM conversion.
  ☆72Updated last year
• Gryphe / MergeMonster
  An unsupervised model merging algorithm for Transformers-based language models.
  ☆108Updated last year
• wsippel / bark_tts
  Oobabooga extension for Bark TTS
  ☆119Updated 2 years ago
• UranusSeven / llama_generative_agent
  A generative agent implementation for LLaMA based models, derived from langchain's implementation.
  ☆178Updated 2 years ago
• hizkifw / WebChatRWKVstic
  ChatGPT-like Web UI for RWKVstic
  ☆100Updated 2 years ago
• camenduru / Qwen-VL-Chat-colab
  ☆80Updated last year
• BillSchumacher / Auto-GPT
  An experimental open-source attempt to make GPT-4 fully autonomous.
  ☆98Updated 2 years ago
• Abel2076 / json2binidx_tool
  ☆81Updated last year
• neromous / RWKV-Ouroboros
  This project is established for real-time training of the RWKV model.
  ☆49Updated last year
• dibrale / webui_autonomics
  Dynamic parameter modulation for oobabooga's text-generation-webui that adjusts generation parameters to better mirror user affect.
  ☆34Updated 2 years ago
• ThereforeGames / echoproof
  Simple extension for text-generation-webui that injects recent conversation history into the negative prompt with the goal of minimizing …
  ☆31Updated 2 years ago
• kaiokendev / superbig
  A prompt/context management system
  ☆171Updated 2 years ago
• jllllll / exllama
  A more memory-efficient rewrite of the HF transformers implementation of Llama for use with quantized weights.
  ☆63Updated 2 years ago
• GiusTex / EdgeGPT
  Extension for Text Generation Webui based on EdgeGPT, a reverse engineered API of Microsoft's Bing Chat AI
  ☆124Updated 2 years ago
• harrisonvanderbyl / rwkvstic
  Framework agnostic python runtime for RWKV models
  ☆147Updated 2 years ago
• iantbutler01 / rwkv-raven-qlora-4bit-instruct
  A finetuning pipeline for instruct tuning Raven 14bn using QLORA 4bit and the Ditty finetuning library
  ☆28Updated last year
• wawawario2 / long_term_memory
  A gradio web UI for running Large Language Models like GPT-J 6B, OPT, GALACTICA, LLaMA, and Pygmalion.
  ☆308Updated 2 years ago
• kanttouchthis / text_generation_webui_xtts
  XTTSv2 Extension for oobabooga text-generation-webui
  ☆154Updated 2 years ago