Alternatives and similar repositories for bitsandbytes-windows

Users that are interested in bitsandbytes-windows are comparing it to the libraries listed below

• oobabooga / GPTQ-for-LLaMa
  4 bits quantization of LLaMa using GPTQ
  ☆130Updated 2 years ago
• jllllll / bitsandbytes-windows-webui
  Windows compile of bitsandbytes for use in text-generation-webui.
  ☆359Updated last year
• KohakuBlueleaf / guanaco-lora
  Instruct-tune LLaMA on consumer hardware
  ☆73Updated 2 years ago
• acpopescu / bitsandbytes
  8-bit CUDA functions for PyTorch
  ☆43Updated 2 years ago
• Silver267 / pytorch-to-safetensor-converter
  A simple converter which converts pytorch bin files to safetensor, intended to be used for LLM conversion.
  ☆71Updated last year
• Gryphe / MergeMonster
  An unsupervised model merging algorithm for Transformers-based language models.
  ☆107Updated last year
• Blealtan / RWKV-LM-LoRA
  RWKV is a RNN with transformer-level LLM performance. It can be directly trained like a GPT (parallelizable). So it's combining the best …
  ☆413Updated 2 years ago
• DeXtmL / bitsandbytes-win-prebuilt
  ☆75Updated 2 years ago
• recursal / ai-town-rwkv-proxy
  Run a large AI town, locally, via RWKV !
  ☆155Updated last year
• jllllll / llama-cpp-python-cuBLAS-wheels
  Wheels for llama-cpp-python compiled with cuBLAS support
  ☆98Updated last year
• ChuloAI / BrainChulo
  Harnessing the Memory Power of the Camelids
  ☆146Updated last year
• BillSchumacher / Auto-GPT
  An experimental open-source attempt to make GPT-4 fully autonomous.
  ☆98Updated 2 years ago
• neromous / RWKV-Ouroboros
  This project is established for real-time training of the RWKV model.
  ☆50Updated last year
• ElliottDyson / OSGA
  Open-Source Generative Agents is a community-driven fork of 'Generative Agents,' aimed at enabling compatibility with open-source Large L…
  ☆61Updated last year
• iantbutler01 / rwkv-raven-qlora-4bit-instruct
  A finetuning pipeline for instruct tuning Raven 14bn using QLORA 4bit and the Ditty finetuning library
  ☆29Updated last year
• johnsmith0031 / alpaca_lora_4bit
  ☆535Updated last year
• camenduru / Qwen-VL-Chat-colab
  ☆82Updated last year
• Abel2076 / json2binidx_tool
  ☆81Updated last year
• minemo / text-generation-webui-barktts
  A simple extension that uses Bark Text-to-Speech for audio output
  ☆33Updated last year
• chu-tianxiang / vllm-gptq
  A high-throughput and memory-efficient inference and serving engine for LLMs
  ☆132Updated last year
• jllllll / exllama
  A more memory-efficient rewrite of the HF transformers implementation of Llama for use with quantized weights.
  ☆64Updated last year
• WeberJulian / AI-voice-chat
  ☆175Updated last year
• kanttouchthis / text_generation_webui_xtts
  XTTSv2 Extension for oobabooga text-generation-webui
  ☆155Updated last year
• SaturnCassini / gpt4all_generative_agents
  Generative Agents: Interactive Simulacra of Human Behavior using GPT4All free model which runs on CPU
  ☆113Updated 2 years ago
• theubie / complex_memory
  A KoboldAI-like memory extension for oobabooga's text-generation-webui
  ☆108Updated 10 months ago
• kaiokendev / superbig
  A prompt/context management system
  ☆170Updated 2 years ago
• Gryphe / BlockMerge_Gradient
  Merge Transformers language models by use of gradient parameters.
  ☆208Updated last year
• TheBloke / AutoGPTQ
  An easy-to-use LLMs quantization package with user-friendly apis, based on GPTQ algorithm.
  ☆37Updated last year
• jondurbin / qlora
  QLoRA: Efficient Finetuning of Quantized LLMs
  ☆78Updated last year
• wsippel / bark_tts
  Oobabooga extension for Bark TTS
  ☆118Updated last year