Alternatives and similar repositories for bitsandbytes-windows

Users that are interested in bitsandbytes-windows are comparing it to the libraries listed below

• oobabooga / GPTQ-for-LLaMa
  4 bits quantization of LLaMa using GPTQ
  ☆130Updated 2 years ago
• jllllll / bitsandbytes-windows-webui
  Windows compile of bitsandbytes for use in text-generation-webui.
  ☆357Updated last year
• acpopescu / bitsandbytes
  8-bit CUDA functions for PyTorch
  ☆44Updated 2 years ago
• KohakuBlueleaf / guanaco-lora
  Instruct-tune LLaMA on consumer hardware
  ☆73Updated 2 years ago
• Abel2076 / json2binidx_tool
  ☆82Updated last year
• neromous / RWKV-Ouroboros
  This project is established for real-time training of the RWKV model.
  ☆50Updated last year
• jllllll / llama-cpp-python-cuBLAS-wheels
  Wheels for llama-cpp-python compiled with cuBLAS support
  ☆97Updated last year
• DeXtmL / bitsandbytes-win-prebuilt
  ☆75Updated 2 years ago
• Blealtan / RWKV-LM-LoRA
  RWKV is a RNN with transformer-level LLM performance. It can be directly trained like a GPT (parallelizable). So it's combining the best …
  ☆413Updated 2 years ago
• hizkifw / WebChatRWKVstic
  ChatGPT-like Web UI for RWKVstic
  ☆100Updated 2 years ago
• Gryphe / MergeMonster
  An unsupervised model merging algorithm for Transformers-based language models.
  ☆106Updated last year
• RWKV / RWKV-infctx-trainer
  RWKV infctx trainer, for training arbitary context sizes, to 10k and beyond!
  ☆148Updated 11 months ago
• FartyPants / Playground
  Text WebUI extension to add clever Notebooks to Chat mode
  ☆141Updated last month
• Silver267 / pytorch-to-safetensor-converter
  A simple converter which converts pytorch bin files to safetensor, intended to be used for LLM conversion.
  ☆71Updated last year
• recursal / ai-town-rwkv-proxy
  Run a large AI town, locally, via RWKV !
  ☆156Updated last year
• iantbutler01 / rwkv-raven-qlora-4bit-instruct
  A finetuning pipeline for instruct tuning Raven 14bn using QLORA 4bit and the Ditty finetuning library
  ☆28Updated last year
• minemo / text-generation-webui-barktts
  A simple extension that uses Bark Text-to-Speech for audio output
  ☆33Updated last year
• resloved / RWKV-notebooks
  📖 — Notebooks related to RWKV
  ☆59Updated 2 years ago
• theubie / complex_memory
  A KoboldAI-like memory extension for oobabooga's text-generation-webui
  ☆108Updated 9 months ago
• camenduru / Qwen-VL-Chat-colab
  ☆82Updated last year
• jllllll / exllama
  A more memory-efficient rewrite of the HF transformers implementation of Llama for use with quantized weights.
  ☆64Updated last year
• harrisonvanderbyl / rwkvstic
  Framework agnostic python runtime for RWKV models
  ☆146Updated last year
• UranusSeven / llama_generative_agent
  A generative agent implementation for LLaMA based models, derived from langchain's implementation.
  ☆176Updated last year
• iwalton3 / mpt-lora-patch
  Patch for MPT-7B which allows using and training a LoRA
  ☆58Updated 2 years ago
• SynthiaDL / TrainChatGalRWKV
  ☆43Updated last year
• modular-ml / wrapyfi-examples_llama
  Inference code for facebook LLaMA models with Wrapyfi support
  ☆129Updated 2 years ago
• 0cc4m / GPTQ-for-LLaMa
  4 bits quantization of LLMs using GPTQ
  ☆49Updated 2 years ago
• TheBloke / AutoGPTQ
  An easy-to-use LLMs quantization package with user-friendly apis, based on GPTQ algorithm.
  ☆38Updated last year
• eugenepentland / landmark-attention-qlora
  Landmark Attention: Random-Access Infinite Context Length for Transformers QLoRA
  ☆123Updated 2 years ago
• ElliottDyson / OSGA
  Open-Source Generative Agents is a community-driven fork of 'Generative Agents,' aimed at enabling compatibility with open-source Large L…
  ☆60Updated last year