broncotc / bitsandbytes-rocmLinks
☆37Updated 2 years ago
Alternatives and similar repositories for bitsandbytes-rocm
Users that are interested in bitsandbytes-rocm are comparing it to the libraries listed below
Sorting:
- Landmark Attention: Random-Access Infinite Context Length for Transformers QLoRA☆123Updated last year
- 8-bit CUDA functions for PyTorch Rocm compatible☆41Updated last year
- 4 bits quantization of LLMs using GPTQ☆49Updated last year
- 8-bit CUDA functions for PyTorch, ported to HIP for use in AMD GPUs☆49Updated 2 years ago
- Oobabooga extension for Bark TTS☆118Updated last year
- ☆158Updated last year
- ChatGPT-like Web UI for RWKVstic☆99Updated 2 years ago
- Framework agnostic python runtime for RWKV models☆146Updated last year
- Efficient 3bit/4bit quantization of LLaMA models☆19Updated 2 years ago
- A prompt/context management system☆170Updated 2 years ago
- A gradio web UI for running Large Language Models like GPT-J 6B, OPT, GALACTICA, LLaMA, and Pygmalion.☆309Updated last year
- An unsupervised model merging algorithm for Transformers-based language models.☆104Updated last year
- Automated prompting and scoring framework to evaluate LLMs using updated human knowledge prompts☆109Updated last year
- A KoboldAI-like memory extension for oobabooga's text-generation-webui☆109Updated 7 months ago
- Just a simple HowTo for https://github.com/johnsmith0031/alpaca_lora_4bit☆30Updated 2 years ago
- Conversational Language model toolkit for training against human preferences.☆42Updated last year
- 4 bits quantization of LLaMA using GPTQ, ported to HIP for use in AMD GPUs.☆32Updated last year
- Falcon LLM ggml framework with CPU and GPU support☆245Updated last year
- A fork of textgen that kept some things like Exllama and old GPTQ.☆22Updated 9 months ago
- Generate Large Language Model text in a container.☆20Updated 2 years ago
- A latent text-to-image diffusion model☆66Updated 2 years ago
- A ready-to-deploy container for implementing an easy to use REST API to access Language Models.☆64Updated 2 years ago
- mikugg is a Frontend for "Generative Visual Novels"☆146Updated this week
- C/C++ implementation of PygmalionAI/pygmalion-6b☆55Updated 2 years ago
- ☆32Updated 2 weeks ago
- ☆40Updated 2 years ago
- DEPRECATED!☆52Updated 11 months ago
- My personal fork of koboldcpp where I hack in experimental samplers.☆46Updated last year
- Text WebUI extension to add clever Notebooks to Chat mode☆139Updated last year
- a fork that installs runs on pytorch cpu-only☆215Updated 2 years ago