Fine-tuning LLMs using QLoRA
☆268Jun 21, 2026Updated 3 months ago
Alternatives and similar repositories for llm_qlora
Users that are interested in llm_qlora are comparing it to the libraries listed below. We may earn a commission when you buy through links labeled 'Ad' on this page.
Sorting:
- ☆15Oct 24, 2023Updated 2 years ago
- A library for simplifying training with multi gpu setups in the HuggingFace / PyTorch ecosystem.☆16Jun 10, 2026Updated 4 months ago
- ☆165Jun 1, 2023Updated 3 years ago
- Experimental sampler to make LLMs more creative☆31Aug 2, 2023Updated 3 years ago
- A working example of a 4bit QLoRA Falcon model using huggingface☆11Sep 16, 2023Updated 3 years ago
- Managed Kubernetes at scale on DigitalOcean • AdDigitalOcean Kubernetes includes the control plane, bandwidth allowance, container registry, automatic updates, and more for free.
- Examples for using the SiLLM framework for training and running Large Language Models (LLMs) on Apple Silicon☆16May 8, 2025Updated last year
- A pytest plugin to organize and track algorithm visualizations☆18Dec 1, 2024Updated last year
- Python bindings for the Transformer models implemented in C/C++ using GGML library.☆1,886Jan 28, 2024Updated 2 years ago
- A workbench application to test out different prompts on a variety of AI models to see how they perform☆15Feb 9, 2025Updated last year
- ☆13May 25, 2023Updated 3 years ago
- Customizable implementation of the self-instruct paper.☆1,053Mar 7, 2024Updated 2 years ago
- QLoRA: Efficient Finetuning of Quantized LLMs☆11,045Jun 10, 2024Updated 2 years ago
- A bagel, with everything.☆327Apr 11, 2024Updated 2 years ago
- ☆25Jan 28, 2026Updated 8 months ago
- Managed Database hosting by DigitalOcean • AdPostgreSQL, MySQL, MongoDB, Kafka, Valkey, and OpenSearch available. Automatically scale up storage and focus on building your apps.
- A prompt/context management system☆168May 8, 2023Updated 3 years ago
- SAIL: Search Augmented Instruction Learning☆159Jul 22, 2025Updated last year
- QLoRA: Efficient Finetuning of Quantized LLMs☆11Jul 22, 2023Updated 3 years ago
- Fast approximate inference on a single GPU with sparsity aware offloading☆38Jan 4, 2024Updated 2 years ago
- ☆52Feb 8, 2026Updated 8 months ago
- 5X faster 60% less memory QLoRA finetuning☆21May 28, 2024Updated 2 years ago
- Go ahead and axolotl questions☆12,590Updated this week
- This is our own implementation of 'Layer Selective Rank Reduction'☆240Sep 29, 2026Updated 2 weeks ago
- ☆11Nov 7, 2025Updated 11 months ago
- Simple, predictable pricing with DigitalOcean hosting • AdAlways know what you'll pay with monthly caps and flat pricing. Enterprise-grade infrastructure trusted by 600k+ customers.
- Train Llama Loras Easily☆30Aug 3, 2023Updated 3 years ago
- A macOS version of the oobabooga gradio web UI for running Large Language Models like LLaMA, llama.cpp, GPT-J, Pythia, OPT, and GALACTICA…☆25Oct 6, 2026Updated last week
- Finetune Falcon, LLaMA, MPT, and RedPajama on consumer hardware using PEFT LoRA☆106Sep 19, 2026Updated 3 weeks ago
- Beautiful photo gallery for the web in one Unix command line. Generates static html and javscript files.☆13Apr 4, 2013Updated 13 years ago
- 使用peft库，对chatGLM-6B/chatGLM2-6B实现4bit的QLoRA高效微调，并做lora model和base model的merge及4bit的量化（quantize）。☆356Aug 22, 2023Updated 3 years ago
- Radiantloom Email Assist 7B is an email-assistant large language model fine-tuned from Zephyr-7B-Beta, over a custom-curated dataset of 1…☆14Jan 19, 2024Updated 2 years ago
- pip install poai☆14Mar 2, 2026Updated 7 months ago
- A more memory-efficient rewrite of the HF transformers implementation of Llama for use with quantized weights.☆2,943Sep 30, 2023Updated 3 years ago
- Low-Rank adapter extraction for fine-tuned transformers models☆181May 2, 2024Updated 2 years ago
- Wordpress hosting with auto-scaling - Free Trial Offer • AdFully Managed hosting for WordPress and WooCommerce businesses that need reliable, auto-scalable performance. Cloudways SafeUpdates now available.
- A local version of WebSim.AI, the prompt to webpage engine. Infinite possibilities to cure your boredom. ( I made it so you dont have to…☆57Jul 19, 2024Updated 2 years ago
- Training LLMs with QLoRA + FSDP☆1,552Nov 9, 2024Updated last year
- Official repo for the paper PHUDGE: Phi-3 as Scalable Judge. Evaluate your LLMs with or without custom rubric, reference answer, absolute…☆53Jul 10, 2024Updated 2 years ago
- TTS Client for Coqui TTS server☆13Jan 7, 2023Updated 3 years ago
- Explore a simple example of utilizing MLX for RAG application running locally on your Apple Silicon device.☆180Jan 31, 2024Updated 2 years ago
- Train Embedding Models on MLX.☆17Jun 2, 2026Updated 4 months ago
- A dynamic compression method that selects consecutive layers from top to bottom using a pre-defined similarity threshold, and compacts pa…☆11Dec 4, 2025Updated 10 months ago