Fine-tuning LLMs using QLoRA
☆268Jun 8, 2024Updated last year
Alternatives and similar repositories for llm_qlora
Users that are interested in llm_qlora are comparing it to the libraries listed below
Sorting:
- Experimental sampler to make LLMs more creative☆31Aug 2, 2023Updated 2 years ago
- A workbench application to test out different prompts on a variety of AI models to see how they perform☆16Feb 9, 2025Updated last year
- Customizable implementation of the self-instruct paper.☆1,050Mar 7, 2024Updated 2 years ago
- ☆167Jun 1, 2023Updated 2 years ago
- Python bindings for the Transformer models implemented in C/C++ using GGML library.☆1,882Jan 28, 2024Updated 2 years ago
- coded with and corrected by Google Anti-Gravity☆13Nov 23, 2025Updated 3 months ago
- 5X faster 60% less memory QLoRA finetuning☆21May 28, 2024Updated last year
- ☆15Oct 24, 2023Updated 2 years ago
- A prompt/context management system☆168May 8, 2023Updated 2 years ago
- Radiantloom Email Assist 7B is an email-assistant large language model fine-tuned from Zephyr-7B-Beta, over a custom-curated dataset of 1…☆14Jan 19, 2024Updated 2 years ago
- Get more done with LLMs☆13Jan 19, 2024Updated 2 years ago
- A library for simplifying training with multi gpu setups in the HuggingFace / PyTorch ecosystem.☆16Jan 9, 2026Updated 2 months ago
- QLoRA: Efficient Finetuning of Quantized LLMs☆11Jul 22, 2023Updated 2 years ago
- PDF Extraction Toolkit (wraps and trains LayoutLM)☆10Oct 8, 2021Updated 4 years ago
- ☆13May 25, 2023Updated 2 years ago
- Creates an Langchain Agent which uses the WebUI's API and Wikipedia to work☆73Sep 12, 2023Updated 2 years ago
- A flask-app that helps me write blogpost.☆12Mar 15, 2025Updated 11 months ago
- A vllm proxy server to add security and multi model management for vllm servers☆12May 30, 2024Updated last year
- Simple LLM interface based on terminal.☆12Jan 4, 2024Updated 2 years ago
- ☆47Jul 2, 2023Updated 2 years ago
- Official repo for the paper PHUDGE: Phi-3 as Scalable Judge. Evaluate your LLMs with or without custom rubric, reference answer, absolute…☆52Jul 10, 2024Updated last year
- Democratizing access to LLMs for the open-source community. Let's advance AI, together.☆29Sep 2, 2023Updated 2 years ago
- Train Llama Loras Easily☆31Aug 3, 2023Updated 2 years ago
- Aligntune : A Modular Toolkit for Post Training Alignment of LLMs☆35Feb 26, 2026Updated last week
- A pytest plugin to organize and track algorithm visualizations☆18Dec 1, 2024Updated last year
- ☆15Mar 12, 2024Updated last year
- QLoRA: Efficient Finetuning of Quantized LLMs☆10,841Jun 10, 2024Updated last year
- Go ahead and axolotl questions☆11,395Updated this week
- Low-Rank adapter extraction for fine-tuned transformers models☆180May 2, 2024Updated last year
- TorchServe+Streamlit for easily serving your HuggingFace NER models☆33Jul 4, 2022Updated 3 years ago
- Simple debug menu for Unity☆17Sep 30, 2023Updated 2 years ago
- Examples for using the SiLLM framework for training and running Large Language Models (LLMs) on Apple Silicon☆16May 8, 2025Updated 10 months ago
- pip install poai☆14Mar 2, 2026Updated last week
- Refined Direct Preference Optimization with Synthetic Data for Behavioral Alignment of LLMs☆13Feb 13, 2024Updated 2 years ago
- Finetune Falcon, LLaMA, MPT, and RedPajama on consumer hardware using PEFT LoRA☆104May 20, 2025Updated 9 months ago
- This is our own implementation of 'Layer Selective Rank Reduction'☆240May 26, 2024Updated last year
- Convenience scripts to finetune (chat-)LLaMa3 and other models for any language☆313Jun 17, 2024Updated last year
- A bagel, with everything.☆326Apr 11, 2024Updated last year
- A more memory-efficient rewrite of the HF transformers implementation of Llama for use with quantized weights.☆2,913Sep 30, 2023Updated 2 years ago