Convenient wrapper for fine-tuning and inference of Large Language Models (LLMs) with several quantization techniques (GTPQ, bitsandbytes)
☆145Oct 17, 2023Updated 2 years ago
Alternatives and similar repositories for llm_finetuning
Users that are interested in llm_finetuning are comparing it to the libraries listed below
Sorting:
- LLM fine-tuning and eval☆348Mar 21, 2024Updated last year
- Modified Beam Search with periodical restart☆12Sep 12, 2024Updated last year
- A pytest plugin to organize and track algorithm visualizations☆18Dec 1, 2024Updated last year
- An Autonomous LLM Agent that runs on Wizcoder-15B☆335Oct 21, 2024Updated last year
- QLoRA with Enhanced Multi GPU Support☆38Aug 8, 2023Updated 2 years ago
- ☆167Jun 1, 2023Updated 2 years ago
- A more memory-efficient rewrite of the HF transformers implementation of Llama for use with quantized weights.☆2,913Sep 30, 2023Updated 2 years ago
- Our Process for Llama2 Finetuning☆16Sep 8, 2023Updated 2 years ago
- Landmark Attention: Random-Access Infinite Context Length for Transformers QLoRA☆125Jun 16, 2023Updated 2 years ago
- A tool that can be used to measure the sequential performance of any OpenAI-compatible LLM API☆22Aug 1, 2024Updated last year
- ☆17Dec 18, 2023Updated 2 years ago
- Customizable implementation of the self-instruct paper.☆1,049Mar 7, 2024Updated last year
- ☆51May 31, 2024Updated last year
- The Multitask Long Document Benchmark☆42Nov 2, 2022Updated 3 years ago
- A data-centric AI package for ML/AI. Get the best high-quality data for the best results. Discord: https://discord.gg/t6ADqBKrdZ☆63Nov 20, 2023Updated 2 years ago
- Intelligent Go-Explore: Standing on the Shoulders of Giant Foundation Models☆66Feb 25, 2025Updated last year
- A Python-based voice assistant integrating speech-to-text (STT), text-to-speech (TTS), and powerful AI capabilities using either a local …☆13Dec 8, 2025Updated 2 months ago
- Gradio based tool to run opensource LLM models directly from Huggingface☆97Jun 27, 2024Updated last year
- 🐙 OctoPack: Instruction Tuning Code Large Language Models☆478Feb 5, 2025Updated last year
- Load multiple LoRA modules simultaneously and automatically switch the appropriate combination of LoRA modules to generate the best answe…☆159Feb 9, 2024Updated 2 years ago
- Proteus is an experimental platform that combines the power of Large Language Models with the Genesis physics engine☆26Dec 20, 2024Updated last year
- Official code for ACL 2023 (short, findings) paper "Recursion of Thought: A Divide and Conquer Approach to Multi-Context Reasoning with L…☆45Jun 13, 2023Updated 2 years ago
- Multi-Domain Expert Learning☆67Jan 23, 2024Updated 2 years ago
- ☆13May 25, 2023Updated 2 years ago
- ☆11Jan 28, 2024Updated 2 years ago
- ☆13May 21, 2023Updated 2 years ago
- REBUS: A Robust Evaluation Benchmark of Understanding Symbols☆13Aug 13, 2024Updated last year
- ☆12May 30, 2025Updated 9 months ago
- distilled Self-Critique refines the outputs of a LLM with only synthetic data☆11Apr 11, 2024Updated last year
- GPT-Book Reader is a powerful app that enables reading, summarizing, and translating long texts using the cutting-edge GPT technology. It…☆10Aug 5, 2023Updated 2 years ago
- Trigger an LLM in your CI/CD to auto-complete your work☆11Apr 5, 2023Updated 2 years ago
- ☆11Jun 5, 2024Updated last year
- Fine-tune mistral-7B on 3090s, a100s, h100s☆724Oct 11, 2023Updated 2 years ago
- Creates an Langchain Agent which uses the WebUI's API and Wikipedia to work☆73Sep 12, 2023Updated 2 years ago
- Llama cute voice assistant☆27Sep 10, 2023Updated 2 years ago
- Landmark Attention: Random-Access Infinite Context Length for Transformers☆426Dec 20, 2023Updated 2 years ago
- A stable, fast and easy-to-use inference library with a focus on a sync-to-async API☆48Sep 26, 2024Updated last year
- WebAISum is a Python script that allows you to summarize web pages using AI models. It supports both local models like Ollama and remote …☆15Apr 28, 2024Updated last year
- an auto-sleeping and -waking framework around llama.cpp☆12Feb 8, 2025Updated last year