Convenient wrapper for fine-tuning and inference of Large Language Models (LLMs) with several quantization techniques (GTPQ, bitsandbytes)
☆142Oct 17, 2023Updated 3 years ago
Alternatives and similar repositories for llm_finetuning
Users that are interested in llm_finetuning are comparing it to the libraries listed below. We may earn a commission when you buy through links labeled 'Ad' on this page.
Sorting:
- LLM fine-tuning and eval☆343Mar 21, 2024Updated 2 years ago
- Landmark Attention: Random-Access Infinite Context Length for Transformers QLoRA☆123Jun 16, 2023Updated 3 years ago
- A more memory-efficient rewrite of the HF transformers implementation of Llama for use with quantized weights.☆2,945Sep 30, 2023Updated 3 years ago
- Official code for ACL 2023 (short, findings) paper "Recursion of Thought: A Divide and Conquer Approach to Multi-Context Reasoning with L…☆45Jun 13, 2023Updated 3 years ago
- ☆165Jun 1, 2023Updated 3 years ago
- Deploy to Railway using AI coding agents - Free Credits Offer • AdUse Claude Code, Codex, OpenCode, and more. Autonomous software development now has the infrastructure to match with Railway.
- An Autonomous LLM Agent that runs on Wizcoder-15B☆333Oct 21, 2024Updated 2 years ago
- Our Process for Llama2 Finetuning☆16Sep 8, 2023Updated 3 years ago
- A pytest plugin to organize and track algorithm visualizations☆18Dec 1, 2024Updated last year
- QLoRA with Enhanced Multi GPU Support☆38Aug 8, 2023Updated 3 years ago
- A public implementation of the ReLoRA pretraining method, built on Lightning-AI's Pytorch Lightning suite.☆34Mar 2, 2024Updated 2 years ago
- an example of local large langue model embeddings with Redis as vector stores☆12Apr 30, 2023Updated 3 years ago
- Fine-tune mistral-7B on 3090s, a100s, h100s☆737Oct 11, 2023Updated 3 years ago
- Customizable implementation of the self-instruct paper.☆1,053Mar 7, 2024Updated 2 years ago
- Experimental sampler to make LLMs more creative☆31Aug 2, 2023Updated 3 years ago
- Wordpress hosting with auto-scaling - Free Trial Offer • AdFully Managed hosting for WordPress and WooCommerce businesses that need reliable, auto-scalable performance. Cloudways SafeUpdates now available.
- A guidance language for controlling large language models.☆40Jun 9, 2023Updated 3 years ago
- The Multitask Long Document Benchmark☆42Nov 2, 2022Updated 4 years ago
- Host the GPTQ model using AutoGPTQ as an API that is compatible with text generation UI API.☆90Jun 19, 2023Updated 3 years ago
- Load multiple LoRA modules simultaneously and automatically switch the appropriate combination of LoRA modules to generate the best answe…☆163Feb 9, 2024Updated 2 years ago
- distilled Self-Critique refines the outputs of a LLM with only synthetic data☆11Apr 11, 2024Updated 2 years ago
- Go ahead and axolotl questions☆12,650Updated this week
- Landmark Attention: Random-Access Infinite Context Length for Transformers☆427Dec 20, 2023Updated 2 years ago
- 🐙 OctoPack: Instruction Tuning Code Large Language Models☆481Feb 5, 2025Updated last year
- ☆52Jun 11, 2023Updated 3 years ago
- Wordpress hosting with auto-scaling - Free Trial Offer • AdFully Managed hosting for WordPress and WooCommerce businesses that need reliable, auto-scalable performance. Cloudways SafeUpdates now available.
- GPT-2 small trained on phi-like data☆68Feb 18, 2024Updated 2 years ago
- "Pacha" TUI (Text User Interface) is a JavaScript application that utilizes the "blessed" library. It serves as a frontend for llama.cpp …☆37Aug 3, 2023Updated 3 years ago
- paraphase sentence☆11Aug 22, 2025Updated last year
- A data-centric AI package for ML/AI. Get the best high-quality data for the best results. Discord: https://discord.gg/t6ADqBKrdZ☆60Nov 20, 2023Updated 2 years ago
- Tune any FALCON in 4-bit☆461Sep 1, 2023Updated 3 years ago
- CI scripts designed to build a Pascal-compatible version of vLLM.☆13Aug 10, 2024Updated 2 years ago
- WebGPU LLM inference tuned by hand☆153Jun 24, 2023Updated 3 years ago
- Full finetuning of large language models without large memory requirements☆92Sep 22, 2025Updated last year
- XTTSv2 Extension for oobabooga text-generation-webui☆156Nov 21, 2023Updated 2 years ago
- Open source password manager - Proton Pass • AdSecurely store, share, and autofill your credentials with Proton Pass, the end-to-end encrypted password manager trusted by millions.
- An OpenAI API compatible LLM inference server based on ExLlamaV2.☆24Feb 9, 2024Updated 2 years ago
- ☆10Oct 21, 2023Updated 3 years ago
- WebAISum is a Python script that allows you to summarize web pages using AI models. It supports both local models like Ollama and remote …☆15Apr 28, 2024Updated 2 years ago
- Web UI for ExLlamaV2☆517Feb 5, 2025Updated last year
- A KoboldAI-like memory extension for oobabooga's text-generation-webui☆106Oct 29, 2024Updated 2 years ago
- A stable, fast and easy-to-use inference library with a focus on a sync-to-async API☆46Sep 26, 2024Updated 2 years ago
- The fingerprinting library for Rust☆15Mar 30, 2026Updated 7 months ago