Convenient wrapper for fine-tuning and inference of Large Language Models (LLMs) with several quantization techniques (GTPQ, bitsandbytes)
☆144Oct 17, 2023Updated 2 years ago
Alternatives and similar repositories for llm_finetuning
Users that are interested in llm_finetuning are comparing it to the libraries listed below. We may earn a commission when you buy through links labeled 'Ad' on this page.
Sorting:
- LLM fine-tuning and eval☆346Mar 21, 2024Updated 2 years ago
- Modified Beam Search with periodical restart☆12Sep 12, 2024Updated last year
- A pytest plugin to organize and track algorithm visualizations☆18Dec 1, 2024Updated last year
- A more memory-efficient rewrite of the HF transformers implementation of Llama for use with quantized weights.☆2,924Sep 30, 2023Updated 2 years ago
- An Autonomous LLM Agent that runs on Wizcoder-15B☆335Oct 21, 2024Updated last year
- Managed Database hosting by DigitalOcean • AdPostgreSQL, MySQL, MongoDB, Kafka, Valkey, and OpenSearch available. Automatically scale up storage and focus on building your apps.
- ☆166Jun 1, 2023Updated 3 years ago
- Landmark Attention: Random-Access Infinite Context Length for Transformers QLoRA☆124Jun 16, 2023Updated 2 years ago
- Our Process for Llama2 Finetuning☆16Sep 8, 2023Updated 2 years ago
- Official code for ACL 2023 (short, findings) paper "Recursion of Thought: A Divide and Conquer Approach to Multi-Context Reasoning with L…☆45Jun 13, 2023Updated 3 years ago
- QLoRA with Enhanced Multi GPU Support☆38Aug 8, 2023Updated 2 years ago
- Customizable implementation of the self-instruct paper.☆1,051Mar 7, 2024Updated 2 years ago
- Experimental sampler to make LLMs more creative☆31Aug 2, 2023Updated 2 years ago
- ☆14May 25, 2023Updated 3 years ago
- A guidance language for controlling large language models.☆43Jun 9, 2023Updated 3 years ago
- Deploy on Railway without the complexity - Free Credits Offer • AdConnect your repo and Railway handles the rest with instant previews. Quickly provision container image services, databases, and storage volumes.
- 🐙 OctoPack: Instruction Tuning Code Large Language Models☆478Feb 5, 2025Updated last year
- Load multiple LoRA modules simultaneously and automatically switch the appropriate combination of LoRA modules to generate the best answe…☆161Feb 9, 2024Updated 2 years ago
- A data-centric AI package for ML/AI. Get the best high-quality data for the best results. Discord: https://discord.gg/t6ADqBKrdZ☆63Nov 20, 2023Updated 2 years ago
- Landmark Attention: Random-Access Infinite Context Length for Transformers☆426Dec 20, 2023Updated 2 years ago
- Host the GPTQ model using AutoGPTQ as an API that is compatible with text generation UI API.☆91Jun 19, 2023Updated 2 years ago
- A tool that can be used to measure the sequential performance of any OpenAI-compatible LLM API☆24Aug 1, 2024Updated last year
- Fine-tune mistral-7B on 3090s, a100s, h100s☆731Oct 11, 2023Updated 2 years ago
- A public implementation of the ReLoRA pretraining method, built on Lightning-AI's Pytorch Lightning suite.☆34Mar 2, 2024Updated 2 years ago
- Creates an Langchain Agent which uses the WebUI's API and Wikipedia to work☆73Sep 12, 2023Updated 2 years ago
- Bare Metal GPUs on DigitalOcean Gradient AI • AdPurpose-built for serious AI teams training foundational models, running large-scale inference, and pushing the boundaries of what's possible.
- Go ahead and axolotl questions☆12,032Updated this week
- WebAISum is a Python script that allows you to summarize web pages using AI models. It supports both local models like Ollama and remote …☆15Apr 28, 2024Updated 2 years ago
- Exploring what's possible with the ChatGPT Code Interpreter and how to use it effectively☆11Jul 22, 2023Updated 2 years ago
- A Python-based voice assistant integrating speech-to-text (STT), text-to-speech (TTS), and powerful AI capabilities using either a local …☆18Dec 8, 2025Updated 6 months ago
- ☆17Dec 18, 2023Updated 2 years ago
- ☆54Jun 11, 2023Updated 3 years ago
- GPT-2 small trained on phi-like data☆68Feb 18, 2024Updated 2 years ago
- CI scripts designed to build a Pascal-compatible version of vLLM.☆12Aug 10, 2024Updated last year
- Proteus is an experimental platform that combines the power of Large Language Models with the Genesis physics engine☆25Dec 20, 2024Updated last year
- Deploy to Railway using AI coding agents - Free Credits Offer • AdUse Claude Code, Codex, OpenCode, and more. Autonomous software development now has the infrastructure to match with Railway.
- XTTSv2 Extension for oobabooga text-generation-webui☆157Nov 21, 2023Updated 2 years ago
- Full finetuning of large language models without large memory requirements☆94Sep 22, 2025Updated 8 months ago
- Web UI for ExLlamaV2☆512Feb 5, 2025Updated last year
- Gradio based tool to run opensource LLM models directly from Huggingface☆99Jun 27, 2024Updated last year
- ☆51May 31, 2024Updated 2 years ago
- WebGPU LLM inference tuned by hand☆150Jun 24, 2023Updated 2 years ago
- Provide a way to use the GPT-QLLama model as an API☆44May 20, 2023Updated 3 years ago