foundation-model-stack / fms-hf-tuning
🚀 Collection of tuning recipes with HuggingFace SFTTrainer and PyTorch FSDP.
☆38Updated this week
Alternatives and similar repositories for fms-hf-tuning:
Users that are interested in fms-hf-tuning are comparing it to the libraries listed below
- Estimate resources needed to train LLMs☆13Updated last month
- 🦄 Unitxt: a python library for getting data fired up and set for training and evaluation☆181Updated this week
- Python library for Synthetic Data Generation☆35Updated this week
- Dolomite Engine is a library for pretraining/finetuning LLMs☆44Updated this week
- IBM development fork of https://github.com/huggingface/text-generation-inference☆60Updated 3 months ago
- InstructLab Training Library - Efficient Fine-Tuning with Message-Format Data☆30Updated this week
- codebase release for EMNLP2023 paper publication☆19Updated last year
- Supervised instruction finetuning for LLM with HF trainer and Deepspeed☆34Updated last year
- A package dedicated for running benchmark agreement testing☆16Updated 4 months ago
- The Granite Guardian models are designed to detect risks in prompts and responses.☆72Updated last week
- ☆24Updated last year
- Anchored Preference Optimization and Contrastive Revisions: Addressing Underspecification in Alignment☆55Updated 6 months ago
- Using open source LLMs to build synthetic datasets for direct preference optimization☆59Updated last year
- Official repo for NAACL 2024 Findings paper "LeTI: Learning to Generate from Textual Interactions."☆63Updated last year
- ☆74Updated last year
- Reward Model framework for LLM RLHF☆61Updated last year
- ☆48Updated 4 months ago
- Lightweight demos for finetuning LLMs. Powered by 🤗 transformers and open-source datasets.☆73Updated 5 months ago
- Benchmark suite for LLMs from Fireworks.ai☆70Updated last month
- ☆33Updated 8 months ago
- Official repo for the paper PHUDGE: Phi-3 as Scalable Judge. Evaluate your LLMs with or without custom rubric, reference answer, absolute…☆49Updated 8 months ago
- A framework for pitting LLMs against each other in an evolving library of games ⚔☆32Updated this week
- ☆66Updated 10 months ago
- LLM attention pattern visualizer☆10Updated last year
- Spherical Merge Pytorch/HF format Language Models with minimal feature loss.☆117Updated last year
- ☆22Updated last year
- a pipeline for using api calls to agnostically convert unstructured data into structured training data☆30Updated 6 months ago
- Improving Text Embedding of Language Models Using Contrastive Fine-tuning☆61Updated 7 months ago
- Repository containing the SPIN experiments on the DIBT 10k ranked prompts☆24Updated last year
- ☆32Updated 9 months ago