foundation-model-stack / fms-hf-tuningLinks
🚀 Collection of tuning recipes with HuggingFace SFTTrainer and PyTorch FSDP.
☆51Updated this week
Alternatives and similar repositories for fms-hf-tuning
Users that are interested in fms-hf-tuning are comparing it to the libraries listed below
Sorting:
- Python library for Synthetic Data Generation☆50Updated 2 weeks ago
- 🦄 Unitxt is a Python library for enterprise-grade evaluation of AI performance, offering the world's largest catalog of tools and data …☆210Updated this week
- LM engine is a library for pretraining/finetuning LLMs☆69Updated last week
- IBM development fork of https://github.com/huggingface/text-generation-inference☆61Updated 3 weeks ago
- Google TPU optimizations for transformers models☆120Updated 8 months ago
- codebase release for EMNLP2023 paper publication☆19Updated 3 weeks ago
- Accelerating your LLM training to full speed! Made with ❤️ by ServiceNow Research☆237Updated last week
- Train, tune, and infer Bamba model☆133Updated 4 months ago
- ☆43Updated last year
- Benchmark suite for LLMs from Fireworks.ai☆83Updated this week
- Ongoing research training transformer models at scale☆32Updated this week
- ☆54Updated 11 months ago
- ☆49Updated 8 months ago
- Supercharge huggingface transformers with model parallelism.☆77Updated 2 months ago
- The source code of our work "Prepacking: A Simple Method for Fast Prefilling and Increased Throughput in Large Language Models" [AISTATS …☆60Updated 11 months ago
- Anchored Preference Optimization and Contrastive Revisions: Addressing Underspecification in Alignment☆60Updated last year
- A Python wrapper around HuggingFace's TGI (text-generation-inference) and TEI (text-embedding-inference) servers.☆33Updated 2 weeks ago
- Source code for the collaborative reasoner research project at Meta FAIR.☆102Updated 5 months ago
- Manage scalable open LLM inference endpoints in Slurm clusters☆274Updated last year
- The code for the paper ROUTERBENCH: A Benchmark for Multi-LLM Routing System☆142Updated last year
- InstructLab Training Library - Efficient Fine-Tuning with Message-Format Data☆42Updated last week
- ☆46Updated last year
- ☆136Updated last month
- ☆77Updated last month
- ☆124Updated 11 months ago
- Let's build better datasets, together!☆262Updated 9 months ago
- ☆43Updated 3 weeks ago
- ☆23Updated 2 years ago
- ☆69Updated 2 months ago
- Code for NeurIPS LLM Efficiency Challenge☆59Updated last year