foundation-model-stack / fms-hf-tuningLinks
🚀 Collection of tuning recipes with HuggingFace SFTTrainer and PyTorch FSDP.
☆47Updated this week
Alternatives and similar repositories for fms-hf-tuning
Users that are interested in fms-hf-tuning are comparing it to the libraries listed below
Sorting:
- IBM development fork of https://github.com/huggingface/text-generation-inference☆61Updated 2 months ago
- Python library for Synthetic Data Generation☆42Updated this week
- LM engine is a library for pretraining/finetuning LLMs☆59Updated this week
- 🦄 Unitxt is a Python library for enterprise-grade evaluation of AI performance, offering the world's largest catalog of tools and data …☆206Updated this week
- ☆40Updated last year
- Estimate resources needed to train LLMs☆13Updated 4 months ago
- Matrix (Multi-Agent daTa geneRation Infra and eXperimentation framework) is a versatile engine for multi-agent conversational data genera…☆73Updated 2 weeks ago
- ☆52Updated 8 months ago
- Train, tune, and infer Bamba model☆130Updated last month
- ☆30Updated 8 months ago
- Google TPU optimizations for transformers models☆116Updated 5 months ago
- ☆23Updated 2 years ago
- Codebase accompanying the Summary of a Haystack paper.☆79Updated 9 months ago
- Pre-training code for CrystalCoder 7B LLM☆54Updated last year
- QAlign is a new test-time alignment approach that improves language model performance by using Markov chain Monte Carlo methods.☆23Updated 3 months ago
- Source code for the collaborative reasoner research project at Meta FAIR.☆95Updated 3 months ago
- Supervised instruction finetuning for LLM with HF trainer and Deepspeed☆35Updated 2 years ago
- InstructLab Training Library - Efficient Fine-Tuning with Message-Format Data☆43Updated this week
- Supercharge huggingface transformers with model parallelism.☆77Updated 9 months ago
- 🚀 Collection of libraries used with fms-hf-tuning to accelerate fine-tuning and training of large models.☆11Updated last month
- Open Implementations of LLM Analyses☆105Updated 9 months ago
- Accelerating your LLM training to full speed! Made with ❤️ by ServiceNow Research☆211Updated this week
- Repo hosting codes and materials related to speeding LLMs' inference using token merging.☆36Updated last year
- The code for the paper ROUTERBENCH: A Benchmark for Multi-LLM Routing System☆128Updated last year
- codebase release for EMNLP2023 paper publication☆19Updated 2 months ago
- ☆41Updated 5 months ago
- ☆48Updated 5 months ago
- Anchored Preference Optimization and Contrastive Revisions: Addressing Underspecification in Alignment☆60Updated 10 months ago
- A framework for standardizing evaluations of large foundation models, beyond single-score reporting and rankings.☆163Updated this week
- Verifiers for LLM Reinforcement Learning☆65Updated 3 months ago