foundation-model-stack / fms-hf-tuningLinks
🚀 Collection of tuning recipes with HuggingFace SFTTrainer and PyTorch FSDP.
☆47Updated last week
Alternatives and similar repositories for fms-hf-tuning
Users that are interested in fms-hf-tuning are comparing it to the libraries listed below
Sorting:
- IBM development fork of https://github.com/huggingface/text-generation-inference☆61Updated 3 months ago
- 🦄 Unitxt is a Python library for enterprise-grade evaluation of AI performance, offering the world's largest catalog of tools and data …☆206Updated this week
- ☆42Updated last year
- LM engine is a library for pretraining/finetuning LLMs☆65Updated this week
- Python library for Synthetic Data Generation☆42Updated this week
- Benchmark suite for LLMs from Fireworks.ai☆80Updated this week
- Google TPU optimizations for transformers models☆120Updated 7 months ago
- The code for the paper ROUTERBENCH: A Benchmark for Multi-LLM Routing System☆134Updated last year
- Accelerating your LLM training to full speed! Made with ❤️ by ServiceNow Research☆223Updated last week
- Train, tune, and infer Bamba model☆131Updated 2 months ago
- Source code for the collaborative reasoner research project at Meta FAIR.☆103Updated 4 months ago
- Codebase accompanying the Summary of a Haystack paper.☆79Updated 11 months ago
- A Python wrapper around HuggingFace's TGI (text-generation-inference) and TEI (text-embedding-inference) servers.☆33Updated 3 months ago
- Manage scalable open LLM inference endpoints in Slurm clusters☆270Updated last year
- ☆54Updated 9 months ago
- ☆75Updated last week
- ☆31Updated 9 months ago
- codebase release for EMNLP2023 paper publication☆19Updated 3 months ago
- ☆238Updated this week
- Using open source LLMs to build synthetic datasets for direct preference optimization☆65Updated last year
- Fine-tune an LLM to perform batch inference and online serving.☆112Updated 3 months ago
- Let's build better datasets, together!☆262Updated 8 months ago
- Matrix (Multi-Agent daTa geneRation Infra and eXperimentation framework) is a versatile engine for multi-agent conversational data genera…☆88Updated last week
- 🔧 Compare how Agent systems perform on several benchmarks. 📊🚀☆100Updated 3 weeks ago
- Lightweight demos for finetuning LLMs. Powered by 🤗 transformers and open-source datasets.☆78Updated 10 months ago
- ArcticTraining is a framework designed to simplify and accelerate the post-training process for large language models (LLMs)☆201Updated last week
- Example ML projects that use the Determined library.☆32Updated 11 months ago
- Code for NeurIPS LLM Efficiency Challenge☆59Updated last year
- Unofficial implementation of https://arxiv.org/pdf/2407.14679☆48Updated 11 months ago
- Hugging Face Inference Toolkit used to serve transformers, sentence-transformers, and diffusers models.☆83Updated this week