foundation-model-stack / fms-hf-tuningLinks
🚀 Collection of tuning recipes with HuggingFace SFTTrainer and PyTorch FSDP.
☆44Updated this week
Alternatives and similar repositories for fms-hf-tuning
Users that are interested in fms-hf-tuning are comparing it to the libraries listed below
Sorting:
- Estimate resources needed to train LLMs☆13Updated 3 months ago
- LM engine is a library for pretraining/finetuning LLMs☆55Updated this week
- IBM development fork of https://github.com/huggingface/text-generation-inference☆60Updated 3 weeks ago
- Python library for Synthetic Data Generation☆42Updated this week
- 🚀 Collection of libraries used with fms-hf-tuning to accelerate fine-tuning and training of large models.☆10Updated last month
- 🦄 Unitxt is a Python library for enterprise-grade evaluation of AI performance, offering the world's largest catalog of tools and data …☆196Updated this week
- codebase release for EMNLP2023 paper publication☆19Updated 3 weeks ago
- InstructLab Training Library - Efficient Fine-Tuning with Message-Format Data☆42Updated this week
- Example ML projects that use the Determined library.☆32Updated 8 months ago
- Train, tune, and infer Bamba model☆127Updated last month
- Docker image NVIDIA GH200 machines - optimized for vllm serving and hf trainer finetuning☆42Updated 3 months ago
- ArcticTraining is a framework designed to simplify and accelerate the post-training process for large language models (LLMs)☆105Updated this week
- ☆44Updated last year
- ☆49Updated 6 months ago
- Repo hosting codes and materials related to speeding LLMs' inference using token merging.☆36Updated last year
- ☆41Updated 2 months ago
- Matrix (Multi-Agent daTa geneRation Infra and eXperimentation framework) is a versatile engine for multi-agent conversational data genera…☆60Updated this week
- ☆93Updated last week
- ☆23Updated last year
- FMS Model Optimizer is a framework for developing reduced precision neural network models.☆20Updated last week
- An introduction to LLM Sampling☆78Updated 5 months ago
- vLLM adapter for a TGIS-compatible gRPC server.☆30Updated this week
- QAlign is a new test-time alignment approach that improves language model performance by using Markov chain Monte Carlo methods.☆24Updated last month
- Verifiers for LLM Reinforcement Learning☆55Updated last month
- ☆99Updated this week
- A Python wrapper around HuggingFace's TGI (text-generation-inference) and TEI (text-embedding-inference) servers.☆34Updated 3 weeks ago
- Benchmark suite for LLMs from Fireworks.ai☆75Updated 2 weeks ago
- Set of scripts to finetune LLMs☆37Updated last year
- ☆28Updated 4 months ago
- Maya: An Instruction Finetuned Multilingual Multimodal Model using Aya☆111Updated 2 weeks ago