foundation-model-stack / fms-hf-tuningLinks
🚀 Collection of tuning recipes with HuggingFace SFTTrainer and PyTorch FSDP.
☆52Updated this week
Alternatives and similar repositories for fms-hf-tuning
Users that are interested in fms-hf-tuning are comparing it to the libraries listed below
Sorting:
- 🦄 Unitxt is a Python library for enterprise-grade evaluation of AI performance, offering the world's largest catalog of tools and data …☆212Updated this week
- IBM development fork of https://github.com/huggingface/text-generation-inference☆62Updated 2 months ago
- Python library for Synthetic Data Generation☆51Updated this week
- Google TPU optimizations for transformers models☆124Updated 10 months ago
- LM engine is a library for pretraining/finetuning LLMs☆77Updated this week
- Train, tune, and infer Bamba model☆137Updated 6 months ago
- Benchmark suite for LLMs from Fireworks.ai☆84Updated 2 weeks ago
- Accelerating your LLM training to full speed! Made with ❤️ by ServiceNow Research☆265Updated this week
- ☆43Updated last year
- A Python wrapper around HuggingFace's TGI (text-generation-inference) and TEI (text-embedding-inference) servers.☆32Updated 2 months ago
- ☆55Updated last year
- codebase release for EMNLP2023 paper publication☆19Updated 2 months ago
- The code for the paper ROUTERBENCH: A Benchmark for Multi-LLM Routing System☆151Updated last year
- A unified library for building, evaluating, and storing speculative decoding algorithms for LLM inference in vLLM☆140Updated this week
- Lightweight demos for finetuning LLMs. Powered by 🤗 transformers and open-source datasets.☆78Updated last year
- ☆78Updated 2 weeks ago
- vLLM adapter for a TGIS-compatible gRPC server.☆45Updated this week
- The source code of our work "Prepacking: A Simple Method for Fast Prefilling and Increased Throughput in Large Language Models" [AISTATS …☆60Updated last year
- ☆124Updated last year
- 🚀 Collection of libraries used with fms-hf-tuning to accelerate fine-tuning and training of large models.☆13Updated last week
- A set of scripts and notebooks on LLM finetunning and dataset creation☆112Updated last year
- Complex Function Calling Benchmark.☆149Updated 10 months ago
- Anchored Preference Optimization and Contrastive Revisions: Addressing Underspecification in Alignment☆60Updated last year
- Supercharge huggingface transformers with model parallelism.☆77Updated 4 months ago
- ☆138Updated 3 months ago
- ☆52Updated last year
- Seemless interface of using PyTOrch distributed with Jupyter notebooks☆57Updated 2 months ago
- Codebase accompanying the Summary of a Haystack paper.☆79Updated last year
- Manage scalable open LLM inference endpoints in Slurm clusters☆277Updated last year
- A collection of all available inference solutions for the LLMs☆93Updated 9 months ago