foundation-model-stack / fms-hf-tuningLinks
🚀 Collection of tuning recipes with HuggingFace SFTTrainer and PyTorch FSDP.
☆47Updated this week
Alternatives and similar repositories for fms-hf-tuning
Users that are interested in fms-hf-tuning are comparing it to the libraries listed below
Sorting:
- Python library for Synthetic Data Generation☆42Updated this week
- LM engine is a library for pretraining/finetuning LLMs☆57Updated this week
- IBM development fork of https://github.com/huggingface/text-generation-inference☆60Updated last month
- Estimate resources needed to train LLMs☆13Updated 4 months ago
- 🦄 Unitxt is a Python library for enterprise-grade evaluation of AI performance, offering the world's largest catalog of tools and data …☆199Updated this week
- 🚀 Collection of libraries used with fms-hf-tuning to accelerate fine-tuning and training of large models.☆11Updated last week
- codebase release for EMNLP2023 paper publication☆19Updated last month
- Train, tune, and infer Bamba model☆127Updated 3 weeks ago
- InstructLab Training Library - Efficient Fine-Tuning with Message-Format Data☆42Updated this week
- vLLM adapter for a TGIS-compatible gRPC server.☆32Updated this week
- ☆39Updated 11 months ago
- A Python wrapper around HuggingFace's TGI (text-generation-inference) and TEI (text-embedding-inference) servers.☆33Updated last month
- a pipeline for using api calls to agnostically convert unstructured data into structured training data☆30Updated 9 months ago
- Pre-training code for CrystalCoder 7B LLM☆54Updated last year
- Repo hosting codes and materials related to speeding LLMs' inference using token merging.☆36Updated last year
- ☆23Updated last year
- Unofficial implementation of https://arxiv.org/pdf/2407.14679☆45Updated 9 months ago
- ☆51Updated 7 months ago
- The repository contains generative AI analytics platform application code.☆26Updated last month
- Codebase accompanying the Summary of a Haystack paper.☆78Updated 9 months ago
- FMS Model Optimizer is a framework for developing reduced precision neural network models.☆20Updated last week
- Data preparation code for Amber 7B LLM☆91Updated last year
- ☆74Updated last year
- Anchored Preference Optimization and Contrastive Revisions: Addressing Underspecification in Alignment☆57Updated 9 months ago
- Hugging Face Inference Toolkit used to serve transformers, sentence-transformers, and diffusers models.☆78Updated 2 weeks ago
- Trully flash implementation of DeBERTa disentangled attention mechanism.☆58Updated last month
- QAlign is a new test-time alignment approach that improves language model performance by using Markov chain Monte Carlo methods.☆23Updated 2 months ago
- Supervised instruction finetuning for LLM with HF trainer and Deepspeed☆35Updated last year
- Benchmark suite for LLMs from Fireworks.ai☆76Updated 2 weeks ago
- Official repo for the paper PHUDGE: Phi-3 as Scalable Judge. Evaluate your LLMs with or without custom rubric, reference answer, absolute…☆49Updated 11 months ago