foundation-model-stack / fms-hf-tuningLinks
🚀 Collection of tuning recipes with HuggingFace SFTTrainer and PyTorch FSDP.
☆54Updated last week
Alternatives and similar repositories for fms-hf-tuning
Users that are interested in fms-hf-tuning are comparing it to the libraries listed below
Sorting:
- Python library for Synthetic Data Generation☆51Updated 3 weeks ago
- 🦄 Unitxt is a Python library for enterprise-grade evaluation of AI performance, offering the world's largest catalog of tools and data …☆212Updated 2 weeks ago
- IBM development fork of https://github.com/huggingface/text-generation-inference☆62Updated 3 months ago
- ☆43Updated last year
- LM engine is a library for pretraining/finetuning LLMs☆102Updated this week
- Ongoing research training transformer models at scale☆42Updated 2 weeks ago
- Benchmark suite for LLMs from Fireworks.ai☆84Updated last month
- vLLM adapter for a TGIS-compatible gRPC server.☆46Updated this week
- Google TPU optimizations for transformers models☆132Updated last week
- Train, tune, and infer Bamba model☆137Updated 6 months ago
- Accelerating your LLM training to full speed! Made with ❤️ by ServiceNow Research☆273Updated last week
- The Granite Guardian models are designed to detect risks in prompts and responses.☆123Updated 2 months ago
- QAlign is a new test-time alignment approach that improves language model performance by using Markov chain Monte Carlo methods.☆26Updated last week
- codebase release for EMNLP2023 paper publication☆19Updated 3 months ago
- EvolKit is an innovative framework designed to automatically enhance the complexity of instructions used for fine-tuning Large Language M…☆245Updated last year
- Supercharge huggingface transformers with model parallelism.☆77Updated 5 months ago
- Source code for the collaborative reasoner research project at Meta FAIR.☆111Updated 8 months ago
- ☆55Updated last year
- FMS Model Optimizer is a framework for developing reduced precision neural network models.☆20Updated last week
- InstructLab Training Library - Efficient Fine-Tuning with Message-Format Data☆44Updated last week
- ☆50Updated 2 months ago
- 🚀 Collection of libraries used with fms-hf-tuning to accelerate fine-tuning and training of large models.☆13Updated last week
- A Python wrapper around HuggingFace's TGI (text-generation-inference) and TEI (text-embedding-inference) servers.☆32Updated 3 months ago
- ☆81Updated last month
- Lightweight demos for finetuning LLMs. Powered by 🤗 transformers and open-source datasets.☆78Updated last year
- ☆17Updated 8 months ago
- ☆138Updated 4 months ago
- Manage scalable open LLM inference endpoints in Slurm clusters☆278Updated last year
- Using open source LLMs to build synthetic datasets for direct preference optimization☆71Updated last year
- ☆48Updated last year