foundation-model-stack / fms-hf-tuning
🚀 Collection of tuning recipes with HuggingFace SFTTrainer and PyTorch FSDP.
☆26Updated this week
Related projects ⓘ
Alternatives and complementary repositories for fms-hf-tuning
- IBM development fork of https://github.com/huggingface/text-generation-inference☆57Updated last month
- Python library for Synthetic Data Generation☆20Updated this week
- ☆106Updated this week
- Taxonomy tree that will allow you to create models tuned with your data☆196Updated this week
- 🦄 Unitxt: a python library for getting data fired up and set for training and evaluation☆159Updated this week
- Open source project for data preparation of LLM application builders☆264Updated this week
- InstructLab Training Library - Efficient Fine-Tuning with Message-Format Data☆17Updated this week
- Estimate resources needed to train LLMs☆11Updated this week
- A simple service that integrates vLLM with Ray Serve for fast and scalable LLM serving.☆52Updated 7 months ago
- codebase release for EMNLP2023 paper publication☆19Updated 8 months ago
- ☆21Updated 3 weeks ago
- Prompt Declaration Language (PDL) is a declarative prompt programming language.☆65Updated this week
- A collection of all available inference solutions for the LLMs☆72Updated last month
- ☆12Updated this week
- Caikit is an AI toolkit that enables users to manage models through a set of developer friendly APIs.☆99Updated last month
- Benchmark suite for LLMs from Fireworks.ai☆58Updated this week
- Packages and instructions for training and inference of LLMs on NVIDIA's new GH200 machines☆15Updated last month
- Self-host LLMs with vLLM and BentoML☆72Updated this week
- A gRPC service intended as a backend for an LLM that can run arbitrary pieces of Python code.☆34Updated this week
- Evaluate and Enhance Your LLM Deployments for Real-World Inference Needs☆160Updated this week
- Evaluation, benchmark, and scorecard, targeting for performance on throughput and latency, accuracy on popular evaluation harness, safety…☆22Updated this week
- ☆91Updated last month
- ☆20Updated 9 months ago
- InstructLab Community wide collaboration space including contributing, security, code of conduct, etc☆72Updated this week
- Open Weight, tool-calling LLMs☆148Updated 2 weeks ago
- experiments with inference on llama☆105Updated 5 months ago
- ☆21Updated 2 weeks ago
- ☆84Updated this week
- Repo hosting codes and materials related to speeding LLMs' inference using token merging.☆29Updated 6 months ago