foundation-model-stack / fms-hf-tuning
🚀 Collection of tuning recipes with HuggingFace SFTTrainer and PyTorch FSDP.
☆27Updated this week
Related projects ⓘ
Alternatives and complementary repositories for fms-hf-tuning
- IBM development fork of https://github.com/huggingface/text-generation-inference☆57Updated last month
- Estimate resources needed to train LLMs☆11Updated 2 weeks ago
- Python library for Synthetic Data Generation☆23Updated this week
- 🦄 Unitxt: a python library for getting data fired up and set for training and evaluation☆160Updated this week
- Open source project for data preparation of LLM application builders☆300Updated this week
- InstructLab Training Library - Efficient Fine-Tuning with Message-Format Data☆21Updated this week
- Taxonomy tree that will allow you to create models tuned with your data☆200Updated this week
- ☆120Updated this week
- ☆23Updated last month
- Benchmark suite for LLMs from Fireworks.ai☆58Updated 2 weeks ago
- codebase release for EMNLP2023 paper publication☆19Updated 8 months ago
- Build Enterprise RAG (Retriver Augmented Generation) Pipelines to tackle various Generative AI use cases with LLM's by simply plugging co…☆110Updated 3 months ago
- Dolomite Engine is a library for pretraining/finetuning LLMs☆21Updated this week
- InstructLab Community wide collaboration space including contributing, security, code of conduct, etc☆72Updated this week
- Google TPU optimizations for transformers models☆75Updated this week
- ☆12Updated last week
- Prompt Declaration Language (PDL) is a declarative prompt programming language.☆74Updated this week
- Large Language Model Text Generation Inference on Habana Gaudi☆27Updated this week
- Examples using the Deep Search functionalities☆46Updated 3 months ago
- End-to-End LLM Guide☆97Updated 4 months ago
- Core repository for an AI-powered OCP assistant service☆37Updated this week
- Accelerate your Gen AI with NVIDIA NIM and NVIDIA AI Workbench☆107Updated this week
- IBM-Generative-AI is a Python library built on IBM's large language model REST interface to seamlessly integrate and extend this service …☆249Updated 2 months ago
- Caikit is an AI toolkit that enables users to manage models through a set of developer friendly APIs.☆99Updated 2 months ago
- Self-host LLMs with vLLM and BentoML☆74Updated last week
- An Operator for deployment and maintenance of NVIDIA NIMs and NeMo microservices in a Kubernetes environment.☆57Updated this week
- Cloud Native Benchmarking of Foundation Models☆20Updated 2 weeks ago
- A collection of all available inference solutions for the LLMs☆73Updated 2 months ago
- ☆21Updated 3 weeks ago