AdrianBZG / LLM-distributed-finetuneLinks
Tune efficiently any LLM model from HuggingFace using distributed training (multiple GPU) and DeepSpeed. Uses Ray AIR to orchestrate the training on multiple AWS GPU instances
☆59Updated 2 years ago
Alternatives and similar repositories for LLM-distributed-finetune
Users that are interested in LLM-distributed-finetune are comparing it to the libraries listed below
Sorting:
- Pretrain, finetune and serve LLMs on Intel platforms with Ray☆132Updated 2 weeks ago
- Benchmark suite for LLMs from Fireworks.ai☆83Updated last week
- experiments with inference on llama☆104Updated last year
- ☆58Updated last year
- 🕹️ Performance Comparison of MLOps Engines, Frameworks, and Languages on Mainstream AI Models.☆138Updated last year
- 🏋️ A unified multi-backend utility for benchmarking Transformers, Timm, PEFT, Diffusers and Sentence-Transformers with full support of O…☆315Updated 2 weeks ago
- batched loras☆346Updated 2 years ago
- The code for the paper ROUTERBENCH: A Benchmark for Multi-LLM Routing System☆142Updated last year
- NeurIPS Large Language Model Efficiency Challenge: 1 LLM + 1GPU + 1Day☆256Updated last year
- ☆121Updated last year
- ☆197Updated last year
- vLLM: A high-throughput and memory-efficient inference and serving engine for LLMs☆90Updated last week
- ☆87Updated 2 years ago
- Manage scalable open LLM inference endpoints in Slurm clusters☆273Updated last year
- Ray - A curated list of resources: https://github.com/ray-project/ray☆69Updated 3 months ago
- Fine-tune an LLM to perform batch inference and online serving.☆112Updated 4 months ago
- Experiments on speculative sampling with Llama models☆126Updated 2 years ago
- ☆470Updated last year
- ☆56Updated 10 months ago
- ☆315Updated last year
- ReLM is a Regular Expression engine for Language Models☆106Updated 2 years ago
- A set of scripts and notebooks on LLM finetunning and dataset creation☆110Updated last year
- A high-throughput and memory-efficient inference and serving engine for LLMs☆265Updated last year
- A simple service that integrates vLLM with Ray Serve for fast and scalable LLM serving.☆72Updated last year
- This is suite of the hands-on training materials that shows how to scale CV, NLP, time-series forecasting workloads with Ray.☆434Updated last year
- Tutorial for building LLM router☆228Updated last year
- ArcticTraining is a framework designed to simplify and accelerate the post-training process for large language models (LLMs)☆224Updated this week
- JetStream is a throughput and memory optimized engine for LLM inference on XLA devices, starting with TPUs (and GPUs in future -- PRs wel…☆381Updated 4 months ago
- ☆255Updated last week
- A high-performance inference system for large language models, designed for production environments.☆477Updated this week