AdrianBZG / LLM-distributed-finetuneLinks
Tune efficiently any LLM model from HuggingFace using distributed training (multiple GPU) and DeepSpeed. Uses Ray AIR to orchestrate the training on multiple AWS GPU instances
☆59Updated 2 years ago
Alternatives and similar repositories for LLM-distributed-finetune
Users that are interested in LLM-distributed-finetune are comparing it to the libraries listed below
Sorting:
- experiments with inference on llama☆104Updated last year
- Pretrain, finetune and serve LLMs on Intel platforms with Ray☆132Updated last week
- batched loras☆345Updated 2 years ago
- The code for the paper ROUTERBENCH: A Benchmark for Multi-LLM Routing System☆140Updated last year
- ☆121Updated last year
- Benchmark suite for LLMs from Fireworks.ai☆83Updated last week
- NeurIPS Large Language Model Efficiency Challenge: 1 LLM + 1GPU + 1Day☆256Updated last year
- ReLM is a Regular Expression engine for Language Models☆106Updated 2 years ago
- 🕹️ Performance Comparison of MLOps Engines, Frameworks, and Languages on Mainstream AI Models.☆137Updated last year
- This is suite of the hands-on training materials that shows how to scale CV, NLP, time-series forecasting workloads with Ray.☆432Updated last year
- 🏋️ A unified multi-backend utility for benchmarking Transformers, Timm, PEFT, Diffusers and Sentence-Transformers with full support of O…☆315Updated this week
- ☆55Updated 9 months ago
- Ray - A curated list of resources: https://github.com/ray-project/ray☆68Updated 2 months ago
- Manage scalable open LLM inference endpoints in Slurm clusters☆271Updated last year
- ☆59Updated last year
- ☆199Updated last year
- Experiments on speculative sampling with Llama models☆128Updated 2 years ago
- vLLM: A high-throughput and memory-efficient inference and serving engine for LLMs☆89Updated this week
- 🚀 Collection of components for development, training, tuning, and inference of foundation models leveraging PyTorch native components.☆211Updated this week
- Tutorial to get started with SkyPilot!☆58Updated last year
- Code for the paper "QMoE: Practical Sub-1-Bit Compression of Trillion-Parameter Models".☆277Updated last year
- A high-throughput and memory-efficient inference and serving engine for LLMs☆266Updated 11 months ago
- ArcticTraining is a framework designed to simplify and accelerate the post-training process for large language models (LLMs)☆210Updated this week
- ArcticInference: vLLM plugin for high-throughput, low-latency inference☆235Updated last week
- ☆565Updated last year
- ☆468Updated last year
- LLM Serving Performance Evaluation Harness☆79Updated 6 months ago
- Website for hosting the Open Foundation Models Cheat Sheet.☆268Updated 4 months ago
- Fine-tune an LLM to perform batch inference and online serving.☆112Updated 3 months ago
- Project 2 (Building Large Language Models) for Stanford CS324: Understanding and Developing Large Language Models (Winter 2022)☆105Updated 2 years ago