AdrianBZG / LLM-distributed-finetuneLinks
Tune efficiently any LLM model from HuggingFace using distributed training (multiple GPU) and DeepSpeed. Uses Ray AIR to orchestrate the training on multiple AWS GPU instances
☆59Updated 2 years ago
Alternatives and similar repositories for LLM-distributed-finetune
Users that are interested in LLM-distributed-finetune are comparing it to the libraries listed below
Sorting:
- Pretrain, finetune and serve LLMs on Intel platforms with Ray☆131Updated last month
- Benchmark suite for LLMs from Fireworks.ai☆82Updated last week
- experiments with inference on llama☆103Updated last year
- ☆121Updated last year
- 🏋️ A unified multi-backend utility for benchmarking Transformers, Timm, PEFT, Diffusers and Sentence-Transformers with full support of O…☆318Updated last month
- ☆58Updated last year
- ArcticTraining is a framework designed to simplify and accelerate the post-training process for large language models (LLMs)☆231Updated last week
- NeurIPS Large Language Model Efficiency Challenge: 1 LLM + 1GPU + 1Day☆256Updated 2 years ago
- The code for the paper ROUTERBENCH: A Benchmark for Multi-LLM Routing System☆145Updated last year
- vLLM: A high-throughput and memory-efficient inference and serving engine for LLMs☆90Updated this week
- Experiments on speculative sampling with Llama models☆125Updated 2 years ago
- Manage scalable open LLM inference endpoints in Slurm clusters☆273Updated last year
- batched loras☆346Updated 2 years ago
- ☆56Updated 11 months ago
- ArcticInference: vLLM plugin for high-throughput, low-latency inference☆283Updated last week
- Ray - A curated list of resources: https://github.com/ray-project/ray☆70Updated last week
- A high-throughput and memory-efficient inference and serving engine for LLMs☆266Updated last year
- 🚀 Collection of components for development, training, tuning, and inference of foundation models leveraging PyTorch native components.☆215Updated this week
- This is suite of the hands-on training materials that shows how to scale CV, NLP, time-series forecasting workloads with Ray.☆435Updated last year
- LLM Serving Performance Evaluation Harness☆79Updated 8 months ago
- Project 2 (Building Large Language Models) for Stanford CS324: Understanding and Developing Large Language Models (Winter 2022)☆105Updated 2 years ago
- Tutorial to get started with SkyPilot!☆57Updated last year
- 🕹️ Performance Comparison of MLOps Engines, Frameworks, and Languages on Mainstream AI Models.☆140Updated last year
- Data preparation code for Amber 7B LLM☆93Updated last year
- A high-performance inference system for large language models, designed for production environments.☆479Updated 2 weeks ago
- Easy and Efficient Quantization for Transformers☆202Updated 4 months ago
- ☆572Updated last year
- IBM development fork of https://github.com/huggingface/text-generation-inference☆61Updated last month
- Code for the paper "QMoE: Practical Sub-1-Bit Compression of Trillion-Parameter Models".☆277Updated last year
- ☆224Updated last week