AdrianBZG / LLM-distributed-finetuneLinks
Tune efficiently any LLM model from HuggingFace using distributed training (multiple GPU) and DeepSpeed. Uses Ray AIR to orchestrate the training on multiple AWS GPU instances
☆59Updated 2 years ago
Alternatives and similar repositories for LLM-distributed-finetune
Users that are interested in LLM-distributed-finetune are comparing it to the libraries listed below
Sorting:
- Benchmark suite for LLMs from Fireworks.ai☆80Updated this week
- experiments with inference on llama☆104Updated last year
- Pretrain, finetune and serve LLMs on Intel platforms with Ray☆129Updated 3 weeks ago
- The code for the paper ROUTERBENCH: A Benchmark for Multi-LLM Routing System☆134Updated last year
- 🏋️ A unified multi-backend utility for benchmarking Transformers, Timm, PEFT, Diffusers and Sentence-Transformers with full support of O…☆310Updated 2 weeks ago
- batched loras☆345Updated last year
- ☆58Updated 11 months ago
- ☆121Updated last year
- NeurIPS Large Language Model Efficiency Challenge: 1 LLM + 1GPU + 1Day☆256Updated last year
- 🕹️ Performance Comparison of MLOps Engines, Frameworks, and Languages on Mainstream AI Models.☆137Updated last year
- Ray - A curated list of resources: https://github.com/ray-project/ray☆67Updated 2 months ago
- ReLM is a Regular Expression engine for Language Models☆106Updated 2 years ago
- Manage scalable open LLM inference endpoints in Slurm clusters☆270Updated last year
- ☆467Updated last year
- Experiments on speculative sampling with Llama models☆128Updated 2 years ago
- vLLM: A high-throughput and memory-efficient inference and serving engine for LLMs☆89Updated this week
- ☆55Updated 9 months ago
- Tutorial to get started with SkyPilot!☆58Updated last year
- A high-performance inference system for large language models, designed for production environments.☆463Updated last month
- ☆315Updated last year
- Genai-bench is a powerful benchmark tool designed for comprehensive token-level performance evaluation of large language model (LLM) serv…☆201Updated this week
- Website for hosting the Open Foundation Models Cheat Sheet.☆267Updated 3 months ago
- A high-throughput and memory-efficient inference and serving engine for LLMs☆267Updated 10 months ago
- Project 2 (Building Large Language Models) for Stanford CS324: Understanding and Developing Large Language Models (Winter 2022)☆105Updated 2 years ago
- A set of scripts and notebooks on LLM finetunning and dataset creation☆110Updated 11 months ago
- ArcticTraining is a framework designed to simplify and accelerate the post-training process for large language models (LLMs)☆204Updated this week
- ☆561Updated last year
- A simple service that integrates vLLM with Ray Serve for fast and scalable LLM serving.☆71Updated last year
- Code for the paper "QMoE: Practical Sub-1-Bit Compression of Trillion-Parameter Models".☆277Updated last year
- ArcticInference: vLLM plugin for high-throughput, low-latency inference☆223Updated last week