Tune efficiently any LLM model from HuggingFace using distributed training (multiple GPU) and DeepSpeed. Uses Ray AIR to orchestrate the training on multiple AWS GPU instances
☆60Jun 20, 2023Updated 2 years ago
Alternatives and similar repositories for LLM-distributed-finetune
Users that are interested in LLM-distributed-finetune are comparing it to the libraries listed below. We may earn a commission when you buy through links labeled 'Ad' on this page.
Sorting:
- Ray - A curated list of resources: https://github.com/ray-project/ray☆80Oct 21, 2025Updated 5 months ago
- Tracking Ray Enhancement Proposals☆69Dec 17, 2025Updated 3 months ago
- ☆29Dec 15, 2025Updated 3 months ago
- RayLLM - LLMs on Ray (Archived). Read README for more info.☆1,266Mar 13, 2025Updated last year
- Distributed XGBoost on Ray☆154Jun 25, 2024Updated last year
- Managed hosting for WordPress and PHP on Cloudways • AdManaged hosting with the flexibility to host WordPress, Magento, Laravel, or PHP apps, on multiple cloud providers. Cloudways by DigitalOcean.
- LightGBM on Ray☆51Feb 4, 2024Updated 2 years ago
- Some microbenchmarks and design docs before commencement☆11Feb 1, 2021Updated 5 years ago
- ☆18Mar 28, 2023Updated 2 years ago
- ☆11Apr 5, 2021Updated 4 years ago
- all my notes in one place☆12Sep 18, 2025Updated 6 months ago
- Links parts of input text to Wikipedia articles☆16Sep 9, 2012Updated 13 years ago
- ☆44Sep 6, 2021Updated 4 years ago
- End-to-End Learning from Complex Multigraphs with Latent-Graph Convolutional Networks☆15Jul 25, 2024Updated last year
- Distributed Reinforcement Learning for LLM Fine-Tuning with multi-GPU utilization☆22Mar 12, 2025Updated last year
- 1-Click AI Models by DigitalOcean Gradient • AdDeploy popular AI models on DigitalOcean Gradient GPU virtual machines with just a single click and start building anything your business needs.
- A thin cython wrapper around llama.cpp, whisper.cpp and stable-diffusion.cpp☆18Updated this week
- Repository for the view as html feature☆33Mar 4, 2026Updated 3 weeks ago
- libsmctrl论文的复现，添加了python端接口，可以在python端灵活调用接口来分配计算资源☆12May 21, 2024Updated last year
- [SIGMOD'25] Source code for the paper: Debunking the Myth of Join Ordering: Toward Robust SQL Analytics☆21Sep 4, 2025Updated 6 months ago
- A pytorch implementation of answer verifier for un-answerable question answering.☆10Jul 26, 2019Updated 6 years ago
- [ACL'21 Findings] Why Machine Reading Comprehension Models Learn Shortcuts?☆16Aug 8, 2023Updated 2 years ago
- ☆16Feb 25, 2026Updated last month
- TextGraphs + LLMs + graph ML for entity extraction, linking, ranking, and constructing a lemma graph☆25Feb 24, 2024Updated 2 years ago
- a fast implementation of BM25☆10Sep 15, 2022Updated 3 years ago
- NordVPN Threat Protection Pro™ • AdTake your cybersecurity to the next level. Block phishing, malware, trackers, and ads. Lightweight app that works with all browsers.
- Code for the paper: CodeTree: Agent-guided Tree Search for Code Generation with Large Language Models☆32Apr 1, 2025Updated 11 months ago
- Example of applying CUDA graphs to LLaMA-v2☆12Aug 25, 2023Updated 2 years ago
- SAMD51 Interrupt Timer library for e.g. Adafruit M4 Metro/Feather/ItsyBitsy Express☆26Jul 19, 2022Updated 3 years ago
- Seq2act: Mapping Natural Language Instructions to Mobile UI Action Sequences from Google research☆15Jul 13, 2020Updated 5 years ago
- NeurIPS 2023 - Cappy: Outperforming and Boosting Large Multi-Task LMs with a Small Scorer☆46Mar 29, 2024Updated last year
- DEPRECATED: Use provider-jet-equinix☆16Feb 16, 2024Updated 2 years ago
- ☆11May 4, 2022Updated 3 years ago
- Transformers at any scale☆42Jan 18, 2024Updated 2 years ago
- ☆15Nov 24, 2018Updated 7 years ago
- Managed Database hosting by DigitalOcean • AdPostgreSQL, MySQL, MongoDB, Kafka, Valkey, and OpenSearch available. Automatically scale up storage and focus on building your apps.
- MPC Server for PySpark inpired by the LakeSail☆17Feb 26, 2026Updated last month
- setup pytorch on android☆12Mar 2, 2020Updated 6 years ago
- WIP. Veloce is a low-code Ray-based parallelization library that makes machine learning computation novel, efficient, and heterogeneous.☆17Aug 4, 2022Updated 3 years ago
- Code for our EMNLP-2023 paper: "Active Instruction Tuning: Improving Cross-Task Generalization by Training on Prompt Sensitive Tasks"☆25Nov 16, 2023Updated 2 years ago
- Integration between Lance and Ray for distributed data processing☆25Updated this week
- LLCL-MIPS is a superscalar MIPS processor, which supports MIPS Release 1 instructions and is capable of booting linux kernel. （第五届龙芯杯特等奖作…☆38Jan 26, 2022Updated 4 years ago
- Basic library for spatial audio SOFA files☆12Sep 29, 2020Updated 5 years ago