Tune efficiently any LLM model from HuggingFace using distributed training (multiple GPU) and DeepSpeed. Uses Ray AIR to orchestrate the training on multiple AWS GPU instances
☆60Jun 20, 2023Updated 2 years ago
Alternatives and similar repositories for LLM-distributed-finetune
Users that are interested in LLM-distributed-finetune are comparing it to the libraries listed below. We may earn a commission when you buy through links labeled 'Ad' on this page.
Sorting:
- Ray - A curated list of resources: https://github.com/ray-project/ray☆80Oct 21, 2025Updated 5 months ago
- Tracking Ray Enhancement Proposals☆69Dec 17, 2025Updated 3 months ago
- RayLLM - LLMs on Ray (Archived). Read README for more info.☆1,266Mar 13, 2025Updated last year
- Distributed XGBoost on Ray☆154Jun 25, 2024Updated last year
- LightGBM on Ray☆51Feb 4, 2024Updated 2 years ago
- Wordpress hosting with auto-scaling on Cloudways • AdFully Managed hosting built for WordPress-powered businesses that need reliable, auto-scalable hosting. Cloudways SafeUpdates now available.
- Some microbenchmarks and design docs before commencement☆11Feb 1, 2021Updated 5 years ago
- Multiphysics Object Oriented Simulation Environment In Julia☆17Dec 18, 2016Updated 9 years ago
- ☆11Apr 5, 2021Updated 4 years ago
- Links parts of input text to Wikipedia articles☆16Sep 9, 2012Updated 13 years ago
- ☆11Jun 4, 2021Updated 4 years ago
- Open-source Claude Code agent multiplexer — run dozens of parallel AI coding agents unattended via tmux☆83Mar 21, 2026Updated last week
- Saliency calculation module for Chainer☆12May 28, 2019Updated 6 years ago
- ☆44Sep 6, 2021Updated 4 years ago
- SQLGPT is an advanced SQL query generator powered by natural language processing. Seamlessly transforming plain English queries into comp…☆10Oct 24, 2023Updated 2 years ago
- Managed Kubernetes at scale on DigitalOcean • AdDigitalOcean Kubernetes includes the control plane, bandwidth allowance, container registry, automatic updates, and more for free.
- Language-interfaced fine-tuning for chemistry☆45Nov 30, 2023Updated 2 years ago
- A thin cython wrapper around llama.cpp, whisper.cpp and stable-diffusion.cpp☆18Updated this week
- ☆28May 2, 2023Updated 2 years ago
- libsmctrl论文的复现，添加了python端接口，可以在python端灵活调用接口来分配计算资源☆12May 21, 2024Updated last year
- [SIGMOD'25] Source code for the paper: Debunking the Myth of Join Ordering: Toward Robust SQL Analytics☆21Sep 4, 2025Updated 6 months ago
- Linear-chain LSTM-CRFs and Convolutional CRFs in PyTorch.☆22Aug 11, 2017Updated 8 years ago
- Go bindings for emokit☆11Mar 12, 2014Updated 12 years ago
- ☆20Oct 15, 2023Updated 2 years ago
- Code for the paper: CodeTree: Agent-guided Tree Search for Code Generation with Large Language Models☆31Apr 1, 2025Updated 11 months ago
- Managed hosting for WordPress and PHP on Cloudways • AdManaged hosting with the flexibility to host WordPress, Magento, Laravel, or PHP apps, on multiple cloud providers. Cloudways by DigitalOcean.
- ☆12Apr 30, 2024Updated last year
- Example of applying CUDA graphs to LLaMA-v2☆12Aug 25, 2023Updated 2 years ago
- Seq2act: Mapping Natural Language Instructions to Mobile UI Action Sequences from Google research☆15Jul 13, 2020Updated 5 years ago
- Pygloo provides Python bindings for Gloo.☆22Jul 7, 2025Updated 8 months ago
- NeurIPS 2023 - Cappy: Outperforming and Boosting Large Multi-Task LMs with a Small Scorer☆46Mar 29, 2024Updated last year
- This repository contains the results and code for the MLPerf™ Inference v4.0 benchmark.☆11Jul 24, 2025Updated 8 months ago
- Standalone Flash Attention v2 kernel without libtorch dependency☆112Sep 10, 2024Updated last year
- Flyte Backend Plugins contributed by the Flyte community.☆29Oct 9, 2023Updated 2 years ago
- Injector trait as a webhook to inject data into Workload.☆15Apr 14, 2021Updated 4 years ago
- 1-Click AI Models by DigitalOcean Gradient • AdDeploy popular AI models on DigitalOcean Gradient GPU virtual machines with just a single click and start building anything your business needs.
- Notebooks for the O'Reilly book "Learning Ray"☆345Apr 25, 2024Updated last year
- MPC Server for PySpark inpired by the LakeSail☆17Feb 26, 2026Updated last month
- setup pytorch on android☆12Mar 2, 2020Updated 6 years ago
- socket program to send data with encryption☆13Jun 1, 2021Updated 4 years ago
- WIP. Veloce is a low-code Ray-based parallelization library that makes machine learning computation novel, efficient, and heterogeneous.☆17Aug 4, 2022Updated 3 years ago
- Integration between Lance and Ray for distributed data processing☆24Mar 20, 2026Updated last week
- Basic library for spatial audio SOFA files☆12Sep 29, 2020Updated 5 years ago