Tune efficiently any LLM model from HuggingFace using distributed training (multiple GPU) and DeepSpeed. Uses Ray AIR to orchestrate the training on multiple AWS GPU instances
☆60Jun 20, 2023Updated 2 years ago
Alternatives and similar repositories for LLM-distributed-finetune
Users that are interested in LLM-distributed-finetune are comparing it to the libraries listed below. We may earn a commission when you buy through links labeled 'Ad' on this page.
Sorting:
- Ray - A curated list of resources: https://github.com/ray-project/ray☆81Oct 21, 2025Updated 6 months ago
- ☆25Jan 2, 2023Updated 3 years ago
- ☆29Dec 15, 2025Updated 4 months ago
- RayLLM - LLMs on Ray (Archived). Read README for more info.☆1,267Mar 13, 2025Updated last year
- Training Recipes for Agentic Reinforcement Learning in LLMs: A Survey☆30Jan 30, 2026Updated 3 months ago
- Wordpress hosting with auto-scaling - Free Trial Offer • AdFully Managed hosting for WordPress and WooCommerce businesses that need reliable, auto-scalable performance. Cloudways SafeUpdates now available.
- Code for SpaceSalmon Flight Computer☆13Jan 11, 2024Updated 2 years ago
- Some microbenchmarks and design docs before commencement☆11Feb 1, 2021Updated 5 years ago
- LightGBM on Ray☆52Feb 4, 2024Updated 2 years ago
- Do we need rebalancing strategies? A theoretical and empirical study around SMOTE and its variants (Sakho, Malherbe and Scornet; 2024)☆11Sep 2, 2025Updated 8 months ago
- Multiphysics Object Oriented Simulation Environment In Julia☆17Dec 18, 2016Updated 9 years ago
- all my notes in one place☆12Mar 29, 2026Updated last month
- A phase field method for lithium dendrite☆12Oct 19, 2022Updated 3 years ago
- Unsupervised fingerprinting of disordered solids leading to analogical materials discovery.☆10Feb 14, 2023Updated 3 years ago
- Links parts of input text to Wikipedia articles☆16Sep 9, 2012Updated 13 years ago
- AI Agents on DigitalOcean Gradient AI Platform • AdBuild production-ready AI agents using customizable tools or access multiple LLMs through a single endpoint. Create custom knowledge bases or connect external data.
- ☆11Jun 4, 2021Updated 4 years ago
- End-to-End Learning from Complex Multigraphs with Latent-Graph Convolutional Networks☆15Jul 25, 2024Updated last year
- Distributed Reinforcement Learning for LLM Fine-Tuning with multi-GPU utilization☆22Mar 12, 2025Updated last year
- Language-interfaced fine-tuning for chemistry☆45Nov 30, 2023Updated 2 years ago
- A thin cython wrapper around llama.cpp, whisper.cpp and stable-diffusion.cpp☆25Updated this week
- ☆28May 2, 2023Updated 3 years ago
- greptime instrument sdk for popular LLM (LangChain, OpenAI, etc.)☆13May 7, 2024Updated 2 years ago
- libsmctrl论文的复现，添加了python端接口，可以在python端灵活调用接口来分配计算资源☆12May 21, 2024Updated last year
- Multi-agent simulator in Jax for research and teaching in AI & ALife☆31Apr 11, 2026Updated 3 weeks ago
- Deploy to Railway using AI coding agents - Free Credits Offer • AdUse Claude Code, Codex, OpenCode, and more. Autonomous software development now has the infrastructure to match with Railway.
- A pytorch implementation of answer verifier for un-answerable question answering.☆10Jul 26, 2019Updated 6 years ago
- [SIGMOD'25] Source code for the paper: Debunking the Myth of Join Ordering: Toward Robust SQL Analytics☆21Sep 4, 2025Updated 8 months ago
- ☆20Oct 15, 2023Updated 2 years ago
- Batch Multi-Fidelity Bayesian Optimization with Deep Auto-Regressive Networks☆12Nov 3, 2021Updated 4 years ago
- ☆19Feb 25, 2026Updated 2 months ago
- TextGraphs + LLMs + graph ML for entity extraction, linking, ranking, and constructing a lemma graph☆25Feb 24, 2024Updated 2 years ago
- ☆12Apr 30, 2024Updated 2 years ago
- Code for the paper: CodeTree: Agent-guided Tree Search for Code Generation with Large Language Models☆34Apr 1, 2025Updated last year
- SAMD51 Interrupt Timer library for e.g. Adafruit M4 Metro/Feather/ItsyBitsy Express☆26Jul 19, 2022Updated 3 years ago
- Wordpress hosting with auto-scaling - Free Trial Offer • AdFully Managed hosting for WordPress and WooCommerce businesses that need reliable, auto-scalable performance. Cloudways SafeUpdates now available.
- Single file interpreter (or naive virtual machine) for my intermediate representation. SSA support has been added.☆15Apr 27, 2016Updated 10 years ago
- Pygloo provides Python bindings for Gloo.☆22Jul 7, 2025Updated 10 months ago
- NeurIPS 2023 - Cappy: Outperforming and Boosting Large Multi-Task LMs with a Small Scorer☆48Mar 29, 2024Updated 2 years ago
- Standalone Flash Attention v2 kernel without libtorch dependency☆113Sep 10, 2024Updated last year
- ☆11May 4, 2022Updated 4 years ago
- Source Code for <Target-Side Data Augmentation for Sequence Generation>☆12Oct 6, 2021Updated 4 years ago
- SeqGAN implementation with Tensorflow☆18Jan 14, 2018Updated 8 years ago