Tune efficiently any LLM model from HuggingFace using distributed training (multiple GPU) and DeepSpeed. Uses Ray AIR to orchestrate the training on multiple AWS GPU instances
☆60Jun 20, 2023Updated 3 years ago
Alternatives and similar repositories for LLM-distributed-finetune
Users that are interested in LLM-distributed-finetune are comparing it to the libraries listed below. We may earn a commission when you buy through links labeled 'Ad' on this page.
Sorting:
- Tracking Ray Enhancement Proposals☆68Jun 1, 2026Updated last month
- Ray - A curated list of resources: https://github.com/ray-project/ray☆83Jun 18, 2026Updated last month
- RayLLM - LLMs on Ray (Archived). Read README for more info.☆1,262Mar 13, 2025Updated last year
- LightGBM on Ray☆52Feb 4, 2024Updated 2 years ago
- Distributed XGBoost on Ray☆153Jun 25, 2024Updated 2 years ago
- 1-Click AI Models by DigitalOcean Gradient • AdDeploy popular AI models on DigitalOcean Gradient GPU virtual machines with just a single click. Zero configuration with optimized deployments.
- Run CWTools on your Clausewitz mod PDXScript code in parallel to your builds thanks to GitHub Actions.☆16Mar 10, 2023Updated 3 years ago
- ☆16Mar 24, 2026Updated 4 months ago
- Links parts of input text to Wikipedia articles☆15Sep 9, 2012Updated 13 years ago
- Unsupervised fingerprinting of disordered solids leading to analogical materials discovery.☆10Feb 14, 2023Updated 3 years ago
- ☆11Jun 4, 2021Updated 5 years ago
- ☆43Sep 6, 2021Updated 4 years ago
- End-to-End Learning from Complex Multigraphs with Latent-Graph Convolutional Networks☆15Jul 25, 2024Updated 2 years ago
- ☆14Sep 10, 2024Updated last year
- Distributed Reinforcement Learning for LLM Fine-Tuning with multi-GPU utilization☆22Mar 12, 2025Updated last year
- Managed hosting for WordPress and PHP on Cloudways • AdManaged hosting for WordPress, Magento, Laravel, or PHP apps, on multiple cloud providers. Deploy in minutes on Cloudways by DigitalOcean.
- Language-interfaced fine-tuning for chemistry☆46Nov 30, 2023Updated 2 years ago
- ☆28May 2, 2023Updated 3 years ago
- A pytorch implementation of answer verifier for un-answerable question answering.☆10Jul 26, 2019Updated 7 years ago
- libsmctrl论文的复现，添加了python端接口，可以在python端灵活调用接口来分配计算资源☆12May 21, 2024Updated 2 years ago
- Go bindings for emokit☆11Mar 12, 2014Updated 12 years ago
- Tutorial notebooks for SciFM24☆11Apr 2, 2024Updated 2 years ago
- ☆14Mar 2, 2023Updated 3 years ago
- API Extensions for core KubeVela.☆14Feb 1, 2026Updated 5 months ago
- ☆17Jun 13, 2021Updated 5 years ago
- Managed Database hosting by DigitalOcean • AdPostgreSQL, MySQL, MongoDB, Kafka, Valkey, and OpenSearch available. Automatically scale up storage and focus on building your apps.
- Code for "Error-driven Fixed-Budget ASR Personalization for Accented Speakers" in ICASSP 2021☆11Jun 13, 2021Updated 5 years ago
- Single file interpreter (or naive virtual machine) for my intermediate representation. SSA support has been added.☆15Apr 27, 2016Updated 10 years ago
- Seq2act: Mapping Natural Language Instructions to Mobile UI Action Sequences from Google research☆15Jul 13, 2020Updated 6 years ago
- Transformers at any scale☆42Jan 18, 2024Updated 2 years ago
- Example of applying CUDA graphs to LLaMA-v2☆11Aug 25, 2023Updated 2 years ago
- Standalone Flash Attention v2 kernel without libtorch dependency☆113Sep 10, 2024Updated last year
- Fast GPU based tensor core reductions☆12Jan 13, 2023Updated 3 years ago
- ☆11May 4, 2022Updated 4 years ago
- socket program to send data with encryption☆13Jun 1, 2021Updated 5 years ago
- Proton VPN Special Offer - Get 70% off • AdSpecial partner offer. Trusted by over 100 million users worldwide. Tested, Approved and Recommended by Experts.
- Notebooks for the O'Reilly book "Learning Ray"☆356Apr 25, 2024Updated 2 years ago
- Injector trait as a webhook to inject data into Workload.☆15Apr 14, 2021Updated 5 years ago
- Molecular Crystal Simulation Library (mcse) is an open-source Python package for manipulating and analyzing molecular crystal structures☆15May 30, 2022Updated 4 years ago
- Command-line script for inferencing from models such as LLaMA, in a chat scenario, with LoRA adaptations☆32Jun 1, 2023Updated 3 years ago
- setup pytorch on android☆12Mar 2, 2020Updated 6 years ago
- WIP. Veloce is a low-code Ray-based parallelization library that makes machine learning computation novel, efficient, and heterogeneous.☆17Aug 4, 2022Updated 3 years ago
- Federated Learning - PyTorch☆15Jun 27, 2021Updated 5 years ago