Tune efficiently any LLM model from HuggingFace using distributed training (multiple GPU) and DeepSpeed. Uses Ray AIR to orchestrate the training on multiple AWS GPU instances
☆60Jun 20, 2023Updated 3 years ago
Alternatives and similar repositories for LLM-distributed-finetune
Users that are interested in LLM-distributed-finetune are comparing it to the libraries listed below. We may earn a commission when you buy through links labeled 'Ad' on this page.
Sorting:
- Tracking Ray Enhancement Proposals☆68Updated this week
- Ray - A curated list of resources: https://github.com/ray-project/ray☆83Jun 18, 2026Updated 2 months ago
- RayLLM - LLMs on Ray (Archived). Read README for more info.☆1,261Mar 13, 2025Updated last year
- LightGBM on Ray☆52Feb 4, 2024Updated 2 years ago
- Some microbenchmarks and design docs before commencement☆11Feb 1, 2021Updated 5 years ago
- Deploy on Railway without the complexity - Free Credits Offer • AdConnect your repo and Railway handles the rest with instant previews. Quickly provision container image services, databases, and storage volumes.
- Distributed XGBoost on Ray☆153Jun 25, 2024Updated 2 years ago
- Run CWTools on your Clausewitz mod PDXScript code in parallel to your builds thanks to GitHub Actions.☆16Mar 10, 2023Updated 3 years ago
- ☆16Mar 24, 2026Updated 5 months ago
- ☆11Apr 5, 2021Updated 5 years ago
- Links parts of input text to Wikipedia articles☆15Sep 9, 2012Updated 13 years ago
- Unsupervised fingerprinting of disordered solids leading to analogical materials discovery.☆10Feb 14, 2023Updated 3 years ago
- Dependency Parsing as Sequence Labeling with BERT☆13Nov 1, 2020Updated 5 years ago
- End-to-End Learning from Complex Multigraphs with Latent-Graph Convolutional Networks☆15Jul 25, 2024Updated 2 years ago
- A phase field method for lithium dendrite☆15Oct 19, 2022Updated 3 years ago
- Wordpress hosting with auto-scaling - Free Trial Offer • AdFully Managed hosting for WordPress and WooCommerce businesses that need reliable, auto-scalable performance. Cloudways SafeUpdates now available.
- greptime instrument sdk for popular LLM (LangChain, OpenAI, etc.)☆13May 7, 2024Updated 2 years ago
- ☆12Apr 30, 2024Updated 2 years ago
- Pygloo provides Python bindings for Gloo.☆22Jul 7, 2025Updated last year
- Example of applying CUDA graphs to LLaMA-v2☆11Aug 25, 2023Updated 3 years ago
- Fast GPU based tensor core reductions☆12Jan 13, 2023Updated 3 years ago
- SeqGAN implementation with Tensorflow☆18Jan 14, 2018Updated 8 years ago
- ☆11May 4, 2022Updated 4 years ago
- Source Code for <Target-Side Data Augmentation for Sequence Generation>☆12Oct 6, 2021Updated 4 years ago
- Notebooks for the O'Reilly book "Learning Ray"☆358Apr 25, 2024Updated 2 years ago
- AI Agents on DigitalOcean Gradient AI Platform • AdBuild production-ready AI agents using customizable tools or access multiple LLMs through a single endpoint. Create custom knowledge bases or connect external data.
- setup pytorch on android☆12Mar 2, 2020Updated 6 years ago
- MOOSE Application for simulation of electrodeposition in Li-ion batteries☆24Mar 30, 2022Updated 4 years ago
- Basic library for spatial audio SOFA files☆12Sep 29, 2020Updated 5 years ago
- ☆17Updated this week
- LLCL-MIPS is a superscalar MIPS processor, which supports MIPS Release 1 instructions and is capable of booting linux kernel. （第五届龙芯杯特等奖作…☆41Jan 26, 2022Updated 4 years ago
- Solution verifier for the E-VRPTW☆16Dec 9, 2017Updated 8 years ago
- crumbling large graphs into connected components☆12Jan 8, 2018Updated 8 years ago
- ☆17May 8, 2020Updated 6 years ago
- A Rust-based toolkit for building and packaging DuckDB extensions without Python dependencies.☆16Jul 21, 2026Updated last month
- Wordpress hosting with auto-scaling - Free Trial Offer • AdFully Managed hosting for WordPress and WooCommerce businesses that need reliable, auto-scalable performance. Cloudways SafeUpdates now available.
- IntLLaMA: A fast and light quantization solution for LLaMA☆19Jul 21, 2023Updated 3 years ago
- libevent protobuf rpc☆17Mar 30, 2020Updated 6 years ago
- Inference Llama/Llama2/Llama3 Modes in NumPy☆21Nov 22, 2023Updated 2 years ago
- ☆17Oct 21, 2021Updated 4 years ago
- 🍼 Baby's CoThought: Leveraging LLMs for Enhanced Reasoning in Compact Models [BabyLM Challenge]☆17Jan 10, 2025Updated last year
- Materials for SDM 2023 tutorial: Augmentation Methods for Graph Learning☆21Apr 28, 2023Updated 3 years ago
- A python library that supports all vector databases specifically for LLM apps and frameworks☆13May 3, 2023Updated 3 years ago