AdrianBZG / LLM-distributed-finetuneView external linksLinks
Tune efficiently any LLM model from HuggingFace using distributed training (multiple GPU) and DeepSpeed. Uses Ray AIR to orchestrate the training on multiple AWS GPU instances
☆60Jun 20, 2023Updated 2 years ago
Alternatives and similar repositories for LLM-distributed-finetune
Users that are interested in LLM-distributed-finetune are comparing it to the libraries listed below
Sorting:
- Ray - A curated list of resources: https://github.com/ray-project/ray☆78Oct 21, 2025Updated 3 months ago
- Zenoh Flow examples☆18Aug 22, 2023Updated 2 years ago
- Distributed XGBoost on Ray☆152Jun 25, 2024Updated last year
- ☆25Jan 2, 2023Updated 3 years ago
- ☆44Sep 6, 2021Updated 4 years ago
- TextGraphs + LLMs + graph ML for entity extraction, linking, ranking, and constructing a lemma graph☆25Feb 24, 2024Updated last year
- RayLLM - LLMs on Ray (Archived). Read README for more info.☆1,263Mar 13, 2025Updated 11 months ago
- Tracking Ray Enhancement Proposals☆63Dec 17, 2025Updated last month
- Solana Airdrop Faucet: A simple web application that allows users to receive free SOL tokens on the Solana Devnet. Built with Next.js, th…☆11Sep 22, 2024Updated last year
- (ICLR 2026) Optimas: Optimizing Compound AI Systems☆68Feb 6, 2026Updated last week
- Asynchronous pipeline parallel optimization☆19Feb 2, 2026Updated last week
- openASO is a project designed to identify regulatory regions of an RNA that can be targeted by antisense oligonucleotides.☆10Sep 30, 2021Updated 4 years ago
- 🧠 A sample app to integrate react-native and open ai☆11Jan 1, 2023Updated 3 years ago
- Chaucha functions for usage with Github Actions☆11Sep 18, 2020Updated 5 years ago
- Go SDK for the Bare Metal Cloud API☆14Dec 20, 2025Updated last month
- ☆30Aug 31, 2022Updated 3 years ago
- Symphony — A decentralized multi-agent framework that enables intelligent agents to collaborate seamlessly across heterogeneous edge devi…☆30Oct 30, 2025Updated 3 months ago
- Kunlun-storage is the storage component for Kunlun distributed DBMS. It's developed based on percona-mysql-8.0.x and contains exclusive f…☆32Apr 11, 2022Updated 3 years ago
- Angular Frontend for the Spring Boot Microservices series☆13Jun 9, 2024Updated last year
- Some microbenchmarks and design docs before commencement☆12Feb 1, 2021Updated 5 years ago
- Subnet 22☆56Jan 15, 2026Updated 3 weeks ago
- This software uses a config file (config.py), which is a settings file, to build and run SWAT+ models. Users can share the config along w…☆16Mar 9, 2022Updated 3 years ago
- [ICDCS 2023] Evaluation and Optimization of Gradient Compression for Distributed Deep Learning☆10Apr 28, 2023Updated 2 years ago
- A simple camera board using GMAX3412 1" 4K@30fps global shutter sensor☆18Dec 21, 2025Updated last month
- Run very cheap game servers (Minecraft, LinuxGSM, etc) in AWS EC2 Spot instances controlled by Discord slash commands. Manage using Terra…☆13Aug 6, 2025Updated 6 months ago
- This GitHub repository contains a project that automates the provisioning of a Kubernetes (K8s) cluster using Infrastructure as Code (IaC…☆15Oct 19, 2025Updated 3 months ago
- A benchmark for generic, large-scale shuffle operations on continuous stream of data, implemented with state-of-the-art stream processing…☆14Updated this week
- プログラミング de 落書きで公開しているコードを共有します☆23Updated this week
- ☆10Dec 24, 2021Updated 4 years ago
- Website for www.ambitionfund.org, micro-grant program to provide support for underrepresented people who need financial assistance pursui…☆13Jan 6, 2023Updated 3 years ago
- ☆13Nov 5, 2024Updated last year
- A distributed stream querying engine that provides sub-millisecond stateful query at millions of queries per-second over fast-evolving li…☆10Jul 18, 2018Updated 7 years ago
- Extract annotated misspellings from MIMIC-III.☆13Dec 17, 2020Updated 5 years ago
- Create immutable infrastructure with IaC technologies at AWS with Terraform and Serverless Framework ☁️ The main services used are Dynamo…☆10Jan 3, 2021Updated 5 years ago
- ☆14Oct 5, 2024Updated last year
- Is using KoP (Kafka-On-Pulsar) a good idea? Use the scenarios implemented in this repository to check whether Pulsar with KoP enabled is …☆12Nov 3, 2022Updated 3 years ago
- This project is used to automatically grab the query results of ChatGPT in batches without manual input. And it supports automatic switch…☆14Feb 28, 2023Updated 2 years ago
- [ACL 2024] RelayAttention for Efficient Large Language Model Serving with Long System Prompts☆40Feb 29, 2024Updated last year
- Example repo to kickstart integration with mlflow recipes.☆46Aug 1, 2025Updated 6 months ago