Tune efficiently any LLM model from HuggingFace using distributed training (multiple GPU) and DeepSpeed. Uses Ray AIR to orchestrate the training on multiple AWS GPU instances
☆60Jun 20, 2023Updated 2 years ago
Alternatives and similar repositories for LLM-distributed-finetune
Users that are interested in LLM-distributed-finetune are comparing it to the libraries listed below. We may earn a commission when you buy through links labeled 'Ad' on this page.
Sorting:
- Ray - A curated list of resources: https://github.com/ray-project/ray☆82Oct 21, 2025Updated 7 months ago
- ☆25Jan 2, 2023Updated 3 years ago
- RayLLM - LLMs on Ray (Archived). Read README for more info.☆1,266Mar 13, 2025Updated last year
- Distributed XGBoost on Ray☆153Jun 25, 2024Updated last year
- Some microbenchmarks and design docs before commencement☆11Feb 1, 2021Updated 5 years ago
- GPUs on demand by Runpod - Special Offer Available • AdRun AI, ML, and HPC workloads on powerful cloud GPUs—without limits or wasted spend. Deploy GPUs in under a minute and pay by the second.
- ☆11Aug 2, 2022Updated 3 years ago
- LightGBM on Ray☆52Feb 4, 2024Updated 2 years ago
- A sophisticated trading system leveraging local LLM deployment through Ollama, distributed computing with Apache Spark, and vector-based …☆16Feb 3, 2025Updated last year
- ☆11Apr 5, 2021Updated 5 years ago
- Notebooks for the ValleyML Bootcamp (Aug 2019) "Statistical methods for data science"☆10Aug 30, 2019Updated 6 years ago
- ☆11Apr 21, 2023Updated 3 years ago
- PostgreSQL BM25S extension☆140May 14, 2026Updated last month
- Links parts of input text to Wikipedia articles☆16Sep 9, 2012Updated 13 years ago
- ☆43Sep 6, 2021Updated 4 years ago
- Deploy to Railway using AI coding agents - Free Credits Offer • AdUse Claude Code, Codex, OpenCode, and more. Autonomous software development now has the infrastructure to match with Railway.
- ☆28May 2, 2023Updated 3 years ago
- greptime instrument sdk for popular LLM (LangChain, OpenAI, etc.)☆13May 7, 2024Updated 2 years ago
- A pytorch implementation of answer verifier for un-answerable question answering.☆10Jul 26, 2019Updated 6 years ago
- Linear-chain LSTM-CRFs and Convolutional CRFs in PyTorch.☆22Aug 11, 2017Updated 8 years ago
- TextGraphs + LLMs + graph ML for entity extraction, linking, ranking, and constructing a lemma graph☆25Feb 24, 2024Updated 2 years ago
- Code for the paper: CodeTree: Agent-guided Tree Search for Code Generation with Large Language Models☆35Jun 2, 2026Updated 2 weeks ago
- Example of applying CUDA graphs to LLaMA-v2☆11Aug 25, 2023Updated 2 years ago
- ☆17Jun 13, 2021Updated 5 years ago
- Seq2act: Mapping Natural Language Instructions to Mobile UI Action Sequences from Google research☆15Jul 13, 2020Updated 5 years ago
- Managed Database hosting by DigitalOcean • AdPostgreSQL, MySQL, MongoDB, Kafka, Valkey, and OpenSearch available. Automatically scale up storage and focus on building your apps.
- Pygloo provides Python bindings for Gloo.☆22Jul 7, 2025Updated 11 months ago
- 网络安全课程作业收集☆15May 3, 2018Updated 8 years ago
- Python Bash emulation for agents, a port of vercel-labs/just-bash☆55Jun 4, 2026Updated 2 weeks ago
- Repo for the Complete Agentic AI Engineering Course☆19May 16, 2025Updated last year
- DEPRECATED: Use provider-jet-equinix☆16Feb 16, 2024Updated 2 years ago
- Fast GPU based tensor core reductions☆13Jan 13, 2023Updated 3 years ago
- Standalone Flash Attention v2 kernel without libtorch dependency☆113Sep 10, 2024Updated last year
- ☆11May 4, 2022Updated 4 years ago
- ☆13May 24, 2021Updated 5 years ago
- Serverless GPU API endpoints on Runpod - Get Bonus Credits • AdSkip the infrastructure headaches. Auto-scaling, pay-as-you-go, no-ops approach lets you focus on innovating your application.
- ☆15Nov 24, 2018Updated 7 years ago
- SeqGAN implementation with Tensorflow☆18Jan 14, 2018Updated 8 years ago
- Flyte Backend Plugins contributed by the Flyte community.☆29Oct 9, 2023Updated 2 years ago
- Notebooks for the O'Reilly book "Learning Ray"☆354Apr 25, 2024Updated 2 years ago
- socket program to send data with encryption☆13Jun 1, 2021Updated 5 years ago
- LLCL-MIPS is a superscalar MIPS processor, which supports MIPS Release 1 instructions and is capable of booting linux kernel. （第五届龙芯杯特等奖作…☆41Jan 26, 2022Updated 4 years ago
- Code for our EMNLP-2023 paper: "Active Instruction Tuning: Improving Cross-Task Generalization by Training on Prompt Sensitive Tasks"☆26Nov 16, 2023Updated 2 years ago