Tensor parallelism is all you need. Run LLMs on an AI cluster at home using any device. Distribute the workload, divide RAM usage, and increase inference speed.
☆18Nov 11, 2024Updated 2 years ago
Alternatives and similar repositories for distributed-llama
Users that are interested in distributed-llama are comparing it to the libraries listed below. We may earn a commission when you buy through links labeled 'Ad' on this page.
Sorting:
- glm-5.2 on too many 64 / 80 GB A100's☆22Sep 9, 2026Updated 2 months ago
- A cmpunlocker fork with working p2p on SYS-4028GR-TRT2☆27Aug 8, 2026Updated 3 months ago
- 限制问题区域显存 62906MiB / 65024MiB 支持驱动 610.57.04 ,修改显卡显示名称为NVIDIA Tesla A100☆12Aug 30, 2026Updated 2 months ago
- Demonstrate a method to run a Python script from an IBMi RPGLE program. This example uses Python (launched by RPG) to create basic file d…☆10Dec 8, 2022Updated 3 years ago
- You only ReBoot once - A USB less ISO/IMG etc. bootloader based on ventoy☆18Updated this week
- Managed Kubernetes at scale on DigitalOcean • AdDigitalOcean Kubernetes includes the control plane, bandwidth allowance, container registry, automatic updates, and more for free.
- Verified multi-source distribution for local LLM weights☆18Nov 4, 2026Updated 2 weeks ago
- Gen 2 Prius (NHW20) Battery ECU on ZombieVerter VCU V1.3☆10Sep 29, 2026Updated last month
- ☆16Sep 29, 2026Updated last month
- This repository serves as a comprehensive collection of code examples, research papers, and practical resources from my Generative AI (Ge…☆12Oct 14, 2026Updated last month
- LLM inference in C/C++☆30Sep 25, 2026Updated last month
- Agnost GitOps Helm charts☆13Dec 9, 2025Updated 11 months ago
- contents of aicwiki.com☆13Updated this week
- GPUDirect Storage (GDS) for the NVIDIA CMP 170HX on modern Linux kernels (6.18+). nvidia-fs NVMe registration hooks for the new blk_rq_dm…☆19Aug 19, 2026Updated 3 months ago
- Evaluation metrics for TTS model.☆12Feb 16, 2025Updated last year
- Proton VPN Special Offer - Get 70% off • AdSpecial partner offer. Trusted by over 100 million users worldwide. Tested, Approved and Recommended by Experts.
- Distillation pipeline from pretrained Transformers to customized FLA models☆13Aug 4, 2025Updated last year
- Tiny vi-like text editor in only 100 lines of C++ code!☆14Aug 12, 2022Updated 4 years ago
- A proxy that hosts multiple single-model runners such as LLama.cpp and vLLM☆12May 30, 2025Updated last year
- Chat GPT Things by Taylor Newsome☆14Mar 19, 2024Updated 2 years ago
- qaxe bitcoin miner☆16Jun 11, 2026Updated 5 months ago
- A disitributed implementation of alphafold3 base on xfold and tpp-pytorch-extension☆11Mar 26, 2026Updated 7 months ago
- A research codebase for Fock-space variational Monte Carlo☆14Aug 25, 2026Updated 2 months ago
- Handle Android "draw over other apps" permissions and queries in a version-agnostic way☆22Jun 17, 2019Updated 7 years ago
- Tries to UI development. Clone of https://www.perplexity.ai/☆11Sep 30, 2023Updated 3 years ago
- Deploy to Railway using AI coding agents - Free Credits Offer • AdUse Claude Code, Codex, OpenCode, and more. Autonomous software development now has the infrastructure to match with Railway.
- Scripts to setup a two-node llama.cpp cluster on NVIDIA DGX Spark (GB10) hardware.☆12May 10, 2026Updated 6 months ago
- This repository is intended as a comprehensive guide to prepare for interviews focused on generative AI. It serves as a one-stop resource…☆11Dec 13, 2024Updated last year
- ☆14Dec 3, 2023Updated 2 years ago
- ☆10Jun 30, 2022Updated 4 years ago
- Unofficial Claude Code SDKs for Typescript and Python☆15May 20, 2025Updated last year
- ☆16Jun 4, 2026Updated 5 months ago
- ☆15Mar 3, 2025Updated last year
- ☆10Sep 11, 2020Updated 6 years ago
- ☆10Dec 29, 2024Updated last year
- AI Agents on DigitalOcean Gradient AI Platform • AdBuild production-ready AI agents using customizable tools or access multiple LLMs through a single endpoint. Create custom knowledge bases or connect external data.
- Qwen3.8-Flash-Next-FP8 (official checkpoint) on 3x/4x CMP170HX / PP=4 / MTP-4☆12Updated this week
- ☆14Sep 4, 2024Updated 2 years ago
- AMD PACE is a PyTorch extension for high-performance LLM inference on AMD CPUs. It provides a framework to develop and test novel optimiz…☆18Oct 21, 2026Updated 3 weeks ago
- GEMMs with metal☆27Nov 1, 2026Updated 2 weeks ago
- CMP 170HX technical wiki: silicon, firmware, the community unlock, procedures and open problems. 55 pages.☆80Aug 22, 2026Updated 2 months ago
- Tools for merging pretrained large language models.☆19Jun 12, 2024Updated 2 years ago
- A JSON list of german words + info☆12Mar 22, 2026Updated 7 months ago
Are these results useful?