Tensor parallelism is all you need. Run LLMs on an AI cluster at home using any device. Distribute the workload, divide RAM usage, and increase inference speed.
☆18Nov 11, 2024Updated last year
Alternatives and similar repositories for distributed-llama
Users that are interested in distributed-llama are comparing it to the libraries listed below. We may earn a commission when you buy through links labeled 'Ad' on this page.
Sorting:
- Specialized fork for (relatively) fast single-GPU inference (in CUDA) using large MoE models that don't fit fully into VRAM☆17May 6, 2026Updated 2 months ago
- Steganography Reverse Shell☆10Apr 22, 2023Updated 3 years ago
- Training HuggingFace models using fastai☆11Jul 22, 2021Updated 5 years ago
- Tries to UI development. Clone of https://www.perplexity.ai/☆11Sep 30, 2023Updated 2 years ago
- ☆15Jan 21, 2024Updated 2 years ago
- Serverless GPU API endpoints on Runpod - Get Bonus Credits • AdSkip the infrastructure headaches. Auto-scaling, pay-as-you-go, no-ops approach lets you focus on innovating your application.
- Modification of SOMPY repo with robust K-means clustering (bootstrapped SSE elbow method)☆13Apr 6, 2019Updated 7 years ago
- 🎥🎯 Tracking dart coordinates with fastai v2☆11Jan 14, 2024Updated 2 years ago
- ☆14Sep 4, 2024Updated last year
- Sent𝕏Ment: Advanced Sentiment Analysis Tool☆13Aug 1, 2023Updated 2 years ago
- ☆14Dec 3, 2023Updated 2 years ago
- Nvidia's leaked code/driver cert☆17Jun 15, 2024Updated 2 years ago
- ☆16Jun 4, 2026Updated last month
- ☆22Jul 13, 2026Updated last week
- A proxy that hosts multiple single-model runners such as LLama.cpp and vLLM☆12May 30, 2025Updated last year
- Wordpress hosting with auto-scaling - Free Trial Offer • AdFully Managed hosting for WordPress and WooCommerce businesses that need reliable, auto-scalable performance. Cloudways SafeUpdates now available.
- Unofficial Claude Code SDKs for Typescript and Python☆15May 20, 2025Updated last year
- This proof-of-concept script demonstrates how to exploit CVE-2024-4323, a memory corruption vulnerability in Fluent Bit, enabling remote …☆15May 20, 2024Updated 2 years ago
- This repository is intended as a comprehensive guide to prepare for interviews focused on generative AI. It serves as a one-stop resource…☆11Dec 13, 2024Updated last year
- Source code for Youtube tutorial series on chest X-ray auto diagnosis☆13Sep 26, 2020Updated 5 years ago
- A MetaMask-fork to support pluggable identity contracts.☆11Dec 30, 2022Updated 3 years ago
- ☆10Sep 11, 2020Updated 5 years ago
- ☆11Jun 26, 2017Updated 9 years ago
- Gradient-based Hyperparameter Optimization Over Long Horizons☆14Sep 29, 2021Updated 4 years ago
- lossily compress representation vectors using product quantization☆59Oct 28, 2025Updated 8 months ago
- Bare Metal GPUs on DigitalOcean Gradient AI • AdPurpose-built for serious AI teams training foundational models, running large-scale inference, and pushing the boundaries of what's possible.
- Specialized AI agents for your bare metal. 100% On-Prem & Air-Gap ready.☆24Feb 21, 2026Updated 5 months ago
- Deploy fastai models with Docker☆19Sep 27, 2020Updated 5 years ago
- One library can make pager slide loop, and add your custom view easier.☆18Jun 9, 2017Updated 9 years ago
- Examples of Using DBTunnel☆11Apr 24, 2024Updated 2 years ago
- ☆16Nov 24, 2025Updated 7 months ago
- Codebase for VidHal: Benchmarking Hallucinations in Vision LLMs☆14Apr 23, 2026Updated 2 months ago
- My stack☆26Jul 10, 2025Updated last year
- Music generation using Elementary Cellular Automata.☆13Nov 23, 2015Updated 10 years ago
- Code and data for editing model beliefs with SDF and other methods, and for evaluating the depth of the implanted beliefs.☆15Oct 23, 2025Updated 8 months ago
- Managed Kubernetes at scale on DigitalOcean • AdDigitalOcean Kubernetes includes the control plane, bandwidth allowance, container registry, automatic updates, and more for free.
- ☆10Jun 24, 2026Updated 3 weeks ago
- Additional functionality for use with fastai’s medical imaging module☆15Jul 20, 2022Updated 4 years ago
- Generate High Quality textual or multi-modal datasets with Agents☆18Jun 7, 2023Updated 3 years ago
- Implementation of venn diagram with Objective C☆11Jul 15, 2016Updated 10 years ago
- ☆20May 30, 2025Updated last year
- Lattice ice40 up5k Raspberry Pi hat designed for using the secondary memory interface (SMI)☆16Nov 11, 2020Updated 5 years ago
- A minimal home grid world environment to evaluate language understanding in interactive agents.☆24Sep 6, 2023Updated 2 years ago