Tensor parallelism is all you need. Run LLMs on an AI cluster at home using any device. Distribute the workload, divide RAM usage, and increase inference speed.
☆18Nov 11, 2024Updated last year
Alternatives and similar repositories for distributed-llama
Users that are interested in distributed-llama are comparing it to the libraries listed below. We may earn a commission when you buy through links labeled 'Ad' on this page.
Sorting:
- ☆12Jul 30, 2025Updated last year
- Training HuggingFace models using fastai☆11Jul 22, 2021Updated 5 years ago
- Tries to UI development. Clone of https://www.perplexity.ai/☆11Sep 30, 2023Updated 3 years ago
- Modification of SOMPY repo with robust K-means clustering (bootstrapped SSE elbow method)☆13Apr 6, 2019Updated 7 years ago
- ☆14Sep 4, 2024Updated 2 years ago
- Managed Kubernetes at scale on DigitalOcean • AdDigitalOcean Kubernetes includes the control plane, bandwidth allowance, container registry, automatic updates, and more for free.
- Sent𝕏Ment: Advanced Sentiment Analysis Tool☆13Aug 1, 2023Updated 3 years ago
- ☆16Jun 4, 2026Updated 4 months ago
- 🎥🎯 Tracking dart coordinates with fastai v2☆12Updated this week
- Unofficial Claude Code SDKs for Typescript and Python☆15May 20, 2025Updated last year
- meson android build PoC☆11Oct 29, 2019Updated 6 years ago
- This repository is intended as a comprehensive guide to prepare for interviews focused on generative AI. It serves as a one-stop resource…☆11Dec 13, 2024Updated last year
- Flask based Web application for predicting the income of a person☆13Dec 23, 2018Updated 7 years ago
- Source code for Youtube tutorial series on chest X-ray auto diagnosis☆13Sep 26, 2020Updated 6 years ago
- Bloom filter alternative (C++)☆18Nov 8, 2018Updated 7 years ago
- Virtual machines for every use case on DigitalOcean • AdGet dependable uptime with 99.99% SLA, simple security tools, and predictable monthly pricing with DigitalOcean's virtual machines, called Droplets.
- ☆11Jun 26, 2017Updated 9 years ago
- lossily compress representation vectors using product quantization☆59Oct 28, 2025Updated 11 months ago
- Minimal, highly available (HA) Kubernetes cluster on Hetzner Cloud — up and running in under 10 minutes.☆11Apr 23, 2026Updated 5 months ago
- ☆19May 15, 2023Updated 3 years ago
- Deploy fastai models with Docker☆19Sep 27, 2020Updated 6 years ago
- Examples of Using DBTunnel☆11Apr 24, 2024Updated 2 years ago
- ☆16Nov 24, 2025Updated 10 months ago
- A Gentle Introduction to Transformers Neural Network☆15Mar 3, 2024Updated 2 years ago
- XREAL Visual-Inertial Odometry for 6DOF VR☆16Jun 29, 2025Updated last year
- Managed hosting for WordPress and PHP on Cloudways • AdManaged hosting for WordPress, Magento, Laravel, or PHP apps, on multiple cloud providers. Deploy in minutes on Cloudways by DigitalOcean.
- A LangGraph-based conversational RAG system: Multi-turn retrieval and adaptive query optimization☆17Nov 13, 2025Updated 10 months ago
- ansible playbook to create HA kubernetes cluster☆10Jul 25, 2018Updated 8 years ago
- ☆10Sep 26, 2026Updated 2 weeks ago
- Generate High Quality textual or multi-modal datasets with Agents☆18Jun 7, 2023Updated 3 years ago
- Low-latency ASR using SpeechBrain StreamingASR and torchaudio StreamReader.☆19Apr 19, 2025Updated last year
- Multivariate Bayesian Structural Time Series in Stan☆13Apr 13, 2020Updated 6 years ago
- ☆20May 30, 2025Updated last year
- ☆19Jul 24, 2025Updated last year
- A minimal home grid world environment to evaluate language understanding in interactive agents.☆25Sep 6, 2023Updated 3 years ago
- Deploy on Railway without the complexity - Free Credits Offer • AdConnect your repo and Railway handles the rest with instant previews. Quickly provision container image services, databases, and storage volumes.
- ☆17Mar 20, 2026Updated 6 months ago
- ☆13Oct 16, 2024Updated last year
- Wrapper is an open-source proxy style universal library that can help developers to set up API calls to language models of multiple provi…☆27Nov 10, 2025Updated 11 months ago
- ☆28Apr 5, 2026Updated 6 months ago
- Kubernetes deployment strategies from "DB Schemas & Kubernetes Rollouts" blogpost☆20May 8, 2019Updated 7 years ago
- Professional visualizations of COVID-19, emulating NYT, The Guardian, Washington Post, The Economist & others, using only Python & Altair…☆24Oct 20, 2022Updated 3 years ago
- The ntentional blog - a machine learning journey☆23Oct 20, 2022Updated 3 years ago