Tensor parallelism is all you need. Run LLMs on an AI cluster at home using any device. Distribute the workload, divide RAM usage, and increase inference speed.
☆18Nov 11, 2024Updated last year
Alternatives and similar repositories for distributed-llama
Users that are interested in distributed-llama are comparing it to the libraries listed below. We may earn a commission when you buy through links labeled 'Ad' on this page.
Sorting:
- Tries to UI development. Clone of https://www.perplexity.ai/☆11Sep 30, 2023Updated 2 years ago
- ☆14Sep 4, 2024Updated last year
- ☆14Dec 3, 2023Updated 2 years ago
- A proxy that hosts multiple single-model runners such as LLama.cpp and vLLM☆12May 30, 2025Updated last year
- meson android build PoC☆11Oct 29, 2019Updated 6 years ago
- Managed hosting for WordPress and PHP on Cloudways • AdManaged hosting for WordPress, Magento, Laravel, or PHP apps, on multiple cloud providers. Deploy in minutes on Cloudways by DigitalOcean.
- This proof-of-concept script demonstrates how to exploit CVE-2024-4323, a memory corruption vulnerability in Fluent Bit, enabling remote …☆15May 20, 2024Updated 2 years ago
- ☆10Dec 29, 2024Updated last year
- This repository is intended as a comprehensive guide to prepare for interviews focused on generative AI. It serves as a one-stop resource…☆11Dec 13, 2024Updated last year
- ☆10Jun 30, 2022Updated 4 years ago
- Tools for merging pretrained large language models.☆19Jun 12, 2024Updated 2 years ago
- A MetaMask-fork to support pluggable identity contracts.☆11Dec 30, 2022Updated 3 years ago
- Extensions adding the Combine missing parts☆11Oct 12, 2019Updated 6 years ago
- Bloom filter alternative (C++)☆18Nov 8, 2018Updated 7 years ago
- ☆15Mar 3, 2025Updated last year
- Deploy on Railway without the complexity - Free Credits Offer • AdConnect your repo and Railway handles the rest with instant previews. Quickly provision container image services, databases, and storage volumes.
- ☆11Jun 26, 2017Updated 9 years ago
- Gradient-based Hyperparameter Optimization Over Long Horizons☆14Sep 29, 2021Updated 4 years ago
- A fully offline voice assistant that combines lmstudio and applio together. Uses two methods of TTS, STT and also has some extra features…☆23Apr 14, 2025Updated last year
- Minimal, highly available (HA) Kubernetes cluster on Hetzner Cloud — up and running in under 10 minutes.☆11Apr 23, 2026Updated 3 months ago
- Advanced GRAG implementation for ComfyUI with beginner-friendly and expert modes☆19Nov 6, 2025Updated 9 months ago
- Specialized AI agents for your bare metal. 100% On-Prem & Air-Gap ready.☆26Feb 21, 2026Updated 5 months ago
- Simple readonly FUSE driver for FAT filesystems☆12Jan 27, 2016Updated 10 years ago
- Examples of Using DBTunnel☆11Apr 24, 2024Updated 2 years ago
- ☆16Nov 24, 2025Updated 8 months ago
- Deploy on Railway without the complexity - Free Credits Offer • AdConnect your repo and Railway handles the rest with instant previews. Quickly provision container image services, databases, and storage volumes.
- Codebase for VidHal: Benchmarking Hallucinations in Vision LLMs☆14Apr 23, 2026Updated 3 months ago
- A Gentle Introduction to Transformers Neural Network☆15Mar 3, 2024Updated 2 years ago
- XREAL Visual-Inertial Odometry for 6DOF VR☆16Jun 29, 2025Updated last year
- My stack☆26Jul 10, 2025Updated last year
- ansible playbook to create HA kubernetes cluster☆10Jul 25, 2018Updated 8 years ago
- ☆10Jun 24, 2026Updated last month
- Generate High Quality textual or multi-modal datasets with Agents☆18Jun 7, 2023Updated 3 years ago
- ☆19Jul 24, 2025Updated last year
- OpenNNFX a community based open source repository of all things No Nonsense Forex☆20Apr 22, 2023Updated 3 years ago
- Deploy to Railway using AI coding agents - Free Credits Offer • AdUse Claude Code, Codex, OpenCode, and more. Autonomous software development now has the infrastructure to match with Railway.
- fltkc☆13Aug 25, 2013Updated 12 years ago
- A minimal home grid world environment to evaluate language understanding in interactive agents.☆24Sep 6, 2023Updated 2 years ago
- Official implementation of the paper "Distilling a Pretrained Language Model to a Multilingual ASR Model" (Interspeech 2022)☆12Mar 12, 2024Updated 2 years ago
- ☆19Jun 20, 2026Updated last month
- Automate your linkedin networking using an AI agent☆19Jan 21, 2025Updated last year
- Wrapper is an open-source proxy style universal library that can help developers to set up API calls to language models of multiple provi…☆26Nov 10, 2025Updated 9 months ago
- ☆12Jun 2, 2026Updated 2 months ago