Modded vLLM to run pipeline parallelism over public networks
☆40May 20, 2025Updated 9 months ago
Alternatives and similar repositories for prime-vllm
Users that are interested in prime-vllm are comparing it to the libraries listed below
Sorting:
- Asynchronous P2P communication backend for decentralized pipeline parallelism☆42Jun 9, 2025Updated 8 months ago
- Solidity contracts for the decentralized Prime Network protocol☆26Jul 6, 2025Updated 7 months ago
- Estimate the throughput of OAI compatible servers☆21Feb 20, 2026Updated last week
- Collaborative inference of latent diffusion via hivemind☆12May 29, 2023Updated 2 years ago
- ☆19Nov 5, 2025Updated 3 months ago
- ☆137Mar 20, 2025Updated 11 months ago
- Manage ML configuration with pydantic☆16Updated this week
- Easily benchmark Machine Learning models on selected tasks and datasets☆16May 22, 2023Updated 2 years ago
- Projects from the Succinct ZK Residency☆20Oct 23, 2024Updated last year
- Code for the paper "Secure Distributed Training at Scale" (ICML 2022)☆16Feb 4, 2025Updated last year
- TOPLOC: is a novel method for verifiable inference that enables users to verify that LLM providers are using the correct model configurat…☆52Apr 14, 2025Updated 10 months ago
- Uniswap V4 Vanity Miner☆30May 31, 2025Updated 9 months ago
- Gradients on demand☆33Updated this week
- MNIST image classification neural network implemented entirely on the EVM☆29Mar 8, 2025Updated 11 months ago
- Pending transaction stream in rust☆27May 31, 2021Updated 4 years ago
- OpenDiLoCo: An Open-Source Framework for Globally Distributed Low-Communication Training☆562Jan 13, 2025Updated last year
- ☆31Nov 14, 2024Updated last year
- Body horror fulfilment center simulator☆25Sep 29, 2024Updated last year
- Data & code accompanying Paradigm's How to Raise the Gas Limit post.☆32Mar 4, 2024Updated 2 years ago
- Core infrastructure for confidential computing AI inference☆35Dec 1, 2025Updated 3 months ago
- never forget anything again! combine AI and intelligent tooling for a local knowledge base to track catalogue, annotate, and plan for you…☆37May 14, 2024Updated last year
- Zero-Knowledge University☆34Aug 14, 2024Updated last year
- Using folding schemes for a provable bitcoin light client☆34May 22, 2024Updated last year
- Hyper-parallel ZK coprocessing.☆17Aug 29, 2025Updated 6 months ago
- Minimal example of MCP for parsing llms.txt☆40Apr 8, 2025Updated 10 months ago
- A collection of the Vietnam Spring ZK Residency effort of the ZKWasm team☆36Apr 6, 2023Updated 2 years ago
- prime is a framework for efficient, globally distributed training of AI models over the internet.☆851Nov 16, 2025Updated 3 months ago
- Check for data drift between two OpenAI multi-turn chat jsonl files.☆39Apr 11, 2024Updated last year
- Cookiecutter template for making a cog for Red.☆12Jun 18, 2024Updated last year
- Extract streaming data from text using prefix completion.☆10Oct 6, 2024Updated last year
- ☆10Aug 26, 2021Updated 4 years ago
- Digital SuperTwin: digital twin of supercomputers☆13Nov 24, 2024Updated last year
- zkSnark circuit compiler☆12Feb 19, 2026Updated last week
- A Library for Scaling Mixed-Integer Optimization-Based Machine Learning.☆12Jun 24, 2024Updated last year
- MCP server for Google search and page fetching using headless Chromium☆67Feb 21, 2026Updated last week
- Cairo-VM STONE STARK Verifier Rust implementation☆43Feb 4, 2025Updated last year
- an autonomous independent digital companion☆14Feb 12, 2026Updated 2 weeks ago
- A Redis-compatible in-memory database server written in Rust with MLua-based Lua 5.1 scripting☆17Nov 28, 2025Updated 3 months ago
- Discord Docsbot, Built on bgent☆11Jun 17, 2024Updated last year