wavefy / decentralized-llm-inferenceLinks
☆26Updated 10 months ago
Alternatives and similar repositories for decentralized-llm-inference
Users that are interested in decentralized-llm-inference are comparing it to the libraries listed below
Sorting:
- Private Web Search for Local LLMs☆136Updated 6 months ago
- peer-to-peer compute and intelligence network that enables decentralized AI development at scale☆115Updated last month
- This repository `II-Commons` contains tools for managing text and image datasets, including loading, fetching, and embedding large datase…☆29Updated last month
- The Prime Intellect CLI provides a powerful command-line interface for managing GPU resources across various providers☆68Updated this week
- powerful and fast tool calling agents☆53Updated 5 months ago
- Dria SDK is for building and executing synthetic data generation pipelines on Dria Knowledge Network.☆26Updated 5 months ago
- Fast block-level file diffs (e.g. for VM disk images) using CoW filesystem metadata☆143Updated 2 months ago
- The DPAB-α Benchmark☆29Updated 7 months ago
- Distributed Inference for mlx LLm☆93Updated last year
- Software for running personal agents locally that can interact with personal agents on other devices☆60Updated 5 months ago
- A tree-based prefix cache library that allows rapid creation of looms: hierarchal branching pathways of LLM generations.☆73Updated 6 months ago
- TOPLOC: is a novel method for verifiable inference that enables users to verify that LLM providers are using the correct model configurat…☆40Updated 4 months ago
- Tools, visualizations, and tutorials for massive embedding datasets.☆31Updated 2 years ago
- Coding problems used in aider's polyglot benchmark☆175Updated 8 months ago
- build your own vector database -- the littlest hnsw☆62Updated 7 months ago
- ElizaOS agent powered by Knowledge Graph memories. Based on the ElizaOS plugin enabling integration with the OriginTrail Decentralized Kn…☆36Updated 3 months ago
- Blueprint by Mozilla.ai for answering questions about structured documents☆37Updated 5 months ago
- Augment Swarm with durable execution to help you build reliable and scalable multi-agent systems.☆105Updated 9 months ago
- A decentralized vector database for building vector search applications☆98Updated last year
- A lightweight code assistant with tool-using capabilities built on HuggingFace's smolagents.☆37Updated 2 months ago
- Pivotal Token Search☆123Updated last month
- Rust SDK and CLI for Swarm Framework with Multi-Agent Orchestration☆15Updated 4 months ago
- George is an API leveraging AI to make it easy to control a computer with natural language.☆49Updated 8 months ago
- Asynchronous P2P communication backend for decentralized pipeline parallelism☆34Updated 2 months ago
- ☆169Updated 5 months ago
- A new benchmark for measuring LLM's capability to detect bugs in large codebase.☆31Updated last year
- ☆15Updated last year
- ☆89Updated 11 months ago
- Model Context Protocol (MCP) server for constraint optimization and solving"☆110Updated 2 months ago
- llm plugin for Cerebras fast inference API☆30Updated last month