PrimeIntellect-ai / prime-vllm
Modded vLLM to run pipeline parallelism over public networks
☆25Updated this week
Alternatives and similar repositories for prime-vllm:
Users that are interested in prime-vllm are comparing it to the libraries listed below
- Solidity contracts for the decentralized Prime Network protocol☆19Updated 2 weeks ago
- TOPLOC: is a novel method for verifiable inference that enables users to verify that LLM providers are using the correct model configurat…☆24Updated 3 weeks ago
- prime-rl is a codebase for decentralized RL training at scale☆85Updated this week
- Asynchronous P2P communication backend for decentralized pipeline parallelism☆18Updated this week
- Optimizing Causal LMs through GRPO with weighted reward functions and automated hyperparameter tuning using Optuna☆39Updated 3 months ago
- ☆27Updated 9 months ago
- ☆38Updated 9 months ago
- ☆48Updated last year
- Grokking on modular arithmetic in less than 150 epochs in MLX☆12Updated 6 months ago
- an open source reproduction of NVIDIA's nGPT (Normalized Transformer with Representation Learning on the Hypersphere)☆98Updated last month
- C99-compatible library for efficiently parking threads on all major operating systems☆11Updated last month
- Sparse autoencoders for Contra text embedding models☆25Updated last year
- Synthetic data derived by templating, few shot prompting, transformations on public domain corpora, and monte carlo tree search.☆32Updated 2 months ago
- ☆18Updated 4 months ago
- ☆13Updated 10 months ago
- Simplex Random Feature attention, in PyTorch☆74Updated last year
- look how they massacred my boy☆63Updated 6 months ago
- NanoGPT (124M) quality in 2.67B tokens☆28Updated 2 weeks ago
- ☆61Updated last year
- train entropix like a champ!☆20Updated 6 months ago
- ☆14Updated 2 weeks ago
- peer-to-peer compute and intelligence network that enables decentralized AI development at scale☆40Updated this week
- Compiling useful links, papers, benchmarks, ideas, etc.☆46Updated last month
- Lego for GRPO☆27Updated last month
- A miniature version of Modal☆20Updated 10 months ago
- train with kittens!☆57Updated 6 months ago
- ☆22Updated last year
- ☆28Updated 5 months ago
- ☆20Updated 6 months ago
- Entropy Based Sampling and Parallel CoT Decoding☆17Updated 6 months ago