PrimeIntellect-ai / pcclLinks
PCCL (Prime Collective Communications Library) implements fault tolerant collective communications over IP
☆88Updated last week
Alternatives and similar repositories for pccl
Users that are interested in pccl are comparing it to the libraries listed below
Sorting:
- SIMD quantization kernels☆65Updated last week
- Modded vLLM to run pipeline parallelism over public networks☆35Updated last week
- look how they massacred my boy☆63Updated 7 months ago
- an open source reproduction of NVIDIA's nGPT (Normalized Transformer with Representation Learning on the Hypersphere)☆100Updated 2 months ago
- train with kittens!☆57Updated 7 months ago
- ☆19Updated 4 months ago
- DeMo: Decoupled Momentum Optimization☆187Updated 6 months ago
- A tree-based prefix cache library that allows rapid creation of looms: hierarchal branching pathways of LLM generations.☆68Updated 3 months ago
- NanoGPT-speedrunning for the poor T4 enjoyers☆66Updated last month
- Load compute kernels from the Hub☆139Updated this week
- Compiling useful links, papers, benchmarks, ideas, etc.☆46Updated 2 months ago
- NanoGPT (124M) quality in 2.67B tokens☆28Updated 3 weeks ago
- Tree Attention: Topology-aware Decoding for Long-Context Attention on GPU clusters☆126Updated 6 months ago
- Write a fast kernel and run it on Discord. See how you compare against the best!☆44Updated this week
- Lego for GRPO☆28Updated this week
- ☆44Updated last year
- PTX-Tutorial Written Purely By AIs (Deep Research of Openai and Claude 3.7)☆67Updated 2 months ago
- ☆126Updated 2 months ago
- prime-rl is a codebase for decentralized async RL training at scale☆311Updated this week
- Simple repository for training small reasoning models☆31Updated 3 months ago
- ☆27Updated 10 months ago
- TOPLOC: is a novel method for verifiable inference that enables users to verify that LLM providers are using the correct model configurat…☆32Updated last month
- 👷 Build compute kernels☆44Updated this week
- ☆78Updated 10 months ago
- Entropy Based Sampling and Parallel CoT Decoding☆17Updated 7 months ago
- ☆38Updated 10 months ago
- Experiment of using Tangent to autodiff triton☆78Updated last year
- research impl of Native Sparse Attention (2502.11089)☆54Updated 3 months ago
- ☆12Updated 11 months ago
- Docker image NVIDIA GH200 machines - optimized for vllm serving and hf trainer finetuning☆41Updated 3 months ago