Alternatives and similar repositories for pccl

Users that are interested in pccl are comparing it to the libraries listed below

• PrimeIntellect-ai / pi-quant
  SIMD quantization kernels
  ☆73Updated last week
• PrimeIntellect-ai / prime-vllm
  Modded vLLM to run pipeline parallelism over public networks
  ☆37Updated last month
• Zyphra / tree_attention
  Tree Attention: Topology-aware Decoding for Long-Context Attention on GPU clusters
  ☆127Updated 7 months ago
• bloc97 / DeMo
  DeMo: Decoupled Momentum Optimization
  ☆189Updated 7 months ago
• cloneofsimo / ptx-tutorial-by-aislop
  PTX-Tutorial Written Purely By AIs (Deep Research of Openai and Claude 3.7)
  ☆66Updated 3 months ago
• HazyResearch / train-tk
  train with kittens!
  ☆61Updated 8 months ago
• JoeLi12345 / nGPT
  an open source reproduction of NVIDIA's nGPT (Normalized Transformer with Representation Learning on the Hypersphere)
  ☆101Updated 4 months ago
• huggingface / kernel-builder
  👷 Build compute kernels
  ☆74Updated this week
• leloykun / modded-nanogpt
  NanoGPT (124M) quality in 2.67B tokens
  ☆28Updated 2 weeks ago
• gpu-mode / discord-cluster-manager
  Write a fast kernel and run it on Discord. See how you compare against the best!
  ☆46Updated 2 weeks ago
• abacusai / gh200-llm
  Docker image NVIDIA GH200 machines - optimized for vllm serving and hf trainer finetuning
  ☆46Updated 4 months ago
• google-deepmind / asyncdiloco
  ☆45Updated last year
• PrimeIntellect-ai / genesys
  ☆128Updated 3 months ago
• okarthikb / state-space-models
  ☆27Updated last year
• pyember / ember
  ☆187Updated 2 weeks ago
• facebookresearch / llm-speedrunner
  The Automated LLM Speedrunning Benchmark measures how well LLM agents can reproduce previous innovations and discover new ones in languag…
  ☆87Updated last week
• xjdr-alt / llmri
  look how they massacred my boy
  ☆63Updated 8 months ago
• matttreed / diloco-sim
  ☆19Updated 6 months ago
• yandex-research / swarm
  Official code for "SWARM Parallelism: Training Large Models Can Be Surprisingly Communication-Efficient"
  ☆140Updated last year
• PrimeIntellect-ai / prime-rl
  prime-rl is a codebase for decentralized async RL training at scale
  ☆362Updated this week
• LeonGuertler / UnstableBaselines
  ☆90Updated this week
• xjdr-alt / mla_blog_translation
  ☆13Updated last year
• UmerHA / triton_util
  Make triton easier
  ☆47Updated last year
• facebookresearch / fastgen
  Simple high-throughput inference library
  ☆120Updated last month
• xjdr-alt / entropix-trainer
  train entropix like a champ!
  ☆20Updated 9 months ago
• PrimeIntellect-ai / smart-contracts
  Solidity contracts for the decentralized Prime Network protocol
  ☆23Updated last week
• HazyResearch / lolcats
  Repo for "LoLCATs: On Low-Rank Linearizing of Large Language Models"
  ☆243Updated 5 months ago
• Aleph-Alpha-Research / scaling
  Scaling is a distributed training library and installable dependency designed to scale up neural networks, with a dedicated module for tr…
  ☆62Updated 8 months ago
• gau-nernst / learn-cuda
  Learn CUDA with PyTorch
  ☆29Updated this week
• stockeh / mlx-grokking
  Grokking on modular arithmetic in less than 150 epochs in MLX
  ☆13Updated 8 months ago