Alternatives and similar repositories for pretraining

Users that are interested in pretraining are comparing it to the libraries listed below

• manifold-inc / targon
  A library for building subnets with the manifold reward stack
  ☆58Updated last week
• NousResearch / finetuning-subnet
  ☆122Updated last year
• namoray / vision
  ☆25Updated 11 months ago
• unconst / boltzmann
  Incentivized Training over Wide Web with 1000x model compression.
  ☆22Updated 9 months ago
• macrocosm-os / apex
  SN1: An incentive mechanism for internet-scale conversational intelligence
  ☆112Updated this week
• commune-ai / commune
  Commune Repo
  ☆89Updated this week
• 404-Repo / three-gen-subnet
  A 3D asset creation extension for the Bittensor network.
  ☆25Updated 2 weeks ago
• OpenKaito / openkaito
  Decentralized Embedding in Bittensor SN5
  ☆61Updated 5 months ago
• neuralinternet / SN27
  Decentralized AI Compute network
  ☆66Updated this week
• opentensor / old-docs
  The docs
  ☆13Updated last year
• Datura-ai / cortex.t
  ☆63Updated 8 months ago
• rayonlabs / chutes
  ☆53Updated this week
• metanova-labs / nova
  ☆13Updated last week
• taoshidev / time-series-prediction-subnet
  Prediction subnet built on Bittensor
  ☆63Updated last year
• omegalabsinc / omegalabs-anytoany-bittensor
  Making the world's first and smartest opensource any-to-any AGI system
  ☆43Updated this week
• PrimeIntellect-ai / smart-contracts
  Solidity contracts for the decentralized Prime Network protocol
  ☆26Updated last month
• opentensor / cubit
  A Cython library to solve the Bittensor registration POW on CUDA
  ☆13Updated 2 weeks ago
• PrimeIntellect-ai / prime-vllm
  Modded vLLM to run pipeline parallelism over public networks
  ☆38Updated 3 months ago
• dstrbtd / DistributedTraining
  ☆17Updated this week
• notarussianteenager / srf-attention
  Simplex Random Feature attention, in PyTorch
  ☆74Updated last year
• yizhe-ang / interactive-transformer
  A visual interface for understanding and interpreting Transformers
  ☆77Updated last year
• NousResearch / nousflash-agents
  Modular Agentic AI Architecture - NousResearch x Teleport (Flashbots)
  ☆72Updated 7 months ago
• vithursant / nanoGPT_mlx
  Port of Andrej Karpathy's nanoGPT to Apple MLX framework.
  ☆112Updated last year
• macrocosm-os / data-universe
  A Bittensor subnet for collecting and storing valuable data for other subnets
  ☆57Updated last week
• teknium1 / transformers-gptq-quant
  ☆46Updated last year
• teknium1 / stanford_alpaca-replit
  Modified Stanford-Alpaca Trainer for Training Replit's Code Model
  ☆41Updated 2 years ago
• PrimeIntellect-ai / INTELLECT-MATH
  A 7B parameter model for mathematical reasoning
  ☆40Updated 6 months ago
• PrimeIntellect-ai / pccl
  PCCL (Prime Collective Communications Library) implements fault tolerant collective communications over IP
  ☆106Updated this week
• recmo / cria
  Tiny inference-only implementation of LLaMA
  ☆93Updated last year
• hyperspaceai / HyperspaceZK
  👾 DX-focused decentralized zero-knowledge framework 🛸
  ☆40Updated last year