Alternatives and similar repositories for pretraining

Users that are interested in pretraining are comparing it to the libraries listed below

• manifold-inc / targon
  A library for building subnets with the manifold reward stack
  ☆59Updated last week
• NousResearch / finetuning-subnet
  ☆121Updated last year
• unconst / boltzmann
  Incentivized Training over Wide Web with 1000x model compression.
  ☆22Updated 11 months ago
• macrocosm-os / apex
  SN1: An incentive mechanism for internet-scale conversational intelligence
  ☆112Updated this week
• PrimeIntellect-ai / prime-vllm
  Modded vLLM to run pipeline parallelism over public networks
  ☆39Updated 4 months ago
• neuralinternet / SN27
  Decentralized AI Compute network
  ☆67Updated this week
• metanova-labs / nova
  ☆14Updated last week
• OpenKaito / openkaito
  Decentralized Embedding in Bittensor SN5
  ☆61Updated 7 months ago
• Datura-ai / cortex.t
  ☆63Updated 9 months ago
• omegalabsinc / omegalabs-anytoany-bittensor
  Making the world's first and smartest opensource any-to-any AGI system
  ☆44Updated last week
• PrimeIntellect-ai / smart-contracts
  Solidity contracts for the decentralized Prime Network protocol
  ☆27Updated 3 months ago
• unconst / DynamicBot
  Dynamic Telegram Trading Bot
  ☆16Updated 7 months ago
• PrimeIntellect-ai / INTELLECT-MATH
  A 7B parameter model for mathematical reasoning
  ☆40Updated 7 months ago
• dstrbtd / DistributedTraining
  ☆18Updated this week
• NousResearch / nousflash-agents
  Modular Agentic AI Architecture - NousResearch x Teleport (Flashbots)
  ☆72Updated 9 months ago
• opentensor / cubit
  A Cython library to solve the Bittensor registration POW on CUDA
  ☆13Updated last month
• teknium1 / RawTransform
  A repository of prompts and Python scripts for intelligent transformation of raw text into diverse formats.
  ☆30Updated 2 years ago
• teknium1 / transformers-gptq-quant
  ☆46Updated last year
• commune-ai / commune
  Commune Repo
  ☆88Updated last week
• opentensor / old-docs
  The docs
  ☆13Updated last year
• vithursant / nanoGPT_mlx
  Port of Andrej Karpathy's nanoGPT to Apple MLX framework.
  ☆112Updated last year
• one-covenant / templar
  incenτivised inτerneτ-wide τraining
  ☆70Updated this week
• PrimeIntellect-ai / pccl
  PCCL (Prime Collective Communications Library) implements fault tolerant collective communications over IP
  ☆126Updated 3 weeks ago
• vikhyat / mixtral-inference
  inference code for mixtral-8x7b-32kseqlen
  ☆101Updated last year
• rayonlabs / G.O.D
  Gradients on demand
  ☆26Updated this week
• 404-Repo / three-gen-subnet
  A 3D asset creation extension for the Bittensor network.
  ☆25Updated last week
• matttreed / diloco-sim
  ☆21Updated 9 months ago
• deepshard / mixtral-8x7b-Inference
  Eh, simple and works.
  ☆27Updated last year
• NousResearch / StripedHyenaTrainer
  ☆61Updated last year
• opentensor / bittensor-delegates
  ☆19Updated 3 months ago