unconst / BitTensorLinks
A peer to peer machine intelligence benchmark
☆25Updated 2 years ago
Alternatives and similar repositories for BitTensor
Users that are interested in BitTensor are comparing it to the libraries listed below
Sorting:
- "Towards Crowdsourced Training of Large Neural Networks using Decentralized Mixture-of-Experts" (NeurIPS 2020), original PyTorch implemen…☆57Updated 4 years ago
- a libp2p-backed daemon wrapping the functionalities of go-libp2p for use in other languages☆11Updated 5 months ago
- Modded vLLM to run pipeline parallelism over public networks☆36Updated 2 months ago
- Jax like function transformation engine but micro, microjax☆33Updated 8 months ago
- Memory-efficient transformer. Work in progress.☆19Updated 2 years ago
- The official code of "Building on Efficient Foundations: Effectively Training LLMs with Structured Feedforward Layers"☆19Updated 11 months ago
- ☆54Updated last year
- RWKV model implementation☆38Updated 2 years ago
- This repository contain the simple llama3 implementation in pure jax.☆67Updated 5 months ago
- Testing KAN-based text generation GPT models☆17Updated last year
- train with kittens!☆61Updated 8 months ago
- ☆14Updated 3 years ago
- Latent Large Language Models☆18Updated 10 months ago
- The Automated LLM Speedrunning Benchmark measures how well LLM agents can reproduce previous innovations and discover new ones in languag…☆89Updated 3 weeks ago
- A fast, distributed filesystem for TensorFlow models, data, and logs☆26Updated 6 years ago
- Pretraining☆25Updated last month
- An unofficial implementation of the Infini-gram model proposed by Liu et al. (2024)☆33Updated last year
- ☆27Updated last year
- Standalone commandline CLI tool for compiling Triton kernels☆17Updated 10 months ago
- A Python library for automatically solving Abstraction and Reasoning Corpus (ARC) challenges using Claude and object-centric modeling.☆22Updated 6 months ago
- A 7B parameter model for mathematical reasoning☆40Updated 5 months ago
- ☆61Updated 3 years ago
- LayerNorm(SmallInit(Embedding)) in a Transformer to improve convergence☆59Updated 3 years ago
- slowly building a set of infinite riddle generators for data-hungry methods☆13Updated 2 years ago
- Long context evaluation for large language models☆220Updated 4 months ago
- p2p peer-to-peer training of tensorflow models☆63Updated 8 years ago
- Make triton easier☆47Updated last year
- ☆17Updated 10 months ago
- PCCL (Prime Collective Communications Library) implements fault tolerant collective communications over IP☆96Updated this week
- Code implementing "Efficient Parallelization of a Ubiquitious Sequential Computation" (Heinsen, 2023)☆94Updated 7 months ago