unconst / BitTensorLinks
A peer to peer machine intelligence benchmark
☆25Updated 2 years ago
Alternatives and similar repositories for BitTensor
Users that are interested in BitTensor are comparing it to the libraries listed below
Sorting:
- "Towards Crowdsourced Training of Large Neural Networks using Decentralized Mixture-of-Experts" (NeurIPS 2020), original PyTorch implemen…☆57Updated 4 years ago
- Jax like function transformation engine but micro, microjax☆33Updated 9 months ago
- This repository contain the simple llama3 implementation in pure jax.☆68Updated 5 months ago
- Official code for "SWARM Parallelism: Training Large Models Can Be Surprisingly Communication-Efficient"☆141Updated last year
- FastFeedForward Networks☆20Updated last year
- Modded vLLM to run pipeline parallelism over public networks☆37Updated 2 months ago
- Attention Kernels for Symmetric Power Transformers☆111Updated last week
- Memory-efficient transformer. Work in progress.☆19Updated 2 years ago
- Collaborative inference of latent diffusion via hivemind☆12Updated 2 years ago
- HomebrewNLP in JAX flavour for maintable TPU-Training☆50Updated last year
- Training Models Daily☆17Updated last year
- Training a model similar to OpenAI DALL-E with volunteers from all over the Internet using hivemind and dalle-pytorch (NeurIPS 2021 demo)☆27Updated 2 years ago
- ☆15Updated last month
- Babysit your preemptible TPUs☆86Updated 2 years ago
- JAX notebook showing how to LoRA + GPTQ arbitrary models☆10Updated 2 years ago
- Learning Universal Predictors☆78Updated last year
- A Python library for automatically solving Abstraction and Reasoning Corpus (ARC) challenges using Claude and object-centric modeling.☆22Updated 7 months ago
- slowly building a set of infinite riddle generators for data-hungry methods☆14Updated 2 years ago
- ☆38Updated last year
- A dataset of alignment research and code to reproduce it☆77Updated 2 years ago
- Code implementing "Efficient Parallelization of a Ubiquitious Sequential Computation" (Heinsen, 2023)☆94Updated 8 months ago
- Official code for "Distributed Deep Learning in Open Collaborations" (NeurIPS 2021)☆117Updated 3 years ago
- Pretraining☆25Updated 2 months ago
- A client library for LAION's effort to filter CommonCrawl with CLIP, building a large scale image-text dataset.☆32Updated 2 years ago
- The history files when recording human interaction while solving ARC tasks☆114Updated 2 weeks ago
- ☆27Updated last year
- ☆53Updated last year
- ☆61Updated 3 years ago
- a WIP architecture designed to allow transformers to think in a manner without tokens☆20Updated last year
- Official implementation of the paper "Linear Transformers with Learnable Kernel Functions are Better In-Context Models"☆161Updated 6 months ago