JannikSt / ibtopLinks
Real-time terminal monitor for InfiniBand networks - htop for high-speed interconnects
☆48Updated 2 months ago
Alternatives and similar repositories for ibtop
Users that are interested in ibtop are comparing it to the libraries listed below
Sorting:
- Modded vLLM to run pipeline parallelism over public networks☆40Updated 6 months ago
- SIMD quantization kernels☆92Updated 2 months ago
- PCCL (Prime Collective Communications Library) implements fault tolerant collective communications over IP☆138Updated 2 months ago
- A 7B parameter model for mathematical reasoning☆40Updated 9 months ago
- Storing long contexts in tiny caches with self-study☆217Updated last month
- Large scale 4D parallelism pre-training for 🤗 transformers in Mixture of Experts *(still work in progress)*☆87Updated last year
- Training-Ready RL Environments + Evals☆182Updated this week
- Long context evaluation for large language models☆224Updated 8 months ago
- an open source reproduction of NVIDIA's nGPT (Normalized Transformer with Representation Learning on the Hypersphere)☆108Updated 8 months ago
- Compiling useful links, papers, benchmarks, ideas, etc.☆45Updated 8 months ago
- ☆143Updated 2 months ago
- A MAD laboratory to improve AI architecture designs 🧪☆135Updated 11 months ago
- A set of Python scripts that makes your experience on TPU better☆54Updated 2 months ago
- A zero-to-one guide on scaling modern transformers with n-dimensional parallelism.☆105Updated 2 months ago
- ☆21Updated 10 months ago
- Simple Transformer in Jax☆139Updated last year
- ☆233Updated 5 months ago
- Scaling is a distributed training library and installable dependency designed to scale up neural networks, with a dedicated module for tr…☆66Updated last week
- ☆106Updated last month
- Google TPU optimizations for transformers models☆122Updated 10 months ago
- The simplest, fastest repository for training/finetuning medium-sized GPTs.☆174Updated 5 months ago
- ☆136Updated 8 months ago
- seqax = sequence modeling + JAX☆168Updated 4 months ago
- Fast bare-bones BPE for modern tokenizer training☆171Updated 5 months ago
- ☆62Updated last year
- Manage ML configuration with pydantic☆16Updated 6 months ago
- train with kittens!☆63Updated last year
- JAX implementation of the Llama 2 model☆216Updated last year
- Load compute kernels from the Hub☆335Updated this week
- Understand and test language model architectures on synthetic tasks.☆240Updated 2 months ago