tensorwavecloud / ScalarLMLinks
ScalarLM - a unified training and inference stack
☆53Updated this week
Alternatives and similar repositories for ScalarLM
Users that are interested in ScalarLM are comparing it to the libraries listed below
Sorting:
- PCCL (Prime Collective Communications Library) implements fault tolerant collective communications over IP☆99Updated 3 weeks ago
- SIMD quantization kernels☆78Updated this week
- ☆213Updated last month
- Cray-LM unified training and inference stack.☆22Updated 6 months ago
- ☆186Updated this week
- PyTorch Single Controller☆345Updated this week
- ☆216Updated 6 months ago
- Where GPUs get cooked 👩🍳🔥☆274Updated this week
- Fault tolerance for PyTorch (HSDP, LocalSGD, DiLoCo, Streaming DiLoCo)☆377Updated this week
- An introduction to LLM Sampling☆79Updated 7 months ago
- Matrix (Multi-Agent daTa geneRation Infra and eXperimentation framework) is a versatile engine for multi-agent conversational data genera…☆81Updated last week
- Write a fast kernel and run it on Discord. See how you compare against the best!☆50Updated this week
- Simple & Scalable Pretraining for Neural Architecture Research☆283Updated this week
- look how they massacred my boy☆63Updated 9 months ago
- Small scale distributed training of sequential deep learning models, built on Numpy and MPI.☆137Updated last year
- train with kittens!☆62Updated 9 months ago
- Accelerating your LLM training to full speed! Made with ❤️ by ServiceNow Research☆218Updated this week
- Docker image NVIDIA GH200 machines - optimized for vllm serving and hf trainer finetuning☆47Updated 5 months ago
- Modded vLLM to run pipeline parallelism over public networks☆37Updated 2 months ago
- PTX-Tutorial Written Purely By AIs (Deep Research of Openai and Claude 3.7)☆66Updated 4 months ago
- ArcticTraining is a framework designed to simplify and accelerate the post-training process for large language models (LLMs)☆195Updated this week
- A simple MLX implementation for pretraining LLMs on Apple Silicon.☆83Updated 3 months ago
- Long context evaluation for large language models☆220Updated 5 months ago
- ☆89Updated 10 months ago
- ☆232Updated this week
- ☆96Updated last week
- an open source reproduction of NVIDIA's nGPT (Normalized Transformer with Representation Learning on the Hypersphere)☆104Updated 5 months ago
- Storing long contexts in tiny caches with self-study☆124Updated this week
- Verbosity control for AI agents☆64Updated last year
- A repository to unravel the language of GPUs, making their kernel conversations easy to understand☆189Updated 2 months ago