☆484Nov 25, 2025Updated 10 months ago
Alternatives and similar repositories for tokasaurus
Users that are interested in tokasaurus are comparing it to the libraries listed below. We may earn a commission when you buy through links labeled 'Ad' on this page.
Sorting:
- Storing long contexts in tiny caches with self-study☆340Mar 23, 2026Updated 6 months ago
- Kernels, of the mega variety :)☆846May 26, 2026Updated 4 months ago
- Simple, flexible configuration in pure Python!☆32Jul 1, 2025Updated last year
- Tile primitives for speedy kernels☆3,746Sep 12, 2026Updated 3 weeks ago
- Hydragen: High-Throughput LLM Inference with Shared Prefixes☆61May 10, 2024Updated 2 years ago
- Serverless GPU API endpoints on Runpod - Get Bonus Credits • AdSkip the infrastructure headaches. Auto-scaling, pay-as-you-go, no-ops approach lets you focus on innovating your application.
- Our library for RL environments + evals☆4,686Updated this week
- Mirage Persistent Kernel: Compiling LLMs into a MegaKernel☆2,547Updated this week
- FlashInfer: Kernel Library for LLM Serving☆6,584Updated this week
- KernelBench: Can LLMs Write GPU Kernels? - Benchmark + Toolkit with Torch -> CUDA (+ more DSLs)☆1,283Mar 24, 2026Updated 6 months ago
- Tinker ↔ KernelBench Integration enabling RL for GPU Kernel Generation☆31Mar 5, 2026Updated 7 months ago
- Agentic RL Training at Scale☆2,148Updated this week
- Simple & Scalable Pretraining for Neural Architecture Research☆347Mar 31, 2026Updated 6 months ago
- ArcticInference: vLLM plugin for high-throughput, low-latency inference☆488Sep 23, 2026Updated 2 weeks ago
- PyTorch native quantization for training and inference☆2,997Updated this week
- Deploy to Railway using AI coding agents - Free Credits Offer • AdUse Claude Code, Codex, OpenCode, and more. Autonomous software development now has the infrastructure to match with Railway.
- A Datacenter Scale Distributed Inference Serving Framework☆8,256Updated this week
- ☆69May 23, 2025Updated last year
- ☆39Aug 4, 2025Updated last year
- Big & Small LLMs working together☆1,365Mar 12, 2026Updated 6 months ago
- Checkpoint-engine is a simple middleware to update model weights in LLM inference engines☆1,007Sep 15, 2026Updated 3 weeks ago
- SGLang is a high-performance serving framework for large language models and multimodal models.☆36,962Updated this week
- 🚀 Efficient implementations for emerging model architectures☆5,842Updated this week
- SkyRL: A Modular Full-stack RL Library for LLMs☆2,401Updated this week
- A scalable asynchronous reinforcement learning implementation with in-flight weight updates.☆434Aug 5, 2026Updated 2 months ago
- GPU virtual machines on DigitalOcean Gradient AI • AdGet to production fast with high-performance AMD and NVIDIA GPUs you can spin up in seconds. The definition of operational simplicity.
- State-of-the-art LLM compression, built for production inference with vLLM☆3,863Updated this week
- ☆12Jul 30, 2025Updated last year
- 👷 Build compute kernels☆213Apr 6, 2026Updated 6 months ago
- MoE training for Me and You and maybe other people☆400Mar 15, 2026Updated 6 months ago
- A framework for optimizing DSPy programs with RL☆339Jan 12, 2026Updated 8 months ago
- Measuring Thinking Efficiency in Reasoning Models - Research Repository☆40Dec 2, 2025Updated 10 months ago
- Nano vLLM☆15,761Apr 26, 2026Updated 5 months ago
- slime is an LLM post-training framework for RL Scaling.☆8,626Updated this week
- CUDA/Metal accelerated language model inference☆646May 29, 2025Updated last year
- Serverless GPU API endpoints on Runpod - Get Bonus Credits • AdSkip the infrastructure headaches. Auto-scaling, pay-as-you-go, no-ops approach lets you focus on innovating your application.
- Efficient Triton Kernels for LLM Training☆6,653Updated this week
- [NeurIPS 2025 Spotlight] Reasoning Environments for Reinforcement Learning with Verifiable Rewards☆1,526Apr 17, 2026Updated 5 months ago
- Minimalistic large language model 3D-parallelism training☆2,835Updated this week
- LMCache: Supercharge Your LLM with the Fastest KV Cache Layer☆11,994Updated this week
- ☆33Apr 19, 2025Updated last year
- PyTorch Single Controller☆1,078Updated this week
- Inference at the speed of light.☆3,021Updated this week