Single-stream LLM inference engine for Qwen3.8-27B on one RTX 5090 — int4 quantization + speculative decoding + custom Triton/CUDA kernels; 229–379 tok/s vs llama.cpp/SGLang/vLLM at batch size 1.
☆23Sep 12, 2026Updated last month
Alternatives and similar repositories for token-rush
Users that are interested in token-rush are comparing it to the libraries listed below. We may earn a commission when you buy through links labeled 'Ad' on this page.
Sorting:
- Reasoning LLMs optimized for Chisel code generation☆26Jun 19, 2025Updated last year
- Android Platform support for rife-ncnn-vulkan☆10Apr 15, 2025Updated last year
- Processing support for Greengenes2☆15Jul 31, 2023Updated 3 years ago
- OpenCode-based time-series harness for structured forecasting, contextual reasoning, tool use, and validation-driven agent workflows.☆13Oct 13, 2026Updated last week
- UCSD ECE277 GPU Programming coursework: GPU-accelerated reinforcement learning on CUDA C with Nsight System☆15Aug 17, 2021Updated 5 years ago
- AI Agents on DigitalOcean Gradient AI Platform • AdBuild production-ready AI agents using customizable tools or access multiple LLMs through a single endpoint. Create custom knowledge bases or connect external data.
- ☆12May 10, 2024Updated 2 years ago
- ☆20Jun 16, 2026Updated 4 months ago
- 利用Bert获取中文字、词向量☆10Jan 18, 2022Updated 4 years ago
- A gallery of Boar :)☆38Aug 10, 2026Updated 2 months ago
- AI Infra / 机器学习系统面经（305 题）☆47May 5, 2026Updated 5 months ago
- 好用的歌牌APP，Unity开发，homebrew☆12May 19, 2021Updated 5 years ago
- [TMLR 26]: "UniRec: Unified Multimodal Encoding for LLM-Based Recommendations", Zijie Lei, Tao Feng, Zhigang Hua, Yan Xie, Guanyu Lin, Sh…☆15Jul 9, 2026Updated 3 months ago
- Composable framework for canvas-based, visual, and domain-driven products.☆45Updated this week
- 基于 C++ 实现的 Etcd kv 存储系统☆15May 21, 2023Updated 3 years ago
- AI Agents on DigitalOcean Gradient AI Platform • AdBuild production-ready AI agents using customizable tools or access multiple LLMs through a single endpoint. Create custom knowledge bases or connect external data.
- ☆14Mar 26, 2025Updated last year
- DeepSeek-V4.1-Flash (552B MoE) on one RTX 5090 with a llama.cpp fork: report, tools, results☆17Sep 23, 2026Updated last month
- Parser utility to generate ASTs from PHP source code suitable to be processed by Joern.☆15Jan 27, 2019Updated 7 years ago
- Openvibe fork☆10Aug 2, 2013Updated 13 years ago
- Artifact Evaluation for OSDI'26 paper CoPilotIO: CPU as a Co-pilot for GPU I/O to Free GPU Compute☆26May 9, 2026Updated 5 months ago
- Implementation of the paper: Selective_Backpropagation from paper Accelerating Deep Learning by Focusing on the Biggest Losers☆16Feb 2, 2020Updated 6 years ago
- ATOD: Annealed Turn-Aware On-Policy Distillation for Multi-Turn Agentic Tasks☆21Sep 11, 2026Updated last month
- ☆16Oct 26, 2025Updated last year
- 3D feature-based image registration for neuroscience datasets☆14Aug 23, 2017Updated 9 years ago
- Deploy on Railway without the complexity - Free Credits Offer • AdConnect your repo and Railway handles the rest with instant previews. Quickly provision container image services, databases, and storage volumes.
- ☆13Jan 23, 2021Updated 5 years ago
- afac2026赛道四baseline☆22Jun 9, 2026Updated 4 months ago
- ☆17May 8, 2021Updated 5 years ago
- Private mirror of newliver666/apk-reverse — Android APK reverse engineering Agent Skill☆17Oct 3, 2026Updated 3 weeks ago
- ☆21May 28, 2026Updated 4 months ago
- [MM 2024] SimCEN: Simple Contrast-enhanced Network for CTR Prediction☆13Apr 10, 2025Updated last year
- Low level algorithms for persistent memory.☆16Feb 9, 2021Updated 5 years ago
- A single page app built with Next.JS and TailwindCSS to visualise risks/opportunities based on likelihood, preparedness using PEST.☆17Updated this week
- Fast implementation of the neighbour-joining phylogenetic inference method☆23May 23, 2020Updated 6 years ago
- Managed hosting for WordPress and PHP on Cloudways • AdManaged hosting for WordPress, Magento, Laravel, or PHP apps, on multiple cloud providers. Deploy in minutes on Cloudways by DigitalOcean.
- Code Scorer using LLM☆12Jun 22, 2026Updated 4 months ago
- Profiling and Improving the PyTorch Dataloader for high-latency Storage☆21Apr 18, 2023Updated 3 years ago
- 中山大学体育场馆管理与预定系统助手☆26Apr 9, 2021Updated 5 years ago
- ☆16Mar 3, 2022Updated 4 years ago
- 中山大学电子与信息工程学院25年春，通信工程的工程应用训练课项目——智能便携式电子负载☆16Feb 8, 2026Updated 8 months ago
- vscode-drawio增强版，提供代码跳转功能☆10Feb 20, 2025Updated last year
- MLSys 2021 paper: MicroRec: efficient recommendation inference by hardware and data structure solutions☆21May 26, 2021Updated 5 years ago