TokenSim is a tool for simulating the behavior of large language models (LLMs) in a distributed environment.
☆25Jun 26, 2026Updated this week
Alternatives and similar repositories for TokenSim
Users that are interested in TokenSim are comparing it to the libraries listed below. We may earn a commission when you buy through links labeled 'Ad' on this page.
Sorting:
- ☆27Feb 11, 2025Updated last year
- TACOS: [T]opology-[A]ware [Co]llective Algorithm [S]ynthesizer for Distributed Machine Learning☆36Jun 13, 2025Updated last year
- Projects for the ECPiX-5 - a ECP5 FPGA board.☆14Jul 5, 2020Updated 5 years ago
- ☆20Jun 1, 2026Updated last month
- ☆14Oct 11, 2024Updated last year
- Deploy open-source AI quickly and easily - Special Bonus Offer • AdRunpod Hub is built for open source. One-click deployment and autoscaling endpoints without provisioning your own infrastructure.
- ☆29Aug 4, 2025Updated 10 months ago
- Artifact for "Apparate: Rethinking Early Exits to Tame Latency-Throughput Tensions in ML Serving" [SOSP '24]☆24Nov 21, 2024Updated last year
- ☆83Jun 23, 2025Updated last year
- Unofficial wheels for some machine-learning Python libraries, for the Nvidia Jetson Nano.☆18Aug 24, 2021Updated 4 years ago
- Tensorflow implementation of "Defense against Universal Adversarial Perturbations"☆10Apr 16, 2018Updated 8 years ago
- Source code for Jellyfish, a soft real-time inference serving system☆15Dec 20, 2022Updated 3 years ago
- Repository for the COLM 2025 paper SpecDec++: Boosting Speculative Decoding via Adaptive Candidate Lengths☆19Jul 10, 2025Updated 11 months ago
- Source code of IPA, https://escholarship.org/uc/item/2p0805dq☆12Jun 27, 2024Updated 2 years ago
- Modding the LOOΠΔ light stick with a custom PCB/firmware, rechargeable battery and a companion Android app for wireless control.☆13Sep 16, 2022Updated 3 years ago
- Deploy on Railway without the complexity - Free Credits Offer • AdConnect your repo and Railway handles the rest with instant previews. Quickly provision container image services, databases, and storage volumes.
- LIBRA: Enabling Workload-aware Multi-dimensional Network Topology Optimization for Distributed Training of Large AI Models☆12May 7, 2024Updated 2 years ago
- An open-source hybrid Mesh–Crossbar NoC for scalable, low-latency shared-L1-memory clusters with thousands of cores.☆37Updated this week
- Cheng-Hao Tu, Jia-Hong Lee, Yi-Ming Chan and Chu-Song Chen, "Pruning Depthwise Separable Convolutions for MobileNet Compression," Interna…☆16Jan 8, 2021Updated 5 years ago
- This GitHub repo contains the artifact for CPElide, which appears at MICRO '24☆17Sep 7, 2024Updated last year
- GPGPU-Sim provides a detailed simulation model of a contemporary GPU running CUDA and/or OpenCL workloads and now includes an integrated…☆15Jun 24, 2020Updated 6 years ago
- ☆18May 4, 2023Updated 3 years ago
- ☆10Feb 17, 2026Updated 4 months ago
- Here is a part of notes of the mathematics classes of CFMATH/in USTC during my undergraduate period.☆18Jan 3, 2026Updated 5 months ago
- Real-time speech-to-text translation over WebSocket. Streams Opus or raw PCM audio from client to server for live transcription and optio…☆16May 30, 2026Updated last month
- Managed Database hosting by DigitalOcean • AdPostgreSQL, MySQL, MongoDB, Kafka, Valkey, and OpenSearch available. Automatically scale up storage and focus on building your apps.
- ☆12Oct 16, 2022Updated 3 years ago
- ☆10Mar 8, 2025Updated last year
- Integrating Event-based Dynamic Vision Sensors with Sparse Hyperdimensional Computing☆13Jul 9, 2020Updated 5 years ago
- Gem5 with PCI Express integrated.☆24Sep 29, 2018Updated 7 years ago
- Inference Llama3.2 1B/3B base/instruct models in 1 file of pure C☆24Jul 22, 2025Updated 11 months ago
- Towards Achieving Adversarial Robustness by Enforcing Feature Consistency Across Bit Planes☆23Jun 14, 2020Updated 6 years ago
- Source code for Multifidielity Thermal Modeling for 2.5D and 3D Multi-Chiplet Architectures☆26Jan 29, 2026Updated 5 months ago
- InstAttention: In-Storage Attention Offloading for Cost-Effective Long-Context LLM Inference☆17Mar 30, 2025Updated last year
- ☆13Apr 6, 2025Updated last year
- Deploy to Railway using AI coding agents - Free Credits Offer • AdUse Claude Code, Codex, OpenCode, and more. Autonomous software development now has the infrastructure to match with Railway.
- ☆30Apr 17, 2025Updated last year
- PyTorch implementation of "Arbitrary Style Transfer in Real-time with Adaptive Instance Normalization"☆11Jul 24, 2023Updated 2 years ago
- ☆34Oct 13, 2025Updated 8 months ago
- ☆20May 14, 2025Updated last year
- "FusionFactory: Fusing LLM Capabilities with Routing Data", Tao Feng, Haozhen Zhang, Zijie Lei, Pengrui Han, Mostofa Patwary, Mohammad Sh…☆22Dec 30, 2025Updated 6 months ago
- A standalone CXL-enabled system simulator.☆21Apr 19, 2026Updated 2 months ago
- ☆16Jun 12, 2026Updated 2 weeks ago