TokenSim is a tool for simulating the behavior of large language models (LLMs) in a distributed environment.
☆20Sep 20, 2025Updated 6 months ago
Alternatives and similar repositories for TokenSim
Users that are interested in TokenSim are comparing it to the libraries listed below
Sorting:
- ☆40Jun 30, 2025Updated 8 months ago
- TACOS: [T]opology-[A]ware [Co]llective Algorithm [S]ynthesizer for Distributed Machine Learning☆32Jun 13, 2025Updated 9 months ago
- Projects for the ECPiX-5 - a ECP5 FPGA board.☆14Jul 5, 2020Updated 5 years ago
- ☆16Apr 22, 2025Updated 10 months ago
- ☆14Oct 11, 2024Updated last year
- Netrace: a network packet trace reader☆14Jun 16, 2014Updated 11 years ago
- Managed collective communication service☆23Sep 2, 2024Updated last year
- ☆72Jun 23, 2025Updated 8 months ago
- ☆29Aug 4, 2025Updated 7 months ago
- Artifact for "Apparate: Rethinking Early Exits to Tame Latency-Throughput Tensions in ML Serving" [SOSP '24]☆24Nov 21, 2024Updated last year
- Tensorflow implementation of "Defense against Universal Adversarial Perturbations"☆10Apr 16, 2018Updated 7 years ago
- Unofficial wheels for some machine-learning Python libraries, for the Nvidia Jetson Nano.☆17Aug 24, 2021Updated 4 years ago
- Source code for Jellyfish, a soft real-time inference serving system☆15Dec 20, 2022Updated 3 years ago
- Repository for the COLM 2025 paper SpecDec++: Boosting Speculative Decoding via Adaptive Candidate Lengths☆17Jul 10, 2025Updated 8 months ago
- A benchmark suite for Graph Machine Learning☆19Oct 8, 2024Updated last year
- LIBRA: Enabling Workload-aware Multi-dimensional Network Topology Optimization for Distributed Training of Large AI Models☆12May 7, 2024Updated last year
- Cheng-Hao Tu, Jia-Hong Lee, Yi-Ming Chan and Chu-Song Chen, "Pruning Depthwise Separable Convolutions for MobileNet Compression," Interna…☆16Jan 8, 2021Updated 5 years ago
- [ICLR 2025] Linear Combination of Saved Checkpoints Makes Consistency and Diffusion Models Better☆16Feb 15, 2025Updated last year
- An OpenConfig reference device implementation☆43Updated this week
- GPGPU-Sim provides a detailed simulation model of a contemporary GPU running CUDA and/or OpenCL workloads and now includes an integrated…☆14Jun 24, 2020Updated 5 years ago
- ☆19May 4, 2023Updated 2 years ago
- Source code for Multifidielity Thermal Modeling for 2.5D and 3D Multi-Chiplet Architectures☆21Jan 29, 2026Updated last month
- Real-time speech-to-text translation over WebSocket. Streams Opus or raw PCM audio from client to server for live transcription and optio…☆13Mar 11, 2026Updated last week
- ☆12Oct 16, 2022Updated 3 years ago
- Integrating Event-based Dynamic Vision Sensors with Sparse Hyperdimensional Computing☆12Jul 9, 2020Updated 5 years ago
- Inference Llama3.2 1B/3B base/instruct models in 1 file of pure C☆22Jul 22, 2025Updated 7 months ago
- Gem5 with PCI Express integrated.☆23Sep 29, 2018Updated 7 years ago
- BloodCell-Detector-Yolo is a YOLOv5 implementation tailored to detect Red Blood Cells (RBC), White Blood Cells (WBC), and Platelets from …☆18Jan 23, 2025Updated last year
- ☆12Apr 6, 2025Updated 11 months ago
- PyTorch implementation of "Arbitrary Style Transfer in Real-time with Adaptive Instance Normalization"☆11Jul 24, 2023Updated 2 years ago
- ☆20May 14, 2025Updated 10 months ago
- "FusionFactory: Fusing LLM Capabilities with Routing Data", Tao Feng, Haozhen Zhang, Zijie Lei, Pengrui Han, Mostofa Patwary, Mohammad Sh…☆19Dec 30, 2025Updated 2 months ago
- SystemVerilog implemention of QEMU PCI edu device☆13May 22, 2023Updated 2 years ago
- ONNXim is a fast cycle-level simulator that can model multi-core NPUs for DNN inference☆191Jan 8, 2026Updated 2 months ago
- ☆16Updated this week
- ☆14Feb 26, 2026Updated 3 weeks ago
- [ASP-DAC 2025] "NeuronQuant: Accurate and Efficient Post-Training Quantization for Spiking Neural Networks" Official Implementation☆19Mar 6, 2025Updated last year
- Examples from the Openlane repository, adapted as Fusesoc cores☆12May 18, 2021Updated 4 years ago
- Implementation of NM sparsity recipe presented in the paper "Progressive Gradient Flow for Robust N:M Sparsity Training in Transformers".☆11Feb 5, 2024Updated 2 years ago