LLM inference optimization simulator
☆13Jul 12, 2025Updated last year
Alternatives and similar repositories for llm-inference-simulator
Users that are interested in llm-inference-simulator are comparing it to the libraries listed below. We may earn a commission when you buy through links labeled 'Ad' on this page.
Sorting:
- Reference-Free automatic summarization evaluation and hallucination detection☆104Jan 15, 2024Updated 2 years ago
- An Erasure Code Library with Efficient Repair and Update Features☆11Jan 3, 2022Updated 4 years ago
- Official Repository of 'A Deep Neural Network for SSVEP-Based Brain-Computer Interfaces'☆84Sep 22, 2023Updated 3 years ago
- Official Repository of 'Transfer learning of an ensemble of DNNs for SSVEP BCI spellers without user-specific training'☆27Sep 22, 2023Updated 3 years ago
- Pytorch implementation of SelectiveNet https://arxiv.org/abs/1901.09192☆12Oct 28, 2020Updated 6 years ago
- GPU virtual machines on DigitalOcean Gradient AI • AdGet to production fast with high-performance AMD and NVIDIA GPUs you can spin up in seconds. The definition of operational simplicity.
- ☆14Nov 12, 2017Updated 8 years ago
- ☆12Jun 30, 2019Updated 7 years ago
- ☆14May 7, 2026Updated 5 months ago
- fused MoE kernel in Candle backend☆14Feb 3, 2026Updated 8 months ago
- The official code for paper entitled "TRCA-Net: Using TRCA filters to boost the SSVEP classification with convolutional neural network" a…☆14Jul 18, 2023Updated 3 years ago
- Graph model execution API for Candle☆19Jul 27, 2025Updated last year
- Log file scanner used with EDA tools to classify errors and warnings☆13Nov 14, 2022Updated 3 years ago
- A Verilog Filelist parser in Rust☆11Mar 25, 2022Updated 4 years ago
- 基于 CUDA Driver API 的 cuda 运行时环境☆16Jul 30, 2025Updated last year
- Deploy on Railway without the complexity - Free Credits Offer • AdConnect your repo and Railway handles the rest with instant previews. Quickly provision container image services, databases, and storage volumes.
- Vim plugin for the uncompromising Python code formatter☆11Mar 11, 2021Updated 5 years ago
- ☆11Nov 27, 2023Updated 2 years ago
- Sphinx extension for visual documentation of hardware written in HWT☆12Nov 12, 2025Updated 11 months ago
- Density Constrained Reinforcement Learning☆12Mar 24, 2023Updated 3 years ago
- Source code for LEF/DEF☆11Oct 16, 2018Updated 8 years ago
- API bindings, CLI client and FUSE filesystem for Wiki.js written in Rust.☆24Feb 16, 2026Updated 8 months ago
- c++ version of ViT☆13Nov 13, 2022Updated 3 years ago
- Latin hypercube sampling code for the lhs pacakge in the statistical software package R (www.r-project.org)☆10Apr 19, 2026Updated 6 months ago
- A Scheduler for Batched LLM Inference☆19Oct 5, 2025Updated last year
- GPUs on demand by Runpod - Special Offer Available • AdRun AI, ML, and HPC workloads on powerful cloud GPUs—without limits or wasted spend. Deploy GPUs in under a minute and pay by the second.
- 用于国科大自动评教。☆14Apr 23, 2024Updated 2 years ago
- ☆14Sep 11, 2025Updated last year
- ☆12Mar 24, 2022Updated 4 years ago
- Browser based ML Inference | OpenAI compliant | Run models like DeepSeek, Llama 3.2, NomicEmbed, KokoroTTS, and more☆60Mar 4, 2025Updated last year
- ☆11Apr 25, 2020Updated 6 years ago
- The Guidance For Installing dpu and some other stuff On Xilinx ZCU102☆14Jan 7, 2020Updated 6 years ago
- ☆26Oct 22, 2025Updated last year
- An experimental package manager and development tool for Hardware Description Languages (HDL).☆14Apr 10, 2022Updated 4 years ago
- A high performance batching router optimises max throughput for text inference workload☆16Sep 6, 2023Updated 3 years ago
- Deploy on Railway without the complexity - Free Credits Offer • AdConnect your repo and Railway handles the rest with instant previews. Quickly provision container image services, databases, and storage volumes.
- Classes and command-line utilities for interacting with BibTeX style databases☆17Nov 12, 2023Updated 2 years ago
- [ICML 2022] Robust Deep Reinforcement Learning through Bootstrapped Opportunistic Curriculum☆12Jul 15, 2022Updated 4 years ago
- 🎧 Pod-Helper: Real-time audio transcription and repair on consumer hardware☆74Feb 23, 2024Updated 2 years ago
- ☆23Jul 19, 2021Updated 5 years ago
- Project for analyzing time-series data from link models or measurements. Generates eye diagrams, extracts statistics, and contains usefu…☆14May 3, 2024Updated 2 years ago
- Learn how to use Shiboken2 with your own custom Qt based library☆11Nov 3, 2021Updated 4 years ago
- AI-driven fusion of multimodal data for Alzheimer's disease biomarker assessment☆26Aug 11, 2025Updated last year