First Latency-Aware Competitive LLM Agent Benchmark
☆32Jun 3, 2025Updated last year
Alternatives and similar repositories for LatencySensitiveBench
Users that are interested in LatencySensitiveBench are comparing it to the libraries listed below. We may earn a commission when you buy through links labeled 'Ad' on this page.
Sorting:
- In 1955, RAND Corporation published a book of a “million random digits”; this code is a modern attempt to reproduce the analysis that was…☆12Nov 14, 2023Updated 3 years ago
- This repository contains the artifacts for the MLSys 2026 paper AgenticCache.☆13Apr 22, 2026Updated 6 months ago
- A Curated Collection of Frontier Language Model Architectures☆14Jan 30, 2026Updated 9 months ago
- Beyond KV Caching: Shared Attention for Efficient LLMs☆20Jul 19, 2024Updated 2 years ago
- Coco is a proactive co-assistant that connects user workspace with a broader ecosystem of AI agents.☆47Updated this week
- Managed hosting for WordPress and PHP on Cloudways • AdManaged hosting for WordPress, Magento, Laravel, or PHP apps, on multiple cloud providers. Deploy in minutes on Cloudways by DigitalOcean.
- PyTorch compilation tutorial covering TorchScript, torch.fx, and Slapo☆17Mar 13, 2023Updated 3 years ago
- ☆14Jun 25, 2025Updated last year
- The Shifted and The Overlooked: A Task-oriented Investigation of User-GPT Interactions (EMNLP 2023))☆13Dec 21, 2023Updated 2 years ago
- [FastMRI Challenge] E2E-VarNet + RCAN Combination for MRI Reconstruction☆14Dec 30, 2022Updated 3 years ago
- Multi-agent system for resolving Site Reliability Engineering tasks.☆32Oct 23, 2025Updated last year
- Official code, models, and dataset for NeuRIP 2026 paper "Evolution Fine-Tuning (EFT): Learning to Discover Across 371 Optimization Tasks…☆31Jun 30, 2026Updated 4 months ago
- PALM: A Efficient Performance Simulator for Tiled Accelerators with Large-scale Model Training☆23Jun 12, 2024Updated 2 years ago
- [ICML 2024] When Linear Attention Meets Autoregressive Decoding: Towards More Effective and Efficient Linearized Large Language Models☆35Jun 12, 2024Updated 2 years ago
- Fast Emulation of Approximate ViT models in PyTorch☆13Feb 13, 2024Updated 2 years ago
- Deploy on Railway without the complexity - Free Credits Offer • AdConnect your repo and Railway handles the rest with instant previews. Quickly provision container image services, databases, and storage volumes.
- ☆26Oct 29, 2026Updated 2 weeks ago
- The official code for [ECCV2020] "HALO: Hardware-aware Learning to Optimize"☆10Mar 22, 2023Updated 3 years ago
- [ICML 2024] Reducing Tool Hallucination via Reliability Alignment☆16Jun 17, 2025Updated last year
- A platform for formalizing OEIS sequences in Lean 4☆21Jun 10, 2026Updated 5 months ago
- ☆15Jul 13, 2021Updated 5 years ago
- ☆20Nov 7, 2019Updated 7 years ago
- BSQ: Exploring Bit-Level Sparsity for Mixed-Precision Neural Network Quantization (ICLR 2021)☆41Jan 12, 2021Updated 5 years ago
- Optimized Parallel Tiled Approach to perform Matrix Multiplication by taking advantage of the lower latency, higher bandwidth shared memo…☆17Sep 24, 2017Updated 9 years ago
- Simple example of how to write an Implicit GEMM Convolution in CUDA using the tensor core WMMA API and bindings for PyTorch.☆19Jun 29, 2023Updated 3 years ago
- Deploy on Railway without the complexity - Free Credits Offer • AdConnect your repo and Railway handles the rest with instant previews. Quickly provision container image services, databases, and storage volumes.
- ☆11May 3, 2019Updated 7 years ago
- ☆236Jun 11, 2024Updated 2 years ago
- [NSDI'26] PolyRL is a reinforcement learning framework for LLM that harvest spot instances on the cloud to reduce cost.☆20Mar 30, 2026Updated 7 months ago
- ☆32Sep 26, 2025Updated last year
- FROM $f(x)$ AND $g(x)$ TO $f(g(x))$: LLMs Learn New Skills in RL by Composing Old Ones☆73Jan 26, 2026Updated 9 months ago
- This repository is an official code base for our paper, Randomly Removing 50% of Dimensions in Text Embeddings has Minimal Impact on Retr…☆12Oct 15, 2025Updated last year
- [ICML 2022] ShiftAddNAS: Hardware-Inspired Search for More Accurate and Efficient Neural Networks☆15May 18, 2022Updated 4 years ago
- A real-time Gaussian Splatting implementation for SLAM systems, building upon the excellent work of MonoGS and Photo-SLAM.☆11Aug 17, 2025Updated last year
- HALO: Hadamard-Assisted Low-Precision Optimization and Training method for finetuning LLMs. 🚀 The official implementation of https://arx…☆32Feb 17, 2025Updated last year
- Wordpress hosting with auto-scaling - Free Trial Offer • AdFully Managed hosting for WordPress and WooCommerce businesses that need reliable, auto-scalable performance. Cloudways SafeUpdates now available.
- ☆15May 11, 2026Updated 6 months ago
- ☆12Oct 9, 2025Updated last year
- ☆16Jul 17, 2026Updated 3 months ago
- ☆11Aug 26, 2024Updated 2 years ago
- The NYU Systems Seminar☆25Feb 26, 2024Updated 2 years ago
- A Python reference implementation of rigid body dynamics algorithms☆18Sep 25, 2026Updated last month
- Systolic array based hardware for Image processing on the SPARTAN-6 FPGA☆13May 26, 2016Updated 10 years ago
Are these results useful?