A collection of reproducible inference engine benchmarks
☆38Apr 22, 2025Updated last year
Alternatives and similar repositories for llm-ie-benchmarks
Users that are interested in llm-ie-benchmarks are comparing it to the libraries listed below. We may earn a commission when you buy through links labeled 'Ad' on this page.
Sorting:
- Releasing the spot availability traces used in "Can't Be Late" paper.☆27Mar 31, 2024Updated 2 years ago
- Simple python library for generating your own perfetto traces for your application. Can be used for both app instrumentation and custom …☆27Jun 22, 2025Updated last year
- The TinyLlama project is an open endeavor to pretrain a 1.1B Llama model on 3 trillion tokens.☆14Mar 30, 2024Updated 2 years ago
- Tutorial to get started with SkyPilot!☆61May 15, 2024Updated 2 years ago
- Deadline-based hyperparameter tuning on RayTune.☆32Jan 16, 2020Updated 6 years ago
- Wordpress hosting with auto-scaling - Free Trial Offer • AdFully Managed hosting for WordPress and WooCommerce businesses that need reliable, auto-scalable performance. Cloudways SafeUpdates now available.
- Artifacts for SOSP'19 paper Optimizing Deep Learning Computation with Automatic Generation of Graph Substitutions☆21Apr 15, 2022Updated 4 years ago
- ☆84Mar 11, 2025Updated last year
- Few-shot text classification with meta learning and BERT☆11Jun 14, 2021Updated 5 years ago
- See how HTTPX, Requests, and AIOHTTP libraries compare for sending network requests and find out which one may fit your case better.☆22Sep 25, 2025Updated last year
- Fast Vector Operations on Pretty Big Data☆13Nov 17, 2015Updated 10 years ago
- ☆12Apr 18, 2019Updated 7 years ago
- Codebase for HYPHEN, accepted at ACL 2022 (main)☆13May 17, 2022Updated 4 years ago
- Prism.JS theme based on monokai☆13Dec 11, 2015Updated 10 years ago
- Safely push a Cog model version by making sure it works and is backwards-compatible with previous versions.☆17Dec 4, 2025Updated 10 months ago
- AI Agents on DigitalOcean Gradient AI Platform • AdBuild production-ready AI agents using customizable tools or access multiple LLMs through a single endpoint. Create custom knowledge bases or connect external data.
- A powerful and user-friendly tool that generates detailed captions for your images☆21Nov 11, 2024Updated last year
- [MLSys 26] 🥇 Solution for Gated Delta Net Track of MLSys 26 Flash infer competition☆36May 22, 2026Updated 4 months ago
- ☆14Jan 11, 2022Updated 4 years ago
- The data processing pipeline for the Koala chatbot language model☆118Apr 6, 2023Updated 3 years ago
- Experimental encrypted file system using SGX and FUSE☆12Oct 9, 2018Updated 8 years ago
- Single file interpreter (or naive virtual machine) for my intermediate representation. SSA support has been added.☆15Apr 27, 2016Updated 10 years ago
- This is a APRS project for DDP course☆10Apr 1, 2018Updated 8 years ago
- [ICLR 2026] GRAPE: Group Representational Position Encoding (https://arxiv.org/abs/2512.07805)☆121Jun 15, 2026Updated 4 months ago
- LLM-Inference-Bench☆63Jul 18, 2025Updated last year
- Deploy on Railway without the complexity - Free Credits Offer • AdConnect your repo and Railway handles the rest with instant previews. Quickly provision container image services, databases, and storage volumes.
- The offline version of acm-compiler-judge☆13May 16, 2019Updated 7 years ago
- ☆11Jun 16, 2022Updated 4 years ago
- Comparison of Language Model Inference Engines☆245Dec 16, 2024Updated last year
- A patchless architecture, based on MLP-Mixer☆18Dec 30, 2021Updated 4 years ago
- 🕷 哇来扒一扒p站hhhh (Web scraper for pixiv)☆12Aug 13, 2018Updated 8 years ago
- A Triton-only attention backend for vLLM☆28Jul 14, 2026Updated 3 months ago
- A compiler for course Compiler 2019☆16Jan 9, 2020Updated 6 years ago
- A tool that can be used to measure the sequential performance of any OpenAI-compatible LLM API☆25Aug 1, 2024Updated 2 years ago
- Collection of FIO configs for testing various types of disk I/O.☆16Apr 1, 2026Updated 6 months ago
- Deploy on Railway without the complexity - Free Credits Offer • AdConnect your repo and Railway handles the rest with instant previews. Quickly provision container image services, databases, and storage volumes.
- 不到100行代码实现一个Python迷你内网穿透、反向正向代理小工具☆12May 27, 2023Updated 3 years ago
- ☆19Jun 11, 2024Updated 2 years ago
- Course material for "Numerical Methods for Data Science" (SJTU, summer 2018)☆40Jul 6, 2018Updated 8 years ago
- ☆24May 10, 2023Updated 3 years ago
- DEPRECATED - plotly.js finance chart wrapper☆16Oct 14, 2016Updated 10 years ago
- Public repository for "Numerical Methods for Data Science" (SJTU, May-June 2019)☆18Jun 13, 2019Updated 7 years ago
- Training and Inference Notebooks for the RedPajama (OpenLlama) models☆19May 18, 2023Updated 3 years ago