A collection of reproducible inference engine benchmarks
☆38Apr 22, 2025Updated last year
Alternatives and similar repositories for llm-ie-benchmarks
Users that are interested in llm-ie-benchmarks are comparing it to the libraries listed below. We may earn a commission when you buy through links labeled 'Ad' on this page.
Sorting:
- ☆33Apr 19, 2025Updated last year
- ☆41Updated this week
- K8s Launch Kit (l8k) is a CLI tool for deploying and managing NVIDIA cloud-native solutions on Kubernetes. The tool helps provide flexibl…☆18Updated this week
- Simple python library for generating your own perfetto traces for your application. Can be used for both app instrumentation and custom …☆27Jun 22, 2025Updated last year
- A service for launching containerized processes on cloud infrastructure.☆12Nov 16, 2023Updated 2 years ago
- Managed hosting for WordPress and PHP on Cloudways • AdManaged hosting for WordPress, Magento, Laravel, or PHP apps, on multiple cloud providers. Deploy in minutes on Cloudways by DigitalOcean.
- [EMNLP 2025 Findings] Familiarity-aware Evidence Compression for Retrieval Augmented Generation☆15Aug 20, 2025Updated last year
- Tutorial to get started with SkyPilot!☆61May 15, 2024Updated 2 years ago
- Deadline-based hyperparameter tuning on RayTune.☆32Jan 16, 2020Updated 6 years ago
- Large Language Models are zero-shot text classifiers; Smart Expert System: Large Language Models as Text Classifiers☆39May 30, 2024Updated 2 years ago
- Chakra et_replay is a tool designed for replaying Chakra Execution Traces (ET) from machine learning models using PyTorch.☆14Oct 23, 2026Updated 2 weeks ago
- TPU support for the fastai library☆14Apr 15, 2021Updated 5 years ago
- My personal solutions to some textbook problems☆12Feb 12, 2020Updated 6 years ago
- The TinyLlama project is an open endeavor to pretrain a 1.1B Llama model on 3 trillion tokens.☆14Mar 30, 2024Updated 2 years ago
- Different models, the same brief - a collection of demos built from shared prompts, with source, screenshots, and notes.☆16Oct 13, 2026Updated 3 weeks ago
- Deploy on Railway without the complexity - Free Credits Offer • AdConnect your repo and Railway handles the rest with instant previews. Quickly provision container image services, databases, and storage volumes.
- The main repository of sse.tongji.edu.cn☆16Oct 28, 2015Updated 11 years ago
- 利用github actions跟踪一些仓库的每日更新☆22Updated this week
- Fast Vector Operations on Pretty Big Data☆13Nov 17, 2015Updated 10 years ago
- 🔥 LLM-powered GPU kernel synthesis: Train models to convert PyTorch ops into optimized Triton kernels via SFT+RL. Multi-turn compilation…☆153Nov 10, 2025Updated 11 months ago
- A Systematic Verification and Structured Revision of Humanity’s Last Exam☆17Feb 27, 2026Updated 8 months ago
- ARC-AGI-3 Milestone 2 solution built on Tufa Labs’ Duck harness, with improved agent tools, compute scheduling, and SGLang serving.☆17Sep 30, 2026Updated last month
- The (open-source part of) code to reproduce "BPPSA: Scaling Back-propagation by Parallel Scan Algorithm".☆13Jun 7, 2021Updated 5 years ago
- Genai-bench is a powerful benchmark tool designed for comprehensive token-level performance evaluation of large language model (LLM) serv…☆335Oct 14, 2026Updated 3 weeks ago
- 基于 sgl-project/sglang 上游社区版本建设的 das 下游适配仓库，面向 hcu 平台进行功能适配与优化。☆48Updated this week
- Proton VPN Special Offer - Get 70% off • AdSpecial partner offer. Trusted by over 100 million users worldwide. Tested, Approved and Recommended by Experts.
- Evaluate your model using advanced prompt strategies☆21Jan 30, 2026Updated 9 months ago
- ☆11Jan 3, 2024Updated 2 years ago
- ☆28May 2, 2023Updated 3 years ago
- Local LLM speed measurements from a 4x RTX 3090 rig, with exact launch commands and per-run provenance.☆18Aug 15, 2026Updated 2 months ago
- Safely push a Cog model version by making sure it works and is backwards-compatible with previous versions.☆17Updated this week
- ExpertFingerprinting: Behavioral Pattern Analysis and Specialization Mapping of Experts in GPT-OSS-20B's Mixture-of-Experts Architecture☆31Feb 3, 2026Updated 9 months ago
- ☆12Apr 18, 2019Updated 7 years ago
- [Version 0.5.0][Registered Package][Functional] (max,+) and (min,+) algebra toolbox for Julia from Scilab toolbox☆10Sep 28, 2026Updated last month
- Experimental encrypted file system using SGX and FUSE☆12Oct 9, 2018Updated 8 years ago
- AI Agents on DigitalOcean Gradient AI Platform • AdBuild production-ready AI agents using customizable tools or access multiple LLMs through a single endpoint. Create custom knowledge bases or connect external data.
- Official Code for AutoLLMResearch: Training Research Agents for Automating LLM Experiment Configuration — Learning from Cheap, Optimizing…☆16May 12, 2026Updated 5 months ago
- This is an updated version of the MolecularTransformer of Schwaller et. al.☆14Jan 17, 2022Updated 4 years ago
- [NAACL 2024] CoE-SQL: In-Context Learning for Multi-Turn Text-to-SQL with Chain-of-Editions☆13May 7, 2024Updated 2 years ago
- LLM-Inference-Bench☆63Jul 18, 2025Updated last year
- Libraries containing all pieces common across different Sveltos repositories☆13Updated this week
- [Re-implementation] FixMatch: Simplifying Semi-Supervised Learning with Consistency and Confidence☆15Jun 29, 2020Updated 6 years ago
- Building a Deep Learning Powered Emoji Slackbot!☆14Jul 23, 2020Updated 6 years ago