LLM 推理服务性能测试
☆44Dec 17, 2023Updated 2 years ago
Alternatives and similar repositories for llm-inference-benchmark
Users that are interested in llm-inference-benchmark are comparing it to the libraries listed below. We may earn a commission when you buy through links labeled 'Ad' on this page.
Sorting:
- 基于电商导购机器人，自然语言理解（NLU），文本纠错，歧义词消歧☆12May 5, 2020Updated 6 years ago
- LLM Inference benchmark☆437Jul 23, 2024Updated last year
- This is the official implementation for our paper;"LAR:Look Around and Refer".☆30Dec 1, 2022Updated 3 years ago
- gradio bbox labeling tools☆11May 12, 2023Updated 3 years ago
- Uniformaly: Towards Task-Agnostic Unified Anomaly Detection☆16Sep 15, 2023Updated 2 years ago
- Deploy on Railway without the complexity - Free Credits Offer • AdConnect your repo and Railway handles the rest with instant previews. Quickly provision container image services, databases, and storage volumes.
- Implementation of AdaCQR(COLING 2025)☆15Dec 30, 2024Updated last year
- 东方隐侠安全团队 AI Agent Skills大集合☆51Mar 22, 2026Updated 3 months ago
- Repository for the COLM 2025 paper SpecDec++: Boosting Speculative Decoding via Adaptive Candidate Lengths☆19Jul 10, 2025Updated 11 months ago
- CVPR25☆28Jul 2, 2025Updated last year
- MobileSAM のエンコーダー/デコーダーをONNXに変換し、推論するサンプル☆12Apr 11, 2024Updated 2 years ago
- Asterinas Confidential Computing is a collection of open-source projects featuring full-stack capabilities in confidential computing.☆17Oct 15, 2024Updated last year
- A Framework for Machine Learning on Encrypted Data☆12Feb 10, 2022Updated 4 years ago
- Universal AI-powered code reviewer using vLLM and/or Ollama provided local LLMs. Works with any language/project. Features persona system…☆43May 30, 2026Updated last month
- Generate text images for training deep learning ocr model☆10Oct 22, 2018Updated 7 years ago
- Deploy on Railway without the complexity - Free Credits Offer • AdConnect your repo and Railway handles the rest with instant previews. Quickly provision container image services, databases, and storage volumes.
- Visual self-questioning for large vision-language assistant.☆44Jul 23, 2025Updated 11 months ago
- 大语言模型评估平台，支持多种评估基准、自定义数据集和性能测试。支持基于自定义数据集的RAG评估。☆93Aug 20, 2025Updated 10 months ago
- A simple, easy-to-hack GraphRAG implementation☆15Sep 21, 2024Updated last year
- ☆10Jul 18, 2024Updated last year
- ☆16Apr 13, 2024Updated 2 years ago
- Pre-built ROCm-GDB and GPU Debug SDK binaries☆16Mar 21, 2019Updated 7 years ago
- In this programming assignment you will implement a streaming video server and client that communicate control commands via the Real-Time…☆11Dec 29, 2012Updated 13 years ago
- 用大模型批量处理数据，现支持各种大模型做OCR，支持通义千问, 月之暗面, 百度飞桨OCR, OpenAI 和LLAVA。Use LLM to generate or clean data for academic use. Support OCR with qwen, m…☆17Sep 15, 2024Updated last year
- a game framework. warning: wip, dev, unstable, radiation hazard, defcon 3☆24May 10, 2015Updated 11 years ago
- Deploy on Railway without the complexity - Free Credits Offer • AdConnect your repo and Railway handles the rest with instant previews. Quickly provision container image services, databases, and storage volumes.
- ☆16Nov 19, 2025Updated 7 months ago
- inference on tvm runtime using c++ with gpu enabled☆10Apr 25, 2018Updated 8 years ago
- ☆12Jan 25, 2023Updated 3 years ago
- ☆21Feb 15, 2024Updated 2 years ago
- Privacy-preserving k-means clustering on data owned by multiple parties☆14May 10, 2016Updated 10 years ago
- a simple pingpong buffer test☆12Feb 11, 2015Updated 11 years ago
- [NeurIPS 2024] Official PyTorch implementation of "Improving Compositional Reasoning of CLIP via Synthetic Vision-Language Negatives"☆48Dec 1, 2024Updated last year
- 这是一个基于OpenCompass的模型评测系统，该系统提供了前端页面UI以方便用户自助开展评测工作。☆27Aug 25, 2025Updated 10 months ago
- tensorrt部署教程☆11Aug 1, 2025Updated 11 months ago
- Deploy open-source AI quickly and easily - Special Bonus Offer • AdRunpod Hub is built for open source. One-click deployment and autoscaling endpoints without provisioning your own infrastructure.
- This is a depth-anything-v2 onnxruntime inference by cpp☆15Sep 2, 2024Updated last year
- Simple test of ARM NEON code. Performs a blit to the framebuffer.☆15Jul 23, 2013Updated 12 years ago
- Applications for OpenCL testing on Toradex Apalis iMX6Q☆13Dec 2, 2022Updated 3 years ago
- ☆11Nov 21, 2022Updated 3 years ago
- FedBERT : A federated approach that enables clients with limited computing resource to participate without violating data privacy.☆14Jul 3, 2023Updated 3 years ago
- ☆15Apr 20, 2022Updated 4 years ago
- Can 3D Vision-Language Models Truly Understand Natural Language?☆20Mar 28, 2024Updated 2 years ago