LLM 推理服务性能测试
☆44Dec 17, 2023Updated 2 years ago
Alternatives and similar repositories for llm-inference-benchmark
Users that are interested in llm-inference-benchmark are comparing it to the libraries listed below. We may earn a commission when you buy through links labeled 'Ad' on this page.
Sorting:
- 基于电商导购机器人，自然语言理解（NLU），文本纠错，歧义词消歧☆12May 5, 2020Updated 5 years ago
- LLM Inference benchmark☆433Jul 23, 2024Updated last year
- To better understand the ggml library☆28Jun 13, 2025Updated 9 months ago
- A human-friendly implementation of the iRobot Open Interface version 2 API.☆14May 14, 2016Updated 9 years ago
- [EMNLP2023]: MIRACLE: Towards Personalized Dialogue Generation with Latent-Space Multiple Personal Attribute Control☆12Nov 11, 2023Updated 2 years ago
- Managed hosting for WordPress and PHP on Cloudways • AdManaged hosting with the flexibility to host WordPress, Magento, Laravel, or PHP apps, on multiple cloud providers. Cloudways by DigitalOcean.
- Implementation of AdaCQR(COLING 2025)☆13Dec 30, 2024Updated last year
- ☆12Mar 19, 2022Updated 4 years ago
- CUDA keyring packaging for Debian☆14Apr 14, 2023Updated 2 years ago
- Repository for the COLM 2025 paper SpecDec++: Boosting Speculative Decoding via Adaptive Candidate Lengths☆17Jul 10, 2025Updated 8 months ago
- Build gstreamer on Raspberry Pi 3☆14Nov 2, 2018Updated 7 years ago
- socat - Multipurpose relay (cloned from git://repo.or.cz/socat.git) http://www.dest-unreach.org/socat/☆17Jan 24, 2016Updated 10 years ago
- ☆24Mar 31, 2022Updated 3 years ago
- LLM Agents: Landing Page Generation for an E-commerce Platform Using CrewAI, Groq-LangChain and Qdrant☆15May 30, 2024Updated last year
- High-Performance Linpack Benchmark adopted version for GPU backend☆12Sep 12, 2022Updated 3 years ago
- Proton VPN Special Offer - Get 70% off • AdSpecial partner offer. Trusted by over 100 million users worldwide. Tested, Approved and Recommended by Experts.
- AITemplate is a Python framework which renders neural network into high performance CUDA/HIP C++ code. Specialized for FP16 TensorCore (N…☆12Jun 24, 2024Updated last year
- Generate text images for training deep learning ocr model☆10Oct 22, 2018Updated 7 years ago
- ☆18Oct 6, 2025Updated 5 months ago
- Visual self-questioning for large vision-language assistant.☆45Jul 23, 2025Updated 8 months ago
- A simple, easy-to-hack GraphRAG implementation☆15Sep 21, 2024Updated last year
- Implementation of various algorithms in the Nested Sequential Monte Carlo family of methods.☆14Sep 9, 2015Updated 10 years ago
- ☆15Apr 13, 2024Updated last year
- Pre-built ROCm-GDB and GPU Debug SDK binaries☆16Mar 21, 2019Updated 7 years ago
- In this programming assignment you will implement a streaming video server and client that communicate control commands via the Real-Time…☆11Dec 29, 2012Updated 13 years ago
- Managed Database hosting by DigitalOcean • AdPostgreSQL, MySQL, MongoDB, Kafka, Valkey, and OpenSearch available. Automatically scale up storage and focus on building your apps.
- 用大模型批量处理数据，现支持各种大模型做OCR，支持通义千问, 月之暗面, 百度飞桨OCR, OpenAI 和LLAVA。Use LLM to generate or clean data for academic use. Support OCR with qwen, m…☆16Sep 15, 2024Updated last year
- a game framework. warning: wip, dev, unstable, radiation hazard, defcon 3☆24May 10, 2015Updated 10 years ago
- inference on tvm runtime using c++ with gpu enabled☆10Apr 25, 2018Updated 7 years ago
- FastThresholdClustering is an efficient vector clustering algorithm based on FAISS, particularly suitable for large-scale vector data clu…☆30Dec 17, 2024Updated last year
- ☆12Jan 25, 2023Updated 3 years ago
- ☆21Feb 15, 2024Updated 2 years ago
- A portable simplest oblivious transfer library.☆15Mar 30, 2025Updated 11 months ago
- a simple pingpong buffer test☆12Feb 11, 2015Updated 11 years ago
- Systemback_source-1.9.4☆15Jan 2, 2021Updated 5 years ago
- Managed Kubernetes at scale on DigitalOcean • AdDigitalOcean Kubernetes includes the control plane, bandwidth allowance, container registry, automatic updates, and more for free.
- 小飞机翻墙教程☆24Nov 14, 2019Updated 6 years ago
- tensorrt部署教程☆11Aug 1, 2025Updated 7 months ago
- This is a depth-anything-v2 onnxruntime inference by cpp☆15Sep 2, 2024Updated last year
- [ECCV 2024] M3DBench introduces a comprehensive 3D instruction-following dataset with support for interleaved multi-modal prompts.☆61Oct 1, 2024Updated last year
- Simple test of ARM NEON code. Performs a blit to the framebuffer.☆15Jul 23, 2013Updated 12 years ago
- 友善之臂(FriendlyARM)开发板Tiny6410学习笔记☆14Jun 5, 2018Updated 7 years ago
- Unofficial docker wrapper for Qualcomm SNPE(Snapdragon Neural Processing Engine) SDK☆11Mar 3, 2022Updated 4 years ago