大模型推理压测
☆51Jul 31, 2025Updated last year
Alternatives and similar repositories for llm_benchmark
Users that are interested in llm_benchmark are comparing it to the libraries listed below. We may earn a commission when you buy through links labeled 'Ad' on this page.
Sorting:
- 用RLHF可选LoRA对LLaMA和MOSS进行训练|Training LLaMA or MOSS with RLHF [LoRA]☆21May 16, 2023Updated 3 years ago
- A locally-running Retrieval Augmented Generation (RAG) system that enables document analysis and question answering using DeepSeek.☆17Jan 25, 2026Updated 8 months ago
- Explorations into adversarial losses on top of autoregressive loss for language modeling☆41Dec 21, 2025Updated 9 months ago
- Ollama RAG using SQL Database☆11Apr 16, 2025Updated last year
- 安卓手机部署DeepSeek-R1 蒸馏的1.5B模型☆25Feb 4, 2025Updated last year
- Managed hosting for WordPress and PHP on Cloudways • AdManaged hosting for WordPress, Magento, Laravel, or PHP apps, on multiple cloud providers. Deploy in minutes on Cloudways by DigitalOcean.
- 通用简单工具项目☆22Oct 6, 2024Updated last year
- A2A协议智能体通信演示项目 - 支持流式响应、推送通知和文件附件的智能体客户端☆21Jun 9, 2025Updated last year
- MCP实战☆107Jul 16, 2025Updated last year
- 国产加速卡-海光DCU实战（大模型训练、微调、推理 等）☆113Aug 10, 2025Updated last year
- ☆28Nov 15, 2020Updated 5 years ago
- A Model Context Protocol Server for AI models to interface with the Tesla Fleet API.☆16Mar 14, 2025Updated last year
- [RAG训练营] u.geekbang.org/subject/airag/1009927 这是我用Cursor自行制作的RAG Framework，好处是可以掌控RAG每一个环节的教学细节。☆121Oct 28, 2025Updated 10 months ago
- 集成雅黑和Inconsolata的字体☆22Mar 24, 2020Updated 6 years ago
- 电商广告推荐系统☆14Jun 3, 2022Updated 4 years ago
- Managed Database hosting by DigitalOcean • AdPostgreSQL, MySQL, MongoDB, Kafka, Valkey, and OpenSearch available. Automatically scale up storage and focus on building your apps.
- FastAPI Chat App with WebSockets is an open-source real-time chat application built on the FastAPI framework. This project provides a rob…☆15Jan 7, 2024Updated 2 years ago
- PHP with FPM Dockerfile for trusted automated Docker builds.☆12Mar 2, 2016Updated 10 years ago
- ☆14Feb 26, 2022Updated 4 years ago
- Optimize QWen1.5 models with TensorRT-LLM☆17May 14, 2024Updated 2 years ago
- CCKS举办的针对电子病例的信息抽取比赛，主要是进行医疗实体及事件抽取，本项目包括展示比赛的不断改进与多种方法的尝试，最终取得：valid第6名；test第9名。☆14Oct 10, 2021Updated 4 years ago
- [DASFAA 2025] Enhancing Retrieval-Augmented Generation with Multi-Modal Knowledge Graph Integration☆15Feb 28, 2026Updated 6 months ago
- TensorRT☆11Sep 22, 2020Updated 6 years ago
- 人脸贴纸☆37Aug 23, 2020Updated 6 years ago
- 自己阅读的多模态对话系统论文（及部分笔记）汇总☆22Jan 5, 2023Updated 3 years ago
- Managed hosting for WordPress and PHP on Cloudways • AdManaged hosting for WordPress, Magento, Laravel, or PHP apps, on multiple cloud providers. Deploy in minutes on Cloudways by DigitalOcean.
- 华东师范大学课程表导出工具☆19Jan 1, 2022Updated 4 years ago
- train cifar10 example with mixup method☆10Dec 30, 2017Updated 8 years ago
- PLM: Efficient Peripheral Language Models Hardware-Co-Designed for Ubiquitous Computing☆21Mar 18, 2025Updated last year
- 大模型推理框架加速，让 LLM 飞起来☆25May 10, 2024Updated 2 years ago
- 在RAG技术中，嵌入向量的生成和匹配是关键环节。本文介绍了一种基于CLIP/BLIP模型的嵌入服务， 该服务支持文本和图像的嵌入生成与相似度计算，为多模态信息检索提供了基础能力。☆42Dec 28, 2024Updated last year
- ☆17Jan 31, 2025Updated last year
- 本体驱动的简单demo，基于知识图谱的智能校园课程与职业规划顾问。通过本体建模 + 规则推理 + 自然语言问答，为学生提供选课建议、职业规划、技能缺口分析等服务，并完整可视化每一步推理路径。☆42Jul 17, 2026Updated 2 months ago
- ☆15Feb 7, 2024Updated 2 years ago
- ASR, End-to-End, end2end, Speech Recognition, 端到端语音识别☆12Oct 25, 2020Updated 5 years ago
- Serverless GPU API endpoints on Runpod - Get Bonus Credits • AdSkip the infrastructure headaches. Auto-scaling, pay-as-you-go, no-ops approach lets you focus on innovating your application.
- Distributed data eXchange Framework,which allows to build data marketplaces .☆20May 6, 2019Updated 7 years ago
- Visualize the Expert Parallelism Load Balancer☆17Mar 15, 2025Updated last year
- Image Visualization Tools for C++☆14Oct 6, 2021Updated 4 years ago
- Qwen2-VL在文旅领域的LLaMA-Factory微调案例 The case for fine-tuning Qwen2-VL in the field of historical literature and museums☆15Sep 17, 2024Updated 2 years ago
- Llama3 Streaming Chat Sample☆22Apr 24, 2024Updated 2 years ago
- SPO | Self-Supervised Prompt Optimization☆28Mar 4, 2025Updated last year
- ☆16Oct 19, 2025Updated 11 months ago