大模型推理压测
☆51Jul 31, 2025Updated last year
Alternatives and similar repositories for llm_benchmark
Users that are interested in llm_benchmark are comparing it to the libraries listed below. We may earn a commission when you buy through links labeled 'Ad' on this page.
Sorting:
- This repository provides the code for applying Contrastive Learning Penalty Loss (CLPL) and Mixture of Experts (MoE) to the BGE-M3 text e…☆11Dec 27, 2024Updated last year
- 用RLHF可选LoRA对LLaMA和MOSS进行训练|Training LLaMA or MOSS with RLHF [LoRA]☆21May 16, 2023Updated 3 years ago
- A locally-running Retrieval Augmented Generation (RAG) system that enables document analysis and question answering using DeepSeek.☆16Jan 25, 2026Updated 6 months ago
- 这个库用于从零开始，搭建一个基于开源大模型的对话系统。包括基本的对话、与文档对话、智能体等多种功能☆10Sep 21, 2024Updated last year
- Ollama RAG using SQL Database☆12Apr 16, 2025Updated last year
- End-to-end encrypted cloud storage - Proton Drive • AdSpecial offer: 40% Off Yearly / 80% Off First Month. Protect your most important files, photos, and documents from prying eyes.
- [RAG训练营] u.geekbang.org/subject/airag/1009927 ESG合规审计系统 - 可持续发展报告检查工具☆41Jun 1, 2025Updated last year
- 安卓手机部署DeepSeek-R1 蒸馏的1.5B模型☆25Feb 4, 2025Updated last year
- 通用简单工具项目☆22Oct 6, 2024Updated last year
- A2A协议智能体通信演示项目 - 支持流式响应、推送通知和文件附件的智能体客户端☆21Jun 9, 2025Updated last year
- MCP实战☆105Jul 16, 2025Updated last year
- 国产加速卡-海光DCU实战（大模型训练、微调、推理 等）☆98Aug 10, 2025Updated last year
- LLM 并发性能测试工具，支持自动化压力测试和性能报告生成。☆272Dec 10, 2025Updated 8 months ago
- [RAG训练营] u.geekbang.org/subject/airag/1009927 这是我用Cursor自行制作的RAG Framework，好处是可以掌控RAG每一个环节的教学细节。☆116Oct 28, 2025Updated 9 months ago
- You Only Look At Face☆35Jun 24, 2020Updated 6 years ago
- AI Agents on DigitalOcean Gradient AI Platform • AdBuild production-ready AI agents using customizable tools or access multiple LLMs through a single endpoint. Create custom knowledge bases or connect external data.
- A CUDA-based voxelizer used in acoustics FDTD calculations.☆11Dec 10, 2020Updated 5 years ago
- This project enhances the LLaMA-2 model using Quantized Low-Rank Adaptation (QLoRA) and other parameter-efficient fine-tuning techniques …☆13Apr 18, 2024Updated 2 years ago
- Optimize QWen1.5 models with TensorRT-LLM☆17May 14, 2024Updated 2 years ago
- CCKS举办的针对电子病例的信息抽取比赛，主要是进行医疗实体及事件抽取，本项目包括展示比赛的不断改进与多种方法的尝试，最终取得：valid第6名；test第9名。☆15Oct 10, 2021Updated 4 years ago
- TensorRT☆11Sep 22, 2020Updated 5 years ago
- 人脸贴纸☆37Aug 23, 2020Updated 5 years ago
- 自己阅读的多模态对话系统论文（及部分笔记）汇总☆22Jan 5, 2023Updated 3 years ago
- 本体驱动的简单demo，基于知识图谱的智能校园课程与职业规划顾问。通过本体建模 + 规则推理 + 自然语言问答，为学生提供选课建议、职业规划、技能缺口分析等服务，并完整可视化每一步推理路径。☆30Jul 17, 2026Updated 3 weeks ago
- 在RAG技术中，嵌入向量的生成和匹配是关键环节。本文介绍了一种基于CLIP/BLIP模型的嵌入服务，该服务支持文本和图像的嵌入生成与相似度计算，为多模态信息检索提供了基础能力。☆42Dec 28, 2024Updated last year
- Managed hosting for WordPress and PHP on Cloudways • AdManaged hosting for WordPress, Magento, Laravel, or PHP apps, on multiple cloud providers. Deploy in minutes on Cloudways by DigitalOcean.
- ☆17Jan 31, 2025Updated last year
- BERT&RoBERTa预训练代码，tensorflow和torch两种版本实现☆13Feb 8, 2023Updated 3 years ago
- 简单好用的WEB堡垒机☆25Dec 26, 2024Updated last year
- ☆15Feb 7, 2024Updated 2 years ago
- 🧠🖼️🐍 A Python wrapper around the BrainFrame REST API☆12Jun 28, 2026Updated last month
- ☆43Apr 16, 2026Updated 3 months ago
- Visualize the Expert Parallelism Load Balancer☆19Mar 15, 2025Updated last year
- Image Visualization Tools for C++☆14Oct 6, 2021Updated 4 years ago
- Qwen2-VL在文旅领域的LLaMA-Factory微调案例 The case for fine-tuning Qwen2-VL in the field of historical literature and museums☆15Sep 17, 2024Updated last year
- Deploy to Railway using AI coding agents - Free Credits Offer • AdUse Claude Code, Codex, OpenCode, and more. Autonomous software development now has the infrastructure to match with Railway.
- ☆16Oct 19, 2025Updated 9 months ago
- Llama3 Streaming Chat Sample☆22Apr 24, 2024Updated 2 years ago
- ☆20Jan 7, 2024Updated 2 years ago
- a fast async pool based on channel☆26Apr 22, 2026Updated 3 months ago
- character recognition, textline recognition☆10Aug 31, 2019Updated 6 years ago
- [RAG训练营] u.geekbang.org/subject/airag/1009927 通过csv文件和Neo4J构建知识图谱，并增强RAG效果☆20May 3, 2025Updated last year
- ☆10Jan 13, 2020Updated 6 years ago