大模型推理框架加速,让 LLM 飞起来
☆25May 10, 2024Updated 2 years ago
Alternatives and similar repositories for lm-fly
Users that are interested in lm-fly are comparing it to the libraries listed below. We may earn a commission when you buy through links labeled 'Ad' on this page.
Sorting:
- Examples for QinYan GLMs☆13Sep 3, 2024Updated 2 years ago
- AI Emoji Argue Agent 🚀 基于LangChain的开源表情包斗图Agent☆29May 30, 2024Updated 2 years ago
- 基于langchain设计的智能体任务,包含规划会话场景资源,构建子任务,任务执行器包含(MCTS)☆32Nov 10, 2025Updated last year
- 🌱 将智谱清言官方智能体API转换为OpenAI兼容协议的网关 👋 帮助开发者们降低接入API的门槛☆59May 11, 2024Updated 2 years ago
- MCP Server for the UniFuncs API☆11Sep 11, 2026Updated 2 months ago
- Wordpress hosting with auto-scaling - Free Trial Offer • AdFully Managed hosting for WordPress and WooCommerce businesses that need reliable, auto-scalable performance. Cloudways SafeUpdates now available.
- 🔥Your Daily Dose of AI Research from Hugging Face 🔥 Stay updated with the latest AI breakthroughs! This bot automatically collects and…☆61Updated this week
- 书生实战营第六期打榜数据集测评方案☆12Mar 17, 2026Updated 8 months ago
- 中文海事大模型郑和(Zh-LLM)☆24Dec 18, 2023Updated 2 years ago
- Accepted by NAACL 2025 main conference.☆11Jan 24, 2025Updated last year
- 使用 CUDA C++ 实现的 llama 模型推理框架☆64Nov 8, 2024Updated 2 years ago
- 😜 表情包视觉数据集,使用glm-4v、step-1v的图像解析能力标注。☆148Apr 27, 2024Updated 2 years ago
- Vllm (A high-throughput and memory-efficient inference and serving engine for LLMs)推理框架源码学习☆14Aug 15, 2025Updated last year
- The fastest off-the-shelf inference algorithm for LLMs (ICLR’25)☆14Mar 8, 2025Updated last year
- Ollama RAG using SQL Database☆11Nov 4, 2026Updated 2 weeks ago
- Managed Kubernetes at scale on DigitalOcean • AdDigitalOcean Kubernetes includes the control plane, bandwidth allowance, container registry, automatic updates, and more for free.
- 本项目致力于为大模型领域的初学者提供全面的知识体系,包括基础和高阶内容,以便开发者能迅速掌握大模型技术栈并全面了解相关知识。☆64Jan 6, 2025Updated last year
- ☆14Apr 15, 2022Updated 4 years ago
- 一键QQ聊天记录读取,进行时间序列、词频、情感分析,可视化,☆11Jun 13, 2023Updated 3 years ago
- Grouping and Recognize speaker from an animation video. 从动漫中提取每一个说话人。☆13May 8, 2024Updated 2 years ago
- LLM智能路由网关、 Enterprise Intelligent AI-API Distribution Gateway☆14Jan 24, 2025Updated last year
- 基于 FastAPI 的生产级 AI Agent 框架,支持 100+ LLM 提供商、MCP 工具集成、多 Agent 协作、RAG 知识库和沙箱隔离执行☆27Mar 24, 2026Updated 7 months ago
- ☆19Nov 7, 2026Updated last week
- Creating an analytics application for military aircraft using ADS-B.☆12Jul 14, 2024Updated 2 years ago
- Multi-agent TRIZ workflow (LangGraph+LangChain) with TRIZ tools, RAG, and evaluation — from our ICAART 2025 paper "TRIZ Agents: A Multi-A…☆14Sep 23, 2025Updated last year
- Open source password manager - Proton Pass • AdSecurely store, share, and autofill your credentials with Proton Pass, the end-to-end encrypted password manager trusted by millions.
- 吴恩达深度学习课程笔记PyTorch版☆22Nov 2, 2025Updated last year
- [NeurIPS 2025] CAM: A Constructivist View of Agentic Memory for LLM-Based Reading Comprehension☆23Oct 8, 2025Updated last year
- 🤖 A multilingual translation tool that automatically converts Hugging Face's daily AI research papers into 🇯🇵 Japanese, 🇰🇷 Korean, �…☆18Oct 27, 2026Updated 3 weeks ago
- LLM Inference with Deep Learning Accelerator.☆59Jan 23, 2025Updated last year
- 服务器以及免费paas平台中运行pandoranext-tokentool和pandoranext☆13Jan 7, 2024Updated 2 years ago
- 属于每个人的公众号”查特查特“上线啦!新问题、新方法、新发现,欢迎提PR!☆46Nov 23, 2023Updated 2 years ago
- 使用 Rust 语言重新实现 https://github.com/zjhellofss/KuiperInfer 和 https://github.com/zjhellofss/kuiperdatawhale 中的深度学习推理框架。☆17Apr 9, 2024Updated 2 years ago
- ☆19Sep 26, 2026Updated last month
- The official repo for our paper: LegalAgentBench: Evaluating LLM Agents in Legal Domainl☆54Apr 10, 2026Updated 7 months ago
- 1-Click AI Models by DigitalOcean Gradient • AdDeploy popular AI models on DigitalOcean Gradient GPU virtual machines with just a single click. Zero configuration with optimized deployments.
- The aim of this project is to publish and archive newsletters to a target email address.☆21Jan 13, 2024Updated 2 years ago
- Yet Another LLM Inference System☆18Mar 1, 2026Updated 8 months ago
- 面向胰腺癌肿瘤患者的智能RAG平台☆209Nov 12, 2026Updated last week
- 这是一个带管理界面的AI对话转换和转发平台,参考了ONE-API,初期的业务逻辑和实现方式都会参考它。☆24Sep 15, 2024Updated 2 years ago
- 高性能计算课程&CUDA编程实例&深度学习推理框架☆76Sep 21, 2023Updated 3 years ago
- 基于 ChatGLM2-6B 的中英文翻译器☆13Aug 2, 2023Updated 3 years ago
- 基于高德API获取地理位置的Cordova插件☆22May 20, 2018Updated 8 years ago
Are these results useful?