大模型推理框架加速，让 LLM 飞起来
☆25May 10, 2024Updated 2 years ago
Alternatives and similar repositories for lm-fly
Users that are interested in lm-fly are comparing it to the libraries listed below. We may earn a commission when you buy through links labeled 'Ad' on this page.
Sorting:
- Examples for QinYan GLMs☆13Sep 3, 2024Updated 2 years ago
- 基于langchain设计的智能体任务，包含规划会话场景资源，构建子任务，任务执行器包含（MCTS）☆32Nov 10, 2025Updated 11 months ago
- 🔥Your Daily Dose of AI Research from Hugging Face 🔥 Stay updated with the latest AI breakthroughs! This bot automatically collects and…☆60Oct 23, 2026Updated last week
- ⚡ Universal developer toolkit powered by Rust & WebAssembly. Comprehensive tools for software development, hardware engineering, and cybe…☆30Apr 24, 2026Updated 6 months ago
- 2023年西交利物浦大学动云科技GMaster战队雷达yolo小目标检测☆18Aug 30, 2023Updated 3 years ago
- Serverless GPU API endpoints on Runpod - Get Bonus Credits • AdSkip the infrastructure headaches. Auto-scaling, pay-as-you-go, no-ops approach lets you focus on innovating your application.
- A static performance model for LLM inference: given (model, GPU, interconnect, workload), instantly answer VRAM feasibility, latency(TTFT…☆21Oct 6, 2026Updated 3 weeks ago
- 中文海事大模型郑和（Zh-LLM）☆25Dec 18, 2023Updated 2 years ago
- A curated list of research papers on Token Communications (TokenCom) and closely related Semantic-/Goal-oriented Communication topics.☆17Apr 18, 2026Updated 6 months ago
- 😜 表情包视觉数据集，使用glm-4v、step-1v的图像解析能力标注。☆148Apr 27, 2024Updated 2 years ago
- 使用 CUDA C++ 实现的 llama 模型推理框架☆64Nov 8, 2024Updated last year
- [AAAI'26 Oral] PurMM: Attention-Guided Test-Time Backdoor Purification in Multimodal Large Language Models☆16Mar 22, 2026Updated 7 months ago
- LLM智能路由网关、 Enterprise Intelligent AI-API Distribution Gateway☆14Jan 24, 2025Updated last year
- ☆15Apr 15, 2022Updated 4 years ago
- ☆19Jul 29, 2025Updated last year
- Deploy open-source AI quickly and easily - Special Bonus Offer • AdRunpod Hub is built for open source. One-click deployment and autoscaling endpoints without provisioning your own infrastructure.
- ☆19Sep 10, 2026Updated last month
- Grouping and Recognize speaker from an animation video. 从动漫中提取每一个说话人。☆13May 8, 2024Updated 2 years ago
- ☆17Feb 10, 2023Updated 3 years ago
- A UI interface for Gemini | 快速与 Gemini 对话☆13Dec 17, 2023Updated 2 years ago
- 吴恩达深度学习课程笔 记PyTorch版☆21Nov 2, 2025Updated 11 months ago
- LLM Inference with Deep Learning Accelerator.☆59Jan 23, 2025Updated last year
- Yet Another LLM Inference System☆18Mar 1, 2026Updated 7 months ago
- erniebot兼容openai的API调用方式，支持流式，非流式调用 ，支持system提示词☆20Apr 28, 2025Updated last year
- This repository features my solution for the DevFest '24 Challenge by @GDGAlgiers , where I used Proximal Policy Optimization (PPO) to op…☆18Aug 12, 2026Updated 2 months ago
- Proton VPN Special Offer - Get 70% off • AdSpecial partner offer. Trusted by over 100 million users worldwide. Tested, Approved and Recommended by Experts.
- 这是一个带管理界面的AI对话转换和转发平台，参考了ONE-API，初期的业务逻辑和实现方式都会参考它。☆24Sep 15, 2024Updated 2 years ago
- 李鲁鲁老师的 Copilot-Python 学习。和ChatGPT等大语言模型协同进化。☆10Jun 3, 2025Updated last year
- 使用 Rust 语言重新实现 https://github.com/zjhellofss/KuiperInfer 和 https://github.com/zjhellofss/kuiperdatawhale 中的深度学习推理框架。☆17Apr 9, 2024Updated 2 years ago
- 面向胰腺癌肿瘤患者的智能RAG平台☆210Dec 12, 2025Updated 10 months ago
- ☆15Mar 11, 2026Updated 7 months ago
- gpt-4o前两天发布会有了视频聊天版本，再模仿前两天谷歌发布会的多模态AI项目Project Astra，粗略挫了个视觉聊天模型。现在能跟他自由交谈，它会根据摄像头拍到的画面与使用者的语言进行反映，并实时声音输出。目前英语效果是最好的，中文也算能支持。演示程序未加速未剪辑…☆43May 23, 2024Updated 2 years ago
- Pipeline-Parallel Lecture: Simplest Dualpipe Implementation.☆31Sep 17, 2025Updated last year
- A python plugin for Chatgpt On Wechat☆16Jul 1, 2024Updated 2 years ago
- A collection of practical Claude Code skills for real-world development workflows☆28Sep 12, 2026Updated last month
- Deploy on Railway without the complexity - Free Credits Offer • AdConnect your repo and Railway handles the rest with instant previews. Quickly provision container image services, databases, and storage volumes.
- ☆25Mar 31, 2022Updated 4 years ago
- 大模型/LLM推理和部署理论与实践☆434Jul 14, 2025Updated last year
- ☆22Apr 22, 2024Updated 2 years ago
- [NAACL 2024] TabSQLify: Enhancing Reasoning Capabilities of LLMs Through Table Decomposition☆19Jan 5, 2026Updated 9 months ago
- 上海大学本硕博一体化选课系统自动选课工具☆17Oct 30, 2022Updated 4 years ago
- 自制基于C++的深度学习前向推理框架☆22Jun 4, 2023Updated 3 years ago
- Continuous Pipelined Speculative Decoding☆22May 25, 2026Updated 5 months ago