zRzRzRzRzRzRzR / lm-flyLinks
大模型推理框架加速，让 LLM 飞起来
☆24Updated last year
Alternatives and similar repositories for lm-fly
Users that are interested in lm-fly are comparing it to the libraries listed below
Sorting:
- 基于langchain设计的智能体任务，包含规划会话场景资源，构建子任务，任务执行器包含（MCTS）☆32Updated last month
- 🔥Your Daily Dose of AI Research from Hugging Face 🔥 Stay updated with the latest AI breakthroughs! This bot automatically collects and…☆56Updated last week
- 一起来养一只拥有专属记忆的AI猫猫吧！☆10Updated last year
- Examples for QinYan GLMs☆13Updated last year
- GLM Series Edge Models☆156Updated 6 months ago
- 我们是第一个完全可商用的角色大模型。☆40Updated last year
- DashInfer is a native LLM inference engine aiming to deliver industry-leading performance atop various hardware architectures, including …☆272Updated 5 months ago
- ☆16Updated last year
- 基于Llama3，通过进一步CPT，SFT，ORPO得到的中文版Llama3☆17Updated last year
- A fluent, scalable, and easy-to-use LLM data processing framework.☆26Updated this week
- This is a user guide for the MiniCPM and MiniCPM-V series of small language models (SLMs) developed by ModelBest. “面壁小钢炮” focuses on achi…☆297Updated 6 months ago
- 😜 表情包视觉数据集，使用glm-4v、step-1v的图像解析能力标注。☆144Updated last year
- vLLM Documentation in Chinese Simplified / vLLM 中文文档☆143Updated 3 weeks ago
- LLM101n: Let's build a Storyteller 中文版☆138Updated last year
- Model compression toolkit engineered for enhanced usability, comprehensiveness, and efficiency.☆237Updated last week
- xllamacpp - a Python wrapper of llama.cpp☆68Updated last week
- ☆30Updated 6 months ago
- Mixture-of-Experts (MoE) Language Model☆192Updated last year
- vllm混合推理扩展插件，支持多NUMA混合推理，单卡推理Qwen3-Next模型可达1000+ prefill☆29Updated 2 months ago
- gpt_server是一个用于生产级部署LLMs、Embedding、Reranker、ASR、TTS、文生图、图片编辑和文生视频的开源框架。☆243Updated 2 weeks ago
- RAG SYSTEM FOR RWKV☆52Updated last year
- LLM 推理服务性能测试☆44Updated 2 years ago
- （撰写ing..)本仓库偏教程性质，以「模型中文化」为一个典型的模型训练问题切入场景，指导读者上手学习LLM二次微调训练。☆36Updated last year
- Collection of model-centric MCP servers☆24Updated 7 months ago
- CPM.cu is a lightweight, high-performance CUDA implementation for LLMs, optimized for end-device inference and featuring cutting-edge tec…☆214Updated 2 months ago
- llms related stuff , including code, docs☆13Updated 10 months ago
- ☆174Updated last year
- A simple and well-tailored LLM application framework that enables you to seamlessly integrate LLM capabilities in the most "Code-Centric"…☆73Updated last week
- LLM Inference benchmark☆430Updated last year
- An AI-powered content conversion tool that transforms text, web content, or HTML code into beautifully designed card images.一款基于AI的内容转换工…☆33Updated 5 months ago