zRzRzRzRzRzRzR / lm-fly
大模型推理框架加速，让 LLM 飞起来
☆19Updated 9 months ago
Alternatives and similar repositories for lm-fly:
Users that are interested in lm-fly are comparing it to the libraries listed below
- 使用langchain进行任务规划，构建子任务的会话场景资源，通过MCTS任务执行器，来让每个子任务通过在上下文中资源，通过自身反思探索来获取自身对问题的最优答案；这种方式依赖模型的对齐偏好，我们在每种偏好上设计了一个工程框架，来完成自我对不同答案的奖励进行采样策略☆27Updated this week
- Examples for QinYan GLMs☆11Updated 5 months ago
- 🔥Your Daily Dose of AI Research from Hugging Face 🔥 Stay updated with the latest AI breakthroughs! This bot automatically collects and…☆48Updated this week
- DashInfer is a native LLM inference engine aiming to deliver industry-leading performance atop various hardware architectures, including …☆231Updated last week
- 😜 表情包视觉数据集，使用glm-4v、step-1v的图像解析能力标注。☆113Updated 9 months ago
- 我们是第一个完全可商用的角色大模型。☆39Updated 6 months ago
- Built on the robust XTuner backend framework, XTuner Chat GUI offers a user-friendly platform for quick and efficient local model inferen…☆13Updated last year
- ☆16Updated 7 months ago
- LLM101n: Let's build a Storyteller 中文版☆124Updated 6 months ago
- ☆124Updated 9 months ago
- A Toolkit for Running On-device Large Language Models (LLMs) in APP☆60Updated 7 months ago
- AI Emoji Argue Agent 🚀 基于LangChain的开源表情包斗图Agent☆24Updated 8 months ago
- SUS-Chat: Instruction tuning done right☆48Updated last year
- pretrain a wiki llm using transformers☆25Updated 5 months ago
- Cross Platform Open Sourced Chinese NoteBookLM app based on Electron, Use DeepSeek + Reecho.ai☆63Updated 3 months ago
- ☆168Updated 2 months ago
- Alpaca Chinese Dataset -- 中文指令微调数据集【人工+GPT4o持续更新】☆192Updated 4 months ago
- 纯c++的全平台llm加速库，支持python调用，支持chatglm-6B, llama, baichuan, moss基座，x86 / ARM☆9Updated last week
- A demo built on Megrez-3B-Instruct, integrating a web search tool to enhance the model's question-and-answer capabilities.☆35Updated 2 months ago
- Efficient, Flexible, and Highly Fault-Tolerant Model Service Management Based on SGLang☆35Updated 3 months ago
- 顾名思义：手搓的RAG☆119Updated 11 months ago
- GLM Series Edge Models☆130Updated this week
- Imitate OpenAI with Local Models☆86Updated 5 months ago
- SearchGPT: Building a quick conversation-based search engine with LLMs.☆44Updated last month
- ☆12Updated 5 months ago
- AM (Advanced Mathematics) Chat is a large language model that integrates advanced mathematical knowledge, exercises in higher mathematics…☆172Updated 6 months ago
- ☆58Updated 11 months ago
- 本项目致力于为大模型领域的初学者提供全面的知识体系，包括基础和高阶内容，以便开发者能迅速掌握大模型技术栈并全面了解相关知识。☆48Updated last month
- ☆22Updated 2 weeks ago
- LLM Inference benchmark☆394Updated 6 months ago