zRzRzRzRzRzRzR / lm-fly
大模型推理框架加速，让 LLM 飞起来
☆19Updated 10 months ago
Alternatives and similar repositories for lm-fly:
Users that are interested in lm-fly are comparing it to the libraries listed below
- 🔥Your Daily Dose of AI Research from Hugging Face 🔥 Stay updated with the latest AI breakthroughs! This bot automatically collects and…☆49Updated this week
- Examples for QinYan GLMs☆11Updated 6 months ago
- 使用langchain进行任务规划，构建子任务的会话场景资源，通过MCTS任务执行器，来让每个子任务通过在上下文中资源，通过自身反思探索来获取自身对问题的最优答案；这种方式依赖模型的对齐偏好，我们在每种偏好上设计了一个工程框架，来完成自我对不同答案的奖励进行采样策略☆29Updated last week
- 😜 表情包视觉数据集，使用glm-4v、step-1v的图像解析能力标注。☆118Updated 11 months ago
- GLM Series Edge Models☆132Updated last month
- 我们是第一个完全可商用的角色大模型。☆39Updated 7 months ago
- DashInfer is a native LLM inference engine aiming to deliver industry-leading performance atop various hardware architectures, including …☆238Updated 3 weeks ago
- ☆16Updated 8 months ago
- The Level-Navi Agent, a framework that requires no training and utilizes large language models for deep query understanding and precise s…☆78Updated 3 months ago
- AI Emoji Argue Agent 🚀 基于LangChain的开源表情包斗图Agent☆25Updated 9 months ago
- 🌱 将智谱清言官方智能体API转换为OpenAI兼容协议的网关 👋 帮助开发者们降低接入API的门槛☆44Updated 10 months ago
- xllamacpp - a Python wrapper of llama.cpp☆26Updated last week
- Built on the robust XTuner backend framework, XTuner Chat GUI offers a user-friendly platform for quick and efficient local model inferen…☆13Updated last year
- Cross Platform Open Sourced Chinese NoteBookLM app based on Electron, Use DeepSeek + Reecho.ai☆67Updated 4 months ago
- A demo built on Megrez-3B-Instruct, integrating a web search tool to enhance the model's question-and-answer capabilities.☆37Updated 3 months ago
- 纯c++的全平台llm加速库，支持python调用，支持chatglm-6B, llama, baichuan, moss基座，x86 / ARM☆9Updated last month
- A simple way to synthesize LLM training data. (under construction⚠)☆16Updated last week
- LLM101n: Let's build a Storyteller 中文版☆130Updated 7 months ago
- 基于大模型生成内容的智能语音对讲☆10Updated 4 months ago
- 收集优质的角色扮演聊天数据 | Collection of roleplay conversations of high quality☆11Updated 3 months ago
- 一起来养一只拥有专属记忆的AI猫猫吧！☆10Updated 5 months ago
- Generate multi-round conversation roleplay data based on self-instruct and evol-instruct.☆124Updated 2 months ago
- （撰写ing..)本仓库偏教程性质，以「模型中文化」为一个典型的模型训练问题切入场景，指导读者上手学习LLM二次微调训练。☆32Updated 7 months ago
- This is a user guide for the MiniCPM and MiniCPM-V series of small language models (SLMs) developed by ModelBest. “面壁小钢炮” focuses on achi…☆223Updated 5 months ago
- 用大模型批量处理数据，现支持各种大模型做OCR，支持通义千问, 月之暗面, 百度飞桨OCR, OpenAI 和LLAVA。Use LLM to generate or clean data for academic use. Support OCR with qwen, m…☆13Updated 6 months ago
- Just for debug☆56Updated last year
- Delta-CoMe can achieve near loss-less 1-bit compressin which has been accepted by NeurIPS 2024☆54Updated 4 months ago
- 顾名思义：手搓的RAG☆121Updated last year
- A Toolkit for Running On-device Large Language Models (LLMs) in APP☆67Updated 8 months ago
- Imitate OpenAI with Local Models☆88Updated 7 months ago