zRzRzRzRzRzRzR / lm-flyLinks
大模型推理框架加速,让 LLM 飞起来
☆20Updated last year
Alternatives and similar repositories for lm-fly
Users that are interested in lm-fly are comparing it to the libraries listed below
Sorting:
- Examples for QinYan GLMs☆13Updated 11 months ago
- 🔥Your Daily Dose of AI Research from Hugging Face 🔥 Stay updated with the latest AI breakthroughs! This bot automatically collects and…☆54Updated this week
- 使用langchain进行任务规划,构建子任务的会话场景资源,通过MCTS任务执行器,来让每个子任务通过在上下文中资源,通过自身反思探索来获取自身对问题的最优答案;这种方式依赖模型的对齐偏好,我们在每种偏好上设计了一个工程框架,来完成自我对不同答案的奖励进行采样策略☆29Updated last month
- 收集优质的角色扮演聊天数据 | Collection of roleplay conversations of high quality☆15Updated 9 months ago
- 基于Llama3,通过进一步CPT,SFT,ORPO得到的中文版Llama3☆17Updated last year
- 😜 表情包视觉数据集,使用glm-4v、step-1v的图像解析能力标注。☆133Updated last year
- An AI-powered content conversion tool that transforms text, web content, or HTML code into beautifully designed card images.一款基于AI的内容转换工…☆29Updated last month
- GLM Series Edge Models☆147Updated 2 months ago
- AI Emoji Argue Agent 🚀 基于LangChain的开源表情包斗图Agent☆25Updated last year
- 我们是第一个完全可商用的角色大模型。☆40Updated last year
- LLM 推理服务性能测试☆44Updated last year
- LLM101n: Let's build a Storyteller 中文版☆132Updated last year
- LLM智能路由网关、 Enterprise Intelligent AI-API Distribution Gateway☆12Updated 7 months ago
- 纯c++的全平台llm加速库,支持python调用,支持chatglm-6B, llama, baichuan, moss基座,x86 / ARM☆13Updated this week
- 顾名思义:手搓的RAG☆126Updated last year
- 本项目借助飞桨平台,构建起一套创新的多模型协同系统,实现 PDF 文件到 Markdown 文件的高效、精准转换。☆25Updated 5 months ago
- A fluent, scalable, and easy-to-use LLM data processing framework.☆25Updated last month
- Built on the robust XTuner backend framework, XTuner Chat GUI offers a user-friendly platform for quick and efficient local model inferen…☆13Updated last year
- xllamacpp - a Python wrapper of llama.cpp☆52Updated this week
- llms related stuff , including code, docs☆13Updated 6 months ago
- ☆16Updated last year
- 基于大模型生成内容的智能语音对讲☆10Updated 9 months ago
- A mini assistant to help you read paper quickly☆51Updated 3 months ago
- DashInfer is a native LLM inference engine aiming to deliver industry-leading performance atop various hardware architectures, including …☆263Updated 3 weeks ago
- gpt_server是一个用于生产级部署LLMs、Embedding、Reranker、ASR和TTS的开源框架。☆206Updated this week
- 一起来养一只拥 有专属记忆的AI猫猫吧!☆10Updated 10 months ago
- This is a user guide for the MiniCPM and MiniCPM-V series of small language models (SLMs) developed by ModelBest. “面壁小钢炮” focuses on achi…☆277Updated last month
- Fine-tuning embedding models.☆14Updated 9 months ago
- SearchGPT: Building a quick conversation-based search engine with LLMs.☆47Updated 7 months ago
- 利用免费的大模型api来结合你的私域数据来生成sft训练数据(妥妥白嫖)支持llamafactory等工具的训练数据格式synthetic data☆179Updated 9 months ago