sophgo / ChatGLM3-TPU
run chatglm3-6b in BM1684X
☆37Updated 11 months ago
Alternatives and similar repositories for ChatGLM3-TPU:
Users that are interested in ChatGLM3-TPU are comparing it to the libraries listed below
- run ChatGLM2-6B in BM1684X☆49Updated 11 months ago
- GPT+神器,简单实用的一站式AGI架构,内置本地化,LLM模型,agent,矢量数据库,智能链chain☆48Updated last year
- TianMu: A modern AI tool with multi-platform support, markdown support, multimodal, continuous conversation, and customizable commands. 一…☆83Updated last year
- 支持中文场景的的小语言模型 llama2.c-zh☆145Updated 11 months ago
- XVERSE-7B: A multilingual large language model developed by XVERSE Technology Inc.☆51Updated 10 months ago
- GLM Series Edge Models☆129Updated last month
- 全球首个StableVicuna中文优化版。☆64Updated last year
- Its an open source LLM based on MOE Structure.☆57Updated 7 months ago
- Run generative AI models in sophgo BM1684X☆165Updated this week
- 基于MNN-llm的安卓手机部署大语言模型:Qwen1.5-0.5B-Chat☆68Updated 10 months ago
- 实现Blip2RWKV+QFormer的多模态图文对话大模型,使用Two-Step Cognitive Psychology Prompt方法,仅3B参数的模型便能够出现类人因果思维链。对标MiniGPT-4,ImageBind等图文对话大语言 模型,力求以更小的算力和资源实…☆37Updated last year
- unify-easy-llm(ULM)旨在打造一个简易的一键式大模型训练工具,支持Nvidia GPU、Ascend NPU等不同硬件以及常用的大模型。☆55Updated 6 months ago
- A demo built on Megrez-3B-Instruct, integrating a web search tool to enhance the model's question-and-answer capabilities.☆35Updated 2 months ago
- 纯c++的全平台llm加速库,支持python调用,支持baichuan, glm, llama, moss基座,手机端流畅运行chatglm-6B级模型单卡可达10000+token / s,☆45Updated last year
- qwen2 and llama3 cpp implementation☆40Updated 8 months ago
- XVERSE-MoE-A4.2B: A multilingual large language model developed by XVERSE Technology Inc.☆36Updated 9 months ago
- 首个llama2 13b 中文版模型 (Base + 中文对话SFT,实现流畅多轮人机自然语言交互)☆89Updated last year
- 部署你自己的OpenAI api🤩, 基于flask, transformers (使用 Baichuan2-13B-Chat-4bits 模型, 可以运行在单张Tesla T4显卡) ,实现了OpenAI中Chat, Models和Completions接口,包含流式响…☆89Updated last year
- zero零训练llm调参☆31Updated last year
- Sample GLM4V + ChatTTS AI assistant☆85Updated 8 months ago
- 想要从零开始训练一个中文的mini大语言模型,可以进行基本的对话,模型大小根据手头的机器决定☆56Updated 6 months ago
- 视频理解:千问视频多模态模型 & Dify☆32Updated 5 months ago
- A high-throughput and memory-efficient inference and serving engine for LLMs☆128Updated 2 months ago
- share data, prompt data , pretraining data☆35Updated last year
- An open-source chat text to control actions agentic workflow framework/showcase powered by Agently AI application development framework.☆26Updated 4 months ago
- 属于每个人的公众号”查特查特“上线啦!新问题、新方法、新发现,欢迎提PR!☆41Updated last year
- DashInfer is a native LLM inference engine aiming to deliver industry-leading performance atop various hardware architectures, including …☆230Updated this week
- 重生之我是 AI 打工人。前世,我的身份默默无闻,来去匆匆,不知道自己将在何地出生。然而,命运给予了我难得的机会,让我重生为一名 AI 打工人。☆45Updated last year
- ☆107Updated 10 months ago
- 大模型中文测试题库-民间版本☆66Updated last year