sophgo / ChatGLM3-TPULinks
run chatglm3-6b in BM1684X
☆39Updated last year
Alternatives and similar repositories for ChatGLM3-TPU
Users that are interested in ChatGLM3-TPU are comparing it to the libraries listed below
Sorting:
- run ChatGLM2-6B in BM1684X☆49Updated last year
- XVERSE-7B: A multilingual large language model developed by XVERSE Technology Inc.☆52Updated last year
- GPT+神器,简单实用的一站式AGI架构,内置本地化,LLM模型,agent,矢量数据库,智能链chain☆48Updated last year
- Its an open source LLM based on MOE Structure.☆58Updated 11 months ago
- 适用于sophon bm1684x,基于 Langchain 与 ChatGLM 等语言模型的本地知识库问答☆12Updated 11 months ago
- 全球首个StableVicuna中文优化版。☆64Updated last year
- 配合 HAI Platform 使用的集成化用户界面☆51Updated 2 years ago
- 实现Blip2RWKV+QFormer的多模态图文对话大模型,使用Two-Step Cognitive Psychology Prompt方法,仅3B参数的模型便能够出现类人因果思维链。对标MiniGPT-4,ImageBind等图文对话大语言模型,力求以更小的算力和资源实…☆38Updated last year
- ☆13Updated last year
- 纯c++的全平台llm加速库,支持python调用,支持baichuan, glm, llama, moss基座,手机端流畅运行chatglm-6B级模型单卡可达10000+token / s,☆45Updated last year
- 基于MNN-llm的安卓手机部署大语言模型:Qwen1.5-0.5B-Chat☆78Updated last year
- zero零训练llm调参☆31Updated last year
- Run generative AI models in sophgo BM1684X/BM1688☆214Updated this week
- A demo built on Megrez-3B-Instruct, integrating a web search tool to enhance the model's question-and-answer capabilities.☆38Updated 5 months ago
- share data, prompt data , pretraining data☆36Updated last year
- qwen2 and llama3 cpp implementation☆44Updated 11 months ago
- unify-easy-llm(ULM)旨在打造一个简易的一键式大模型训练工具,支持Nvidia GPU、Ascend NPU等不同硬件以及常用的大模型。☆55Updated 10 months ago
- 部署你自己的OpenAI api🤩, 基于flask, transformers (使用 Baichuan2-13B-Chat-4bits 模型, 可以运行在单张Tesla T4显卡) ,实现了OpenAI中Chat, Models和Completions接口,包含流式响…☆93Updated last year
- A high-throughput and memory-efficient inference and serving engine for LLMs☆136Updated 5 months ago
- 首个llama2 13b 中文版模型 (Base + 中文对话SFT,实现流畅多轮人机自然语言交互)☆90Updated last year
- the newest version of llama3,source code explained line by line using Chinese☆22Updated last year
- 研究GOT-OCR-项目落地加速,不限语言☆60Updated 7 months ago
- 支持中文场景的的小语言模型 llama2.c-zh☆147Updated last year
- XVERSE-65B: A multilingual large language model developed by XVERSE Technology Inc.☆138Updated last year
- aigc_serving lightweight and efficient Language service model reasoning☆24Updated 11 months ago
- A prompt set of ChatGLM-6B☆14Updated last year
- Finetune Llama 3, Mistral & Gemma LLMs 2-5x faster with 80% less memory☆27Updated last year
- AGI模块库架构图☆75Updated last year
- Explore LLM model deployment based on AXera's AI chips☆103Updated this week
- GLM Series Edge Models☆141Updated 3 months ago