sophgo / ChatGLM3-TPULinks
run chatglm3-6b in BM1684X
☆39Updated last year
Alternatives and similar repositories for ChatGLM3-TPU
Users that are interested in ChatGLM3-TPU are comparing it to the libraries listed below
Sorting:
- 视频理解:千问视频多模态模型 & Dify☆66Updated last year
- 首个llama2 13b 中文版模型 (Base + 中文对话SFT,实现流畅多轮人机自然语言交互)☆91Updated 2 years ago
- run ChatGLM2-6B in BM1684X☆49Updated last year
- XVERSE-7B: A multilingual large language model developed by XVERSE Technology Inc.☆53Updated last year
- 实现Blip2RWKV+QFormer的多模态图文对话大模型,使用Two-Step Cognitive Psychology Prompt方法,仅3B参数的模型便能够出现类人因果思维链。对标MiniGPT-4,ImageBind等图文对话大语言模型,力求以更小的算力和资源实…☆40Updated 2 years ago
- High-performance LLM inference based on our optimized version of FastTransfomer☆122Updated 2 years ago
- 适用于sophon bm1684x,基于 Langchain 与 ChatGLM 等语言模型的本地知识库问答☆14Updated last year
- Its an open source LLM based on MOE Structure.☆58Updated last year
- Finetune Llama 3, Mistral & Gemma LLMs 2-5x faster with 80% less memory☆29Updated last year
- Python3 package for Chinese/English OCR,use paddleocr-v5 onnx model(~20MB), with ultra-fast inference speed. 基于ppocr-v5-onnx模型推理,中英文OCR开源…☆123Updated 6 months ago
- share data, prompt data , pretraining data☆36Updated 2 years ago
- The framework of training large language models,support lora, full parameters fine tune etc, define yaml to start training/fine tune of y…☆31Updated last year
- ChatGLM 6B 的模型与UI,通过 LangChain 与向量匹配实现本地知识库问答,支持流式输出☆116Updated 2 years ago
- llm-inference is a platform for publishing and managing llm inference, providing a wide range of out-of-the-box features for model deploy…☆91Updated last year
- GLM Series Edge Models☆156Updated 7 months ago
- OrionStar-Yi-34B-Chat 是一款开源中英文Chat模型,由猎户星空基于Yi-34B开源模型、使用15W+高质量语料微调而成。☆265Updated last year
- Tracking the hot Github repos and update daily 每天自动追踪Github热门项目☆50Updated last week
- 支持中文场景的的小语言模型 llama2.c-zh☆150Updated last year
- bisheng-unstructured library☆57Updated 8 months ago
- 纯c++的全平台llm加速库,支持python调用,支持baichuan, glm, llama, moss基座,手机端流畅运行chatglm-6B级模型单卡可达10000+token / s,☆45Updated 2 years ago
- 基于MNN-llm的安卓手机部署大语言模型:Qwen1.5-0.5B-Chat☆89Updated last year
- 研究GOT-OCR-项目落地加速,不限语言☆62Updated last year
- An open-source chat text to control actions agentic workflow framework/showcase powered by Agently AI application development framework.☆29Updated last year
- ggml implementation of the baichuan13b model (adapted from llama.cpp)☆55Updated 2 years ago
- 部署你自己的OpenAI api🤩, 基于flask, transformers (使用 Baichuan2-13B-Chat-4bits 模型, 可以运行在单张Tesla T4显卡) ,实现了OpenAI中Chat, Models和Completions接口,包含流式响…☆96Updated 2 years ago
- XVERSE-MoE-A4.2B: A multilingual large language model developed by XVERSE Technology Inc.☆39Updated last year
- 属于每个人的公众号”查特查特“上线啦!新问题、新方法、新发现,欢迎提PR!☆47Updated 2 years ago
- A demo built on Megrez-3B-Instruct, integrating a web search tool to enhance the model's question-and-answer capabilities.☆39Updated last year
- Port of Facebook's LLaMA model in C/C++☆105Updated 2 months ago
- ☆14Updated 2 years ago