sophgo / ChatGLM3-TPU
run chatglm3-6b in BM1684X
☆38Updated 6 months ago
Related projects: ⓘ
- run ChatGLM2-6B in BM1684X☆48Updated 6 months ago
- TianMu: A modern AI tool with multi-platform support, markdown support, multimodal, continuous conversation, and customizable commands. 一…☆85Updated 10 months ago
- GPT+神器,简单实用的一站式AGI架构,内置本地化,LLM模型,agent,矢量数据库,智能链chain☆47Updated last year
- 文本语料转训练集工具,txt转dataset☆70Updated 4 months ago
- Run generative AI models in sophgo BM1684X☆103Updated this week
- Sample GLM4V + ChatTTS AI assistant☆82Updated 3 months ago
- qwen2 and llama3 cpp implementation☆34Updated 3 months ago
- 首个llama2 13b 中文版模型 (Base + 中文对话SFT,实现流畅多轮人机自然语言交互)☆89Updated last year
- DashInfer is a native LLM inference engine aiming to deliver industry-leading performance atop various hardware architectures, including …☆130Updated 3 weeks ago
- 全球首个StableVicuna中文优化版。☆65Updated last year
- 基于MNN-llm的安卓手机部署大语言模型:Qwen1.5-0.5B-Chat☆40Updated 5 months ago
- 纯c++的全平台llm加速库,支持python调用,支持baichuan, glm, llama, moss基座,手机端流畅运行chatglm-6B级模型单卡可达10000+token / s,☆44Updated last year
- 阿里SenseVoice的fastpi封装,采用onnx发布,附带量化模型,支持GPU。支持从URL文件进行语音识别。☆38Updated 2 weeks ago
- High-performance LLM inference based on our optimized version of FastTransfomer☆123Updated 9 months ago
- chatglm-6B for tools application using langchain☆76Updated last year
- Port of Facebook's LLaMA model in C/C++☆66Updated this week
- ChatTTS HTTP API☆48Updated 3 months ago
- XVERSE-7B: A multilingual large language model developed by XVERSE Technology Inc.☆50Updated 5 months ago
- 使用甄嬛语料微调的chatglm☆81Updated last year
- 大模型中文测试题库-民间版本☆48Updated last year
- Its an open source LLM based on MOE Structure.☆56Updated 2 months ago
- Phi3 中文仓库☆314Updated 4 months ago
- 想要从零开始训练一个中文的mini 大语言模型,可以进行基本的对话,模型大小根据手头的机器决定☆47Updated last month
- 部署你自己的OpenAI api🤩, 基于flask, transformers (使用 Baichuan2-13B-Chat-4bits 模型, 可以运行在单张Tesla T4显卡) ,实现了OpenAI中Chat, Models和Completions接口,包含流式响…☆85Updated 10 months ago
- 问题生成器,无限追问☆11Updated last year
- 基于chatglm快速搭建文档问答机器人☆87Updated last year
- 属于每个人的公众号”查特查特“上线啦!新问题、新方法、新发现,欢迎提PR!☆38Updated 9 months ago
- 演示 vllm 对中文大语言模型的神奇效果☆31Updated 10 months ago
- Finetune Llama 3, Mistral & Gemma LLMs 2-5x faster with 80% less memory☆24Updated 4 months ago
- A dataset template for guiding chat-models to self-cognition, including information about the model’s identity, capabilities, usage, limi…☆25Updated last year