viitrix / vt-transformer
Transformer framework for edge computing based on C++.
☆119Updated last week
Related projects ⓘ
Alternatives and complementary repositories for vt-transformer
- DashInfer is a native LLM inference engine aiming to deliver industry-leading performance atop various hardware architectures, including …☆137Updated 2 months ago
- ☆100Updated 7 months ago
- run ChatGLM2-6B in BM1684X☆48Updated 8 months ago
- 支持中文场景的的小语言模型 llama2.c-zh☆145Updated 8 months ago
- A Toolkit for Running On-device Large Language Models (LLMs) in APP☆57Updated 4 months ago
- Port of Facebook's LLaMA model in C/C++☆71Updated last week
- ☆213Updated 6 months ago
- OpenLLaMA-Chinese, a permissively licensed open source instruction-following models based on OpenLLaMA☆64Updated last year
- qwen2 and llama3 cpp implementation☆34Updated 5 months ago
- C++ implementation of Qwen-LM☆553Updated 10 months ago
- LLM101n: Let's build a Storyteller 中文版☆118Updated 3 months ago
- Analysis of Chinese and English layouts 中英文版面分析☆126Updated last month
- Easy, fast, and cheap pretrain,finetune, serving for everyone☆262Updated 2 weeks ago
- XVERSE-65B: A multilingual large language model developed by XVERSE Technology Inc.☆132Updated 7 months ago
- Mixture-of-Experts (MoE) Language Model☆180Updated 2 months ago
- 顾名思义：手搓的RAG☆111Updated 8 months ago
- Inferflow is an efficient and highly configurable inference engine for large language models (LLMs).☆236Updated 8 months ago
- Using Llama-3.1 70b on Groq to create o1-like reasoning chains☆19Updated last month
- llm-export can export llm model to onnx.☆230Updated last week
- This is a user guide for the MiniCPM and MiniCPM-V series of small language models (SLMs) developed by ModelBest. “面壁小钢炮” focuses on achi…☆118Updated 3 weeks ago
- Phi3 中文仓库☆320Updated 6 months ago
- ☆77Updated 6 months ago
- 源自PP-Structure的表格识别算法，模型转换为ONNX，推理引擎采用ONNXRuntime，部署简单，无内存泄露问题。☆70Updated last week
- 纯c++的全平台llm加速库，支持python调用，支持baichuan, glm, llama, moss基座，手机端流畅运行chatglm-6B级模型单卡可达10000+token / s，☆45Updated last year
- gpt_server是一个用于生产级部署LLMs或Embedding的开源框架。☆120Updated this week
- 基于MNN-llm的安卓手机部署大语言模型：Qwen1.5-0.5B-Chat☆48Updated 7 months ago
- 研究GOT-OCR-项目落地加速，不限语言☆51Updated 3 weeks ago
- Efficient AI Inference & Serving☆458Updated 10 months ago
- ☆90Updated last year
- ☆25Updated 3 weeks ago