viitrix / vt-transformer
Transformer framework for edge computing based on C++.
☆118Updated last month
Related projects: ⓘ
- DashInfer is a native LLM inference engine aiming to deliver industry-leading performance atop various hardware architectures, including …☆130Updated 3 weeks ago
- OpenLLaMA-Chinese, a permissively licensed open source instruction-following models based on OpenLLaMA☆64Updated last year
- C++ implementation of Qwen-LM☆531Updated 8 months ago
- ☆97Updated 5 months ago
- An easy-to-use framework for modular RAG☆279Updated last week
- llm-export can export llm model to onnx.☆193Updated this week
- Port of Facebook's LLaMA model in C/C++☆66Updated this week
- A Toolkit for Running On-device Large Language Models (LLMs) in APP☆53Updated 2 months ago
- Easy, fast, and cheap pretrain,finetune, serving for everyone☆245Updated last week
- Efficient AI Inference & Serving☆452Updated 8 months ago
- run ChatGLM2-6B in BM1684X☆48Updated 6 months ago
- LLM101n: Let's build a Storyteller 中文版☆113Updated last month
- ☆77Updated 4 months ago
- Mixture-of-Experts (MoE) Language Model☆179Updated last week
- Phi3 中文仓库☆314Updated 4 months ago
- 支持中文场景的的小语言模型 llama2.c-zh☆140Updated 6 months ago
- The official repo of Aquila2 series proposed by BAAI, including pretrained & chat large language models.☆429Updated 7 months ago
- ☆572Updated last month
- ☆341Updated last month
- 中文Mixtral-8x7B（Chinese-Mixtral-8x7B）☆637Updated last month
- Inferflow is an efficient and highly configurable inference engine for large language models (LLMs).☆232Updated 6 months ago
- ☆217Updated last year
- ☆90Updated last year
- RTP-LLM: Alibaba's high-performance LLM inference engine for diverse applications.☆512Updated last week
- ☆247Updated 3 months ago
- Llama3-Chinese是以Meta-Llama-3-8B为底座，使用 DORA + LORA+ 的训练方法，在50w高质量中文多轮SFT数据 + 10w英文多轮SFT数据 + 2000单轮自我认知数据训练而来的大模型。☆285Updated 4 months ago
- llm-inference is a platform for publishing and managing llm inference, providing a wide range of out-of-the-box features for model deploy…☆66Updated 4 months ago
- Enhance LLM agents with rich tool APIs☆339Updated last week
- 中文书籍收录整理, Collection of Chinese Books☆169Updated 8 months ago
- 看图学大模型☆148Updated last month