OpenBMB / llama.cpp
Port of Facebook's LLaMA model in C/C++
☆72Updated this week
Related projects ⓘ
Alternatives and complementary repositories for llama.cpp
- Get up and running with Llama 3, Mistral, Gemma, and other large language models.☆25Updated last month
- 研究GOT-OCR-项目落地加速，不限语言☆48Updated 2 weeks ago
- A Toolkit for Running On-device Large Language Models (LLMs) in APP☆57Updated 4 months ago
- qwen2 and llama3 cpp implementation☆34Updated 5 months ago
- This is a user guide for the MiniCPM and MiniCPM-V series of small language models (SLMs) developed by ModelBest. “面壁小钢炮” focuses on achi…☆111Updated last week
- A high-throughput and memory-efficient inference and serving engine for LLMs☆16Updated this week
- A Simple MLLM Surpassed QwenVL-Max with OpenSource Data Only in 14B LLM.☆36Updated 2 months ago
- C++ implementation of Qwen-LM☆550Updated 10 months ago
- DashInfer is a native LLM inference engine aiming to deliver industry-leading performance atop various hardware architectures, including …☆135Updated 2 months ago
- Pure C++ implementation of several models for real-time chatting on your computer (CPU)☆374Updated this week
- 源自PP-Structure的表格识别算法，模型转换为ONNX，推理引擎采用ONNXRuntime，部署简单，无内存泄露问题。☆38Updated 2 weeks ago
- SUS-Chat: Instruction tuning done right☆47Updated 9 months ago
- 个人项目地址，一些大语言 模型和多模态模型的应用☆116Updated this week
- Multimodal chatbot with computer vision capabilities integrated☆98Updated 5 months ago
- ☆178Updated last week
- run chatglm3-6b in BM1684X☆39Updated 8 months ago
- A high-throughput and memory-efficient inference and serving engine for LLMs☆121Updated 10 months ago
- Another ChatGLM2 implementation for GPTQ quantization☆54Updated last year
- A high-throughput and memory-efficient inference and serving engine for LLMs☆129Updated 4 months ago
- Chinese CLIP models with SOTA performance.☆48Updated last year
- 基于MNN-llm的安卓手机部署大语言模型：Qwen1.5-0.5B-Chat☆48Updated 7 months ago
- ☆77Updated 6 months ago
- 实时语音交互数字人，支持端到端语音方案（GLM-4-Voice - THG）和级联方案（ASR-LLM-TTS-THG）。可自定义形象与音色，无须训练，支持音色克隆，首包延迟低至3s。Real-time voice interactive digital human, su…☆89Updated this week
- Mixture-of-Experts (MoE) Language Model☆180Updated 2 months ago
- llm-export can export llm model to onnx.☆226Updated this week
- 本项目是一个通过文字生成图片的项目，基于开源模型Stable Diffusion V1.5生成可以在手机的CPU和NPU上运行的模型，包括其配套的模型运行框架。☆105Updated 7 months ago
- run ChatGLM2-6B in BM1684X☆48Updated 8 months ago
- ☆72Updated 10 months ago
- Chinese Stable Diffusion, zh SD,中文文生图，中文SD，中文Stable Diffusion☆44Updated 7 months ago
- The official codes for "Aurora: Activating chinese chat capability for Mixtral-8x7B sparse Mixture-of-Experts through Instruction-Tuning"☆257Updated 6 months ago