openvino-dev-samples / Qwen2.openvinoLinks
This sample shows how to deploy Qwen2 using OpenVINO
☆39Updated 10 months ago
Alternatives and similar repositories for Qwen2.openvino
Users that are interested in Qwen2.openvino are comparing it to the libraries listed below
Sorting:
- run chatglm3-6b in BM1684X☆39Updated last year
- run ChatGLM2-6B in BM1684X☆49Updated last year
- This is Microsoft-Phi-3-NvidiaNIMWorkshop☆22Updated 11 months ago
- unify-easy-llm(ULM)旨在打造一个简易的一键式大模型训练工具,支持Nvidia GPU、Ascend NPU等不同硬件以及常用的大模型。☆56Updated 11 months ago
- ggml implementation of the baichuan13b model (adapted from llama.cpp)☆54Updated last year
- qwen2 and llama3 cpp implementation☆45Updated last year
- 基于MNN-llm的安卓手机部署大语言模型:Qwen1.5-0.5B-Chat☆80Updated last year
- 支持中文场景的的小语言模型 llama2.c-zh☆147Updated last year
- vLLM Documentation in Chinese Simplified / vLLM 中文文档☆87Updated 2 months ago
- Alpaca Chinese Dataset -- 中文指令微调数据集☆209Updated 9 months ago
- Music large model based on InternLM2-chat.☆22Updated 7 months ago
- 该项目是为了使用layoutlmv3针对中文图片训练和推理。 其中主要解决三个问题: 1.数据标准化成可以的训练数据集格式 2.layoutlmv3-base-chinese 分词修改 2.超过512长度的文本切分和滑窗操作☆53Updated 10 months ago
- Finetune Llama 3, Mistral & Gemma LLMs 2-5x faster with 80% less memory☆28Updated last year
- Python3 package for Chinese/English OCR,use paddleocr-v5 onnx model(~20MB), with ultra-fast inference speed. 基于ppocr-v5-onnx模型推理,中英文OCR开源…☆94Updated last week
- 研究GOT-OCR-项目落地加速,不限语言☆60Updated 9 months ago
- Phi2-Chinese-0.2B 从0开始训练自己的Phi2中文小模型,支持接入langchain加载本地知识库做检索增强生成RAG。Training your own Phi2 small chat model from scratch.☆556Updated last year
- ☆48Updated 4 months ago
- Run generative AI models in sophgo BM1684X/BM1688☆227Updated last week
- This is a user guide for the MiniCPM and MiniCPM-V series of small language models (SLMs) developed by ModelBest. “面壁小钢炮” focuses on achi…☆261Updated 3 weeks ago
- LLM 推理服务性能测试☆44Updated last year
- 部署你自己的OpenAI api🤩, 基于flask, transformers (使用 Baichuan2-13B-Chat-4bits 模型, 可以运行在单张Tesla T4显卡) ,实现了OpenAI中Chat, Models和Completions接口,包含流式响…☆92Updated last year
- Open foundation models, such LLama2, ChatGLM, etc.☆116Updated 10 months ago
- In this fast-paced world, we all need a little something to spice up life. Whether you need a glass of sweet talk to lift your spirits or…☆58Updated last month
- Explore LLM model deployment based on AXera's AI chips☆109Updated last week
- Qwen1.5-SFT(阿里, Ali), Qwen_Qwen1.5-2B-Chat/Qwen_Qwen1.5-7B-Chat微调(transformers)/LORA(peft)/推理☆64Updated last year
- ☆152Updated last year
- share data, prompt data , pretraining data☆36Updated last year
- ☆102Updated 2 years ago
- 训练一个对中文支持更好的LLaVA模型,并开源训练代码和数据。☆64Updated 10 months ago
- 想要从零开始训练一个中文的mini大语言模型,可以进行基本的对话,模型大小根据手头的机器决定☆60Updated 11 months ago