纯c++的全平台llm加速库，支持python调用，支持baichuan, glm, llama, moss基座，手机端流畅运行chatglm-6B级模型单卡可达10000+token / s，
☆42Aug 16, 2023Updated 3 years ago
Alternatives and similar repositories for baichuan-speedup
Users that are interested in baichuan-speedup are comparing it to the libraries listed below. We may earn a commission when you buy through links labeled 'Ad' on this page.
Sorting:
- 实现了Baichuan-Chat微调，Lora、QLora等各种微调方式，一键运行。☆70Aug 15, 2023Updated 3 years ago
- ggml implementation of the baichuan13b model (adapted from llama.cpp)☆55Jul 27, 2023Updated 3 years ago
- Baichuan2代码的逐行解析版本，适合小白☆210Sep 20, 2023Updated 3 years ago
- 基于baichuan-7b的开源多模态大语言模型☆72Dec 7, 2023Updated 2 years ago
- 演示 vllm 对中文大语言模型的神奇效果☆31Nov 4, 2023Updated 2 years ago
- 1-Click AI Models by DigitalOcean Gradient • AdDeploy popular AI models on DigitalOcean Gradient GPU virtual machines with just a single click. Zero configuration with optimized deployments.
- 一个桌面宠物程序，现在似乎发展成为桌面便签了。桌面便签程序见develop-todolist分支。☆11Nov 17, 2024Updated last year
- This sample shows how to use the oneAPI Video Processing Library (oneVPL) to perform a single and multi-source video decode and preproces…☆15Jun 15, 2023Updated 3 years ago
- 中文金融大模型测评基准，六大类二十五任务、等级化评价，国内模型获得A级☆10May 6, 2024Updated 2 years ago
- 人工智能社会保险反欺诈分析☆29Aug 5, 2018Updated 8 years ago
- ChatGLM2-6B-Explained☆36Jul 28, 2023Updated 3 years ago
- 飞桨模型加密库☆10Nov 13, 2021Updated 4 years ago
- Transformer related optimization, including BERT, GPT☆17Jul 29, 2023Updated 3 years ago
- ChatGLM-6B添加了RLHF的实现，以及部分核心代码的逐行讲解 ,实例部分是做了个新闻短标题的生成，以及指定context推荐的RLHF的实现☆88Aug 16, 2023Updated 3 years ago
- Mesh networking using WiFi Ad-Hoc and OLSR on Android☆10Dec 1, 2018Updated 7 years ago
- Deploy to Railway using AI coding agents - Free Credits Offer • AdUse Claude Code, Codex, OpenCode, and more. Autonomous software development now has the infrastructure to match with Railway.
- 用于生成文本纠错模型(如Gector)需要的大量数据。☆15Jan 5, 2023Updated 3 years ago
- 聚宝盆(Cornucopia): 中文金融系列开源可商用大模型，并提供一套高效轻量化的垂直领域LLM训练框架(Pretraining、SFT、RLHF、Quantize等)☆655Jun 30, 2023Updated 3 years ago
- IntLLaMA: A fast and light quantization solution for LLaMA☆19Jul 21, 2023Updated 3 years ago
- BiLLa: A Bilingual LLaMA with Enhanced Reasoning Ability☆414Jun 1, 2023Updated 3 years ago
- 拍拍贷"魔镜杯”风控大赛☆12Dec 22, 2016Updated 9 years ago
- 知识融合标注工具☆15Dec 19, 2018Updated 7 years ago
- Code for M4LE: A Multi-Ability Multi-Range Multi-Task Multi-Domain Long-Context Evaluation Benchmark for Large Language Models☆23Jul 27, 2024Updated 2 years ago
- 多轮共情对话模型PICA☆98Sep 11, 2023Updated 3 years ago
- AIxCC: automated vulnerability repair via LLMs, search, and static analysis☆13Jul 16, 2024Updated 2 years ago
- Deploy on Railway without the complexity - Free Credits Offer • AdConnect your repo and Railway handles the rest with instant previews. Quickly provision container image services, databases, and storage volumes.
- 1st Solution For Conversational Multi-Doc QA Workshop & International Challenge @ WSDM'24 - Xiaohongshu.Inc☆157Jul 25, 2025Updated last year
- This project provides a face recoganization system via opencv4☆18Jan 16, 2019Updated 7 years ago
- 记录自己对《代码审计》的理解和总结，对危险函数的深入分析以及在p牛的博客和代码审计圈的收获☆10Feb 27, 2018Updated 8 years ago
- Deep-Learn model SSD_300x300 transplante to TensorRT(Nvidia Jetson Tx2)☆11Dec 8, 2018Updated 7 years ago
- C++ and CUDA extensions for Python/Pytorch and GPU Accelerated Augmentation.☆34Nov 30, 2022Updated 3 years ago
- Decoding h264 rtsp stream with libavformat☆15Nov 19, 2015Updated 10 years ago
- 百度QA100万数据集☆47Nov 30, 2023Updated 2 years ago
- ☆10May 30, 2024Updated 2 years ago
- Apply prompt learning in Chinese NER tasks☆13Mar 24, 2022Updated 4 years ago
- Wordpress hosting with auto-scaling - Free Trial Offer • AdFully Managed hosting for WordPress and WooCommerce businesses that need reliable, auto-scalable performance. Cloudways SafeUpdates now available.
- 自然语言处理之中文文本分类（以垃圾短信识别为例）☆24Jun 4, 2020Updated 6 years ago
- fastllm是后端无依赖的高性能大模型推理库。同时支持张量并行推理稠密模型和混合模式推理MOE模型，任意10G以上显卡即可推理满血DeepSeek。双路9004/9005服务器+单显卡部署DeepSeek满血满精度原版模型，单并发20tps；INT4量化模型单并发30tp…☆5,077Updated this week
- ☆13Jun 18, 2024Updated 2 years ago
- ☆16Aug 8, 2021Updated 5 years ago
- A 13B large language model developed by Baichuan Intelligent Technology☆2,924Sep 6, 2023Updated 3 years ago
- TensorRT 2022复赛方案： 首个基于Transformer的图像重建模型MST++的TensorRT模型推断优化☆143Jul 6, 2022Updated 4 years ago
- Benchmarking deep learning models for real-time object detection on various platforms☆13Jan 26, 2018Updated 8 years ago