纯c++的全平台llm加速库，支持python调用，支持baichuan, glm, llama, moss基座，手机端流畅运行chatglm-6B级模型单卡可达10000+token / s，
☆42Aug 16, 2023Updated 2 years ago
Alternatives and similar repositories for baichuan-speedup
Users that are interested in baichuan-speedup are comparing it to the libraries listed below. We may earn a commission when you buy through links labeled 'Ad' on this page.
Sorting:
- 实现了Baichuan-Chat微调，Lora、QLora等各种微调方式，一键运行。☆70Aug 15, 2023Updated 2 years ago
- ggml implementation of the baichuan13b model (adapted from llama.cpp)☆55Jul 27, 2023Updated 2 years ago
- PFCC 社区博客☆14Updated this week
- 天池大赛：金融大脑-金融智能NLP服务☆16Jul 9, 2018Updated 7 years ago
- Baichuan2代码的逐行解析版本，适合小白☆211Sep 20, 2023Updated 2 years ago
- Virtual machines for every use case on DigitalOcean • AdGet dependable uptime with 99.99% SLA, simple security tools, and predictable monthly pricing with DigitalOcean's virtual machines, called Droplets.
- 基于baichuan-7b的开源多模态大语言模型☆72Dec 7, 2023Updated 2 years ago
- key value and document-oriented database combined☆11May 14, 2020Updated 6 years ago
- 官方transformers源码解析。AI大模型时代，pytorch、transformer是新操作系统，其他都是运行在其上面的软件。☆16Sep 25, 2023Updated 2 years ago
- ☆23Jul 17, 2023Updated 2 years ago
- 演示 vllm 对中文大语言模型的神奇效果☆31Nov 4, 2023Updated 2 years ago
- STM32实现的循迹,红外避障,超声波避障,蓝牙遥控,红外遥控五种基本功能的小车☆16May 25, 2024Updated 2 years ago
- This sample shows how to use the oneAPI Video Processing Library (oneVPL) to perform a single and multi-source video decode and preproces…☆15Jun 15, 2023Updated 2 years ago
- Transformer related optimization, including BERT, GPT☆17Jul 29, 2023Updated 2 years ago
- ChatGLM2-6B-Explained☆36Jul 28, 2023Updated 2 years ago
- Managed hosting for WordPress and PHP on Cloudways • AdManaged hosting for WordPress, Magento, Laravel, or PHP apps, on multiple cloud providers. Deploy in minutes on Cloudways by DigitalOcean.
- 飞桨模型加密库☆10Nov 13, 2021Updated 4 years ago
- 人工智能社会保险反欺诈分析☆29Aug 5, 2018Updated 7 years ago
- golang utils☆26Feb 15, 2023Updated 3 years ago
- SMP2018中文人机对话技术评测（ECDT）☆15Oct 25, 2018Updated 7 years ago
- 通过示例阐述如何使用pycrfsuite☆10Nov 7, 2016Updated 9 years ago
- ChatGLM-6B添加了RLHF的实现，以及部分核心代码的逐行讲解 ,实例部分是做了个新闻短标题的生成，以及指定context推荐的RLHF的实现☆88Aug 16, 2023Updated 2 years ago
- 用于生成文本纠错模型(如Gector)需要的大量数据。☆14Jan 5, 2023Updated 3 years ago
- Android runtime permissions manager☆13Jul 8, 2019Updated 6 years ago
- CHATGPT-In-Jupyter☆11Jun 2, 2023Updated 2 years ago
- Deploy to Railway using AI coding agents - Free Credits Offer • AdUse Claude Code, Codex, OpenCode, and more. Autonomous software development now has the infrastructure to match with Railway.
- 聚宝盆(Cornucopia): 中文金融系列开源可商用大模型，并提供一套高效轻量化的垂直领域LLM训练框架(Pretraining、SFT、RLHF、Quantize等)☆657Jun 30, 2023Updated 2 years ago
- ☆10Dec 20, 2022Updated 3 years ago
- 知识融合标注工具☆15Dec 19, 2018Updated 7 years ago
- Deep Learning Library for R☆12May 6, 2018Updated 8 years ago
- BiLLa: A Bilingual LLaMA with Enhanced Reasoning Ability☆417Jun 1, 2023Updated 2 years ago
- 使用ONNXRuntime部署面向轻量实时的M-LSD直线检测，包含C++和Python两个版本的程序☆26Jan 21, 2023Updated 3 years ago
- Md5 碰撞生成实现，去掉了boost依赖，简化编译☆12Jan 25, 2018Updated 8 years ago
- 多轮共情对话模型PICA☆98Sep 11, 2023Updated 2 years ago
- High-level Rust library that binds to Poppler to extract text from a PDF☆11Dec 16, 2020Updated 5 years ago
- 1-Click AI Models by DigitalOcean Gradient • AdDeploy popular AI models on DigitalOcean Gradient GPU virtual machines with just a single click. Zero configuration with optimized deployments.
- ☆15Jan 11, 2023Updated 3 years ago
- This project provides a face recoganization system via opencv4☆18Jan 16, 2019Updated 7 years ago
- 学习OpenGL的代码仓库☆14Apr 25, 2026Updated last month
- 记录自己对《代码审计》的理解和总结，对危险函数的深入分析以及在p牛的博客和代码审计圈的收获☆10Feb 27, 2018Updated 8 years ago
- 一个为RAG系统设计的Markdown文档工具，提供标题结构自动抽取和文档分割两大功能。完整保留文档层级结构，解决传统切分器丢失标题层级与破坏表格完整性的问题。A hierarchy-preserving Markdown document splitter for RAG…☆14Jan 2, 2025Updated last year
- Examples of demo deployment using Gradio. Image Classification, Live Webcam Segmentation, APIs , Tunneling etc.☆17Oct 17, 2022Updated 3 years ago
- Deep-Learn model SSD_300x300 transplante to TensorRT(Nvidia Jetson Tx2)☆11Dec 8, 2018Updated 7 years ago