ArtificialZeng/baichuan-speedup external links

---

GitHub - View repository

GitHub.dev - Open in online code editor

Star history - Growth chart over time

deps.dev - Dependencies and security vulnerabilities

Gitingest - Export source code for LLM usage

Repomix - Export source code for LLM usage

uithub - Export source code for LLM usage

Close

ArtificialZeng/baichuan-speedup

Readme badge preview -

If you own this repo, copy the snippet below and add it to your README.md

---

Copy

[![RelatedRepos](https://img.shields.io/badge/related-repos-yellow)](https://relatedrepos.com/gh/ArtificialZeng/baichuan-speedup)

Close

ArtificialZeng / baichuan-speedupView on GitHubMore

• External links
• Readme badge

纯c++的全平台llm加速库，支持python调用，支持baichuan, glm, llama, moss基座，手机端流畅运行chatglm-6B级模型单卡可达10000+token / s，

☆42Aug 16, 2023Updated 3 years ago

Alternatives and similar repositories for baichuan-speedup

Users that are interested in baichuan-speedup are comparing it to the libraries listed below. We may earn a commission when you buy through links labeled 'Ad' on this page.

• ArtificialZeng / Baichuan-Chat-Tuning

  View on GitHub
  实现了Baichuan-Chat微调，Lora、QLora等各种微调方式，一键运行。
  ☆70Aug 15, 2023Updated 3 years ago
• ouwei2013 / baichuan13b.cpp

  View on GitHub
  ggml implementation of the baichuan13b model (adapted from llama.cpp)
  ☆55Jul 27, 2023Updated 3 years ago
• ArtificialZeng / Baichuan2-Explained

  View on GitHub
  Baichuan2代码的逐行解析版本，适合小白
  ☆211Sep 20, 2023Updated 2 years ago
• pleisto / yuren-baichuan-7b

  View on GitHub
  基于baichuan-7b的开源多模态大语言模型
  ☆72Dec 7, 2023Updated 2 years ago
• gameofdimension / vllm-cn

  View on GitHub
  演示 vllm 对中文大语言模型的神奇效果
  ☆31Nov 4, 2023Updated 2 years ago
• GPU virtual machines on DigitalOcean Gradient AI • Ad
  Get to production fast with high-performance AMD and NVIDIA GPUs you can spin up in seconds. The definition of operational simplicity.
• QinWinner / MFC-darknet-yolo

  View on GitHub
  我利用在windows10上编译的darknet，实现了安全帽检测功能，编写了一个简单的mfc demo利用我们生成的模型来实现目标检测功能。Safety Helmet Wearing Test
  ☆24Nov 7, 2019Updated 6 years ago
• Liyulingyue / DesktopPet

  View on GitHub
  一个桌面宠物程序，现在似乎发展成为桌面便签了。桌面便签程序见develop-todolist分支。
  ☆11Nov 17, 2024Updated last year
• openvino-dev-samples / decode-infer-on-GPU

  View on GitHub
  This sample shows how to use the oneAPI Video Processing Library (oneVPL) to perform a single and multi-source video decode and preproces…
  ☆15Jun 15, 2023Updated 3 years ago
• hetrone / kesai-anti-fraud

  View on GitHub
  人工智能社会保险反欺诈分析
  ☆29Aug 5, 2018Updated 8 years ago
• AgentMaker / AgentEncryption

  View on GitHub
  飞桨模型加密库
  ☆10Nov 13, 2021Updated 4 years ago
• Rayrtfr / FasterTransformer

  View on GitHub
  Transformer related optimization, including BERT, GPT
  ☆17Jul 29, 2023Updated 3 years ago
• wangle1218 / SMP2018

  View on GitHub
  SMP2018中文人机对话技术评测（ECDT）
  ☆15Oct 25, 2018Updated 7 years ago
• Pillars-Creation / ChatGLM-RLHF-LoRA-RM-PPO

  View on GitHub
  ChatGLM-6B添加了RLHF的实现，以及部分核心代码的逐行讲解 ,实例部分是做了个新闻短标题的生成，以及指定context推荐的RLHF的实现
  ☆88Aug 16, 2023Updated 3 years ago
• txHe / UseOfPycrfsuite

  View on GitHub
  通过示例阐述如何使用pycrfsuite
  ☆10Nov 7, 2016Updated 9 years ago
• Proton VPN Special Offer - Get 70% off • Ad
  Special partner offer. Trusted by over 100 million users worldwide. Tested, Approved and Recommended by Experts.
• ZJJHYM / bert4keras_note

  View on GitHub
  对苏神的bert4keras的实现原理和矩阵运算进行详细的注释，方便学习；bert4keras链接：https://github.com/bojone/bert4keras
  ☆42Dec 15, 2020Updated 5 years ago
• godaai / llm-inference

  View on GitHub
  Resources for Large Language Model Inference
  ☆17Dec 29, 2023Updated 2 years ago
• liwenju0 / error_text_gen

  View on GitHub
  用于生成文本纠错模型(如Gector)需要的大量数据。
  ☆15Jan 5, 2023Updated 3 years ago
• lixibi / CHATGPT-In-Jupyter

  View on GitHub
  CHATGPT-In-Jupyter
  ☆11Jun 2, 2023Updated 3 years ago
• lansinuote / Single_Round_Questions_and_Answers

  View on GitHub
  ☆10Dec 20, 2022Updated 3 years ago
• KwanWaiChung / M4LE

  View on GitHub
  Code for M4LE: A Multi-Ability Multi-Range Multi-Task Multi-Domain Long-Context Evaluation Benchmark for Large Language Models
  ☆23Jul 27, 2024Updated 2 years ago
• NEU-DataMining / PICA

  View on GitHub
  多轮共情对话模型PICA
  ☆98Sep 11, 2023Updated 2 years ago
• ChrisTimperley / RepairChain

  View on GitHub
  AIxCC: automated vulnerability repair via LLMs, search, and static analysis
  ☆13Jul 16, 2024Updated 2 years ago
• zhangzhao219 / WSDM-Cup-2024

  View on GitHub
  1st Solution For Conversational Multi-Doc QA Workshop & International Challenge @ WSDM'24 - Xiaohongshu.Inc
  ☆157Jul 25, 2025Updated last year
• Bare Metal GPUs on DigitalOcean Gradient AI • Ad
  Purpose-built for serious AI teams training foundational models, running large-scale inference, and pushing the boundaries of what's possible.
• cjzjolly / learnopengl

  View on GitHub
  学习OpenGL的代码仓库
  ☆15Jun 5, 2026Updated 3 months ago
• tczhangzhi / face-recognition

  View on GitHub
  This project provides a face recoganization system via opencv4
  ☆18Jan 16, 2019Updated 7 years ago
• lazybootsafe / Audit-Learning

  View on GitHub
  记录自己对《代码审计》的理解和总结，对危险函数的深入分析以及在p牛的博客和代码审计圈的收获
  ☆10Feb 27, 2018Updated 8 years ago
• xziya / atec-sim

  View on GitHub
  金融大脑-金融智能NLP服务 竞赛
  ☆17Apr 27, 2019Updated 7 years ago
• aiplaybookin / gradio-demo

  View on GitHub
  Examples of demo deployment using Gradio. Image Classification, Live Webcam Segmentation, APIs , Tunneling etc.
  ☆17Oct 17, 2022Updated 3 years ago
• tosonw / deepstream-test1-app_rtsp

  View on GitHub
  基于官方源码deepstream-test1修改，调用rtsp摄像头，并推理显示结果
  ☆15Mar 11, 2020Updated 6 years ago
• ChenCVer / python_cpp_extension

  View on GitHub
  C++ and CUDA extensions for Python/Pytorch and GPU Accelerated Augmentation.
  ☆34Nov 30, 2022Updated 3 years ago
• AndSonder / Document-Scanner

  View on GitHub
  基于PaddlePaddle实现的扫描全能王
  ☆16Nov 23, 2022Updated 3 years ago
• YuxingLu613 / Prompt-NER-Chinese

  View on GitHub
  Apply prompt learning in Chinese NER tasks
  ☆13Mar 24, 2022Updated 4 years ago
• 1-Click AI Models by DigitalOcean Gradient • Ad
  Deploy popular AI models on DigitalOcean Gradient GPU virtual machines with just a single click. Zero configuration with optimized deployments.
• YangLinzhuo / cuda-sgemm-optimization

  View on GitHub
  CUDA SGEMM optimization note
  ☆15Oct 31, 2023Updated 2 years ago
• AndSonder / student_message

  View on GitHub
  面向对象学习小项目，学生信息管理系统
  ☆10Oct 6, 2019Updated 6 years ago
• ztxz16 / fastllm

  View on GitHub
  fastllm是后端无依赖的高性能大模型推理库。同时支持张量并行推理稠密模型和混合模式推理MOE模型，任意10G以上显卡即可推理满血DeepSeek。双路9004/9005服务器+单显卡部署DeepSeek满血满精度原版模型，单并发20tps；INT4量化模型单并发30tp…
  ☆4,972Updated this week
• xjdr-alt / mla_blog_translation

  View on GitHub
  ☆13Jun 18, 2024Updated 2 years ago
• eric612 / Jetson-nano-benchmark

  View on GitHub
  ☆11May 15, 2019Updated 7 years ago
• thunder95 / Paddle_Table_Image_Reader

  View on GitHub
  ☆16Aug 8, 2021Updated 5 years ago
• lixiuhong / implicit_gemm_convolution

  View on GitHub
  ☆14May 28, 2019Updated 7 years ago