ArtificialZeng/baichuan-speedup external links

---

GitHub - View repository

GitHub.dev - Open in online code editor

Star history - Growth chart over time

deps.dev - Dependencies and security vulnerabilities

Gitingest - Export source code for LLM usage

Repomix - Export source code for LLM usage

uithub - Export source code for LLM usage

Close

ArtificialZeng/baichuan-speedup

Readme badge preview -

If you own this repo, copy the snippet below and add it to your README.md

---

Copy

[![RelatedRepos](https://img.shields.io/badge/related-repos-yellow)](https://relatedrepos.com/gh/ArtificialZeng/baichuan-speedup)

Close

ArtificialZeng / baichuan-speedupView on GitHubMore

• External links
• Readme badge

纯c++的全平台llm加速库，支持python调用，支持baichuan, glm, llama, moss基座，手机端流畅运行chatglm-6B级模型单卡可达10000+token / s，

☆43Aug 16, 2023Updated 3 years ago

Alternatives and similar repositories for baichuan-speedup

Users that are interested in baichuan-speedup are comparing it to the libraries listed below. We may earn a commission when you buy through links labeled 'Ad' on this page.

• ArtificialZeng / Baichuan-Chat-Tuning

  View on GitHub
  实现了Baichuan-Chat微调，Lora、QLora等各种微调方式，一键运行。
  ☆70Aug 15, 2023Updated 3 years ago
• ouwei2013 / baichuan13b.cpp

  View on GitHub
  ggml implementation of the baichuan13b model (adapted from llama.cpp)
  ☆54Jul 27, 2023Updated 3 years ago
• rover9632 / atec_nlp

  View on GitHub
  天池大赛：金融大脑-金融智能NLP服务
  ☆16Jul 9, 2018Updated 8 years ago
• PFCCLab / blog

  View on GitHub
  PFCC 社区博客
  ☆14Updated this week
• pleisto / yuren-baichuan-7b

  View on GitHub
  基于baichuan-7b的开源多模态大语言模型
  ☆72Dec 7, 2023Updated 2 years ago
• Wordpress hosting with auto-scaling - Free Trial Offer • Ad
  Fully Managed hosting for WordPress and WooCommerce businesses that need reliable, auto-scalable performance. Cloudways SafeUpdates now available.
• ArtificialZeng / ChatGLM-Efficient-Tuning-Explained

  View on GitHub
  ☆23Jul 17, 2023Updated 3 years ago
• ArtificialZeng / Baichuan2-Explained

  View on GitHub
  Baichuan2代码的逐行解析版本，适合小白
  ☆210Sep 20, 2023Updated 3 years ago
• gameofdimension / vllm-cn

  View on GitHub
  演示 vllm 对中文大语言模型的神奇效果
  ☆31Nov 4, 2023Updated 2 years ago
• AgentMaker / AgentEncryption

  View on GitHub
  飞桨模型加密库
  ☆10Nov 13, 2021Updated 4 years ago
• Rayrtfr / FasterTransformer

  View on GitHub
  Transformer related optimization, including BERT, GPT
  ☆17Jul 29, 2023Updated 3 years ago
• hpc203 / pp-yoloe-onnxrun-cpp-py

  View on GitHub
  使用ONNXRuntime部署PP-YOLOE目标检测，支持PP-YOLOE-s、PP-YOLOE-m、PP-YOLOE-l、PP-YOLOE-x四种结构，包含C++和Python两个版本的程序
  ☆22Jun 10, 2022Updated 4 years ago
• Pillars-Creation / ChatGLM-RLHF-LoRA-RM-PPO

  View on GitHub
  ChatGLM-6B添加了RLHF的实现，以及部分核心代码的逐行讲解 ,实例部分是做了个新闻短标题的生成，以及指定context推荐的RLHF的实现
  ☆88Aug 16, 2023Updated 3 years ago
• Ficat / EasyPermissions

  View on GitHub
  Android runtime permissions manager
  ☆13Jul 8, 2019Updated 7 years ago
• liwenju0 / error_text_gen

  View on GitHub
  用于生成文本纠错模型(如Gector)需要的大量数据。
  ☆15Jan 5, 2023Updated 3 years ago
• Managed Kubernetes at scale on DigitalOcean • Ad
  DigitalOcean Kubernetes includes the control plane, bandwidth allowance, container registry, automatic updates, and more for free.
• ngcc-dev / ngcc-harness

  View on GitHub
  ngcc artifacts
  ☆46Updated this week
• andreas-mausch / MeshAndroid

  View on GitHub
  Mesh networking using WiFi Ad-Hoc and OLSR on Android
  ☆10Dec 1, 2018Updated 7 years ago
• AndSonder / UNIVERSAL_SGEMM_CUDA

  View on GitHub
  Optimize SGEMM step by step
  ☆10Sep 4, 2024Updated 2 years ago
• ZJJHYM / bert4keras_note

  View on GitHub
  对苏神的bert4keras的实现原理和矩阵运算进行详细的注释，方便学习；bert4keras链接：https://github.com/bojone/bert4keras
  ☆42Dec 15, 2020Updated 5 years ago
• Neutralzz / BiLLa

  View on GitHub
  BiLLa: A Bilingual LLaMA with Enhanced Reasoning Ability
  ☆413Jun 1, 2023Updated 3 years ago
• ShechemKS / Yolo_Detectron2

  View on GitHub
  Implementation of Yolo using Facebook's Detectron2 (https://github.com/facebookresearch/detectron2) Framework with Quantization support b…
  ☆10Aug 20, 2021Updated 5 years ago
• cdeterman / prometheus

  View on GitHub
  Deep Learning Library for R
  ☆12May 6, 2018Updated 8 years ago
• gilfernandes / complex_chain_playground

  View on GitHub
  Playground project acting as an example for a complex LangChain workflow
  ☆11Jun 20, 2023Updated 3 years ago
• inisis / Capella

  View on GitHub
  Cuda Version Image Processing API
  ☆40Mar 17, 2019Updated 7 years ago
• Managed hosting for WordPress and PHP on Cloudways • Ad
  Managed hosting for WordPress, Magento, Laravel, or PHP apps, on multiple cloud providers. Deploy in minutes on Cloudways by DigitalOcean.
• lansinuote / Single_Round_Questions_and_Answers

  View on GitHub
  ☆10Dec 20, 2022Updated 3 years ago
• jerry1993-tech / Cornucopia-LLaMA-Fin-Chinese

  View on GitHub
  聚宝盆(Cornucopia): 中文金融系列开源可商用大模型，并提供一套高效轻量化的垂直领域LLM训练框架(Pretraining、SFT、RLHF、Quantize等)
  ☆655Jun 30, 2023Updated 3 years ago
• megvii-research / IntLLaMA

  View on GitHub
  IntLLaMA: A fast and light quantization solution for LLaMA
  ☆19Jul 21, 2023Updated 3 years ago
• aiplaybookin / gradio-demo

  View on GitHub
  Examples of demo deployment using Gradio. Image Classification, Live Webcam Segmentation, APIs , Tunneling etc.
  ☆17Oct 17, 2022Updated 4 years ago
• Pi3AI / Ivy-Fake

  View on GitHub
  ☆29Dec 11, 2025Updated 10 months ago
• tosonw / deepstream-test1-app_rtsp

  View on GitHub
  基于官方源码deepstream-test1修改，调用rtsp摄像头，并推理显示结果
  ☆15Mar 11, 2020Updated 6 years ago
• hpc203 / M-LSD-onnxrun-cpp-py

  View on GitHub
  使用ONNXRuntime部署面向轻量实时的M-LSD直线检测，包含C++和Python两个版本的程序
  ☆28Jan 21, 2023Updated 3 years ago
• godaai / llm-inference

  View on GitHub
  Resources for Large Language Model Inference
  ☆17Dec 29, 2023Updated 2 years ago
• isee15 / fastcoll

  View on GitHub
  Md5 碰撞生成实现，去掉了boost依赖，简化编译
  ☆12Jan 25, 2018Updated 8 years ago
• Wordpress hosting with auto-scaling - Free Trial Offer • Ad
  Fully Managed hosting for WordPress and WooCommerce businesses that need reliable, auto-scalable performance. Cloudways SafeUpdates now available.
• ChenCVer / python_cpp_extension

  View on GitHub
  C++ and CUDA extensions for Python/Pytorch and GPU Accelerated Augmentation.
  ☆34Nov 30, 2022Updated 3 years ago
• harubaru / stable-diffusion-training

  View on GitHub
  ☆11Sep 5, 2022Updated 4 years ago
• michael-wzhu / Chinese-LlaMA2

  View on GitHub
  Repo for adapting Meta LlaMA2 in Chinese! META最新发布的LlaMA2的汉化版！ （完全开源可商用）
  ☆732Aug 10, 2023Updated 3 years ago
• lefttt / TWYN

  View on GitHub
  ☆13Jan 5, 2026Updated 9 months ago
• AndSonder / student_message

  View on GitHub
  面向对象学习小项目，学生信息管理系统
  ☆10Oct 6, 2019Updated 7 years ago
• YuxingLu613 / Prompt-NER-Chinese

  View on GitHub
  Apply prompt learning in Chinese NER tasks
  ☆13Mar 24, 2022Updated 4 years ago
• William1617 / DTLN_RKNN

  View on GitHub
  ☆10May 30, 2024Updated 2 years ago