纯c++的全平台llm加速库,支持python调用,支持baichuan, glm, llama, moss基座,手机端流畅运行chatglm-6B级模型单卡可达10000+token / s,
☆43Aug 16, 2023Updated 3 years ago
Alternatives and similar repositories for baichuan-speedup
Users that are interested in baichuan-speedup are comparing it to the libraries listed below. We may earn a commission when you buy through links labeled 'Ad' on this page.
Sorting:
- 实现了Baichuan-Chat微调,Lora、QLora等各种微调方式,一键运行。☆70Aug 15, 2023Updated 3 years ago
- ggml implementation of the baichuan13b model (adapted from llama.cpp)☆54Jul 27, 2023Updated 3 years ago
- 天池大赛:金融大脑-金融智能NLP服务☆16Jul 9, 2018Updated 8 years ago
- PFCC 社区博客☆14Updated this week
- ☆23Jul 17, 2023Updated 3 years ago
- Managed Database hosting by DigitalOcean • AdPostgreSQL, MySQL, MongoDB, Kafka, Valkey, and OpenSearch available. Automatically scale up storage and focus on building your apps.
- 基于baichuan-7b的开源多模态大语言模型☆72Dec 7, 2023Updated 2 years ago
- Baichuan2代码的逐行解析版本,适合小白☆210Sep 20, 2023Updated 3 years ago
- c++实现的clip推理,模型有一点点改动,但是不大,改动和导出模型的代码可以在readme里找到,模型文件都在Releases里,包括AX650的模型。新增支持ChineseCLIP☆31Jun 19, 2025Updated last year
- Transformer related optimization, including BERT, GPT☆17Jul 29, 2023Updated 3 years ago
- Golang斗地主游戏开发☆13Feb 14, 2018Updated 8 years ago
- 人工智能社会保险反欺诈分析☆29Aug 5, 2018Updated 8 years ago
- 使用ONNXRuntime部署PP-YOLOE目标检测,支持PP-YOLOE-s、PP-YOLOE-m、PP-YOLOE-l、PP-YOLOE-x四种结构,包含C++和Python两个版本的程序☆22Jun 10, 2022Updated 4 years ago
- SMP2018中文人机对话技术评测(ECDT)☆15Oct 25, 2018Updated 8 years ago
- This sample shows how to use the oneAPI Video Processing Library (oneVPL) to perform a single and multi-source video decode and preproces…☆15Jun 15, 2023Updated 3 years ago
- Deploy to Railway using AI coding agents - Free Credits Offer • AdUse Claude Code, Codex, OpenCode, and more. Autonomous software development now has the infrastructure to match with Railway.
- 中文金融大模型测评基准,六大类二十五任务、等级化评价,国内模型获得A级☆10May 6, 2024Updated 2 years ago
- The sandbox built for Vibe Coding!☆11Updated this week
- ChatGLM-6B添加了RLHF的实现,以及部分核心代码的逐行讲解 ,实例部分是做了个新闻短标题的生成,以及指定context推荐的RLHF的实现☆88Aug 16, 2023Updated 3 years ago
- Towards Systematic Measurement for Long Text Quality☆39Sep 5, 2024Updated 2 years ago
- 实体链接过程中的一些相关代码☆10Jun 13, 2018Updated 8 years ago
- Mesh networking using WiFi Ad-Hoc and OLSR on Android☆10Dec 1, 2018Updated 7 years ago
- CHATGPT-In-Jupyter☆11Jun 2, 2023Updated 3 years ago
- Optimize SGEMM step by step☆10Sep 4, 2024Updated 2 years ago
- 对苏神的bert4keras的实现原理和矩阵运算进行详细的注释,方便学习;bert4keras链接:https://github.com/bojone/bert4keras☆42Dec 15, 2020Updated 5 years ago
- GPU virtual machines on DigitalOcean Gradient AI • AdGet to production fast with high-performance AMD and NVIDIA GPUs you can spin up in seconds. The definition of operational simplicity.
- This repository open-sources our GEC system submitted by THU KELab (sz) in the CCL2023-CLTC Track 1: Multidimensional Chinese Learner Tex…☆15Nov 25, 2023Updated 2 years ago
- Comparison of existing spell checking tools☆11Mar 28, 2023Updated 3 years ago
- 知识融合标注工具☆15Dec 19, 2018Updated 7 years ago
- BiLLa: A Bilingual LLaMA with Enhanced Reasoning Ability☆412Jun 1, 2023Updated 3 years ago
- Code for M4LE: A Multi-Ability Multi-Range Multi-Task Multi-Domain Long-Context Evaluation Benchmark for Large Language Models☆23Jul 27, 2024Updated 2 years ago
- 文本数据增强☆15Apr 10, 2020Updated 6 years ago
- Examples of demo deployment using Gradio. Image Classification, Live Webcam Segmentation, APIs , Tunneling etc.☆17Oct 17, 2022Updated 4 years ago
- Implementation of Yolo using Facebook's Detectron2 (https://github.com/facebookresearch/detectron2) Framework with Quantization support b…☆10Aug 20, 2021Updated 5 years ago
- Cuda Version Image Processing API☆40Mar 17, 2019Updated 7 years ago
- Virtual machines for every use case on DigitalOcean • AdGet dependable uptime with 99.99% SLA, simple security tools, and predictable monthly pricing with DigitalOcean's virtual machines, called Droplets.
- Md5 碰撞生成实现,去掉了boost依赖,简化编译☆12Jan 25, 2018Updated 8 years ago
- Playground project acting as an example for a complex LangChain workflow☆11Jun 20, 2023Updated 3 years ago
- Evaluate typed decision models such as Jev and Valen on text, image and video benchmarks, with one runner and a public leaderboard.☆11Updated this week
- ☆11Sep 5, 2022Updated 4 years ago
- C++ and CUDA extensions for Python/Pytorch and GPU Accelerated Augmentation.☆33Nov 30, 2022Updated 3 years ago
- 使用ONNXRuntime部署面向轻量实时的M-LSD直线检测,包含C++和Python两个版本的程序☆28Jan 21, 2023Updated 3 years ago
- Repo for adapting Meta LlaMA2 in Chinese! META最新发布的LlaMA2的汉化版! (完全开源可商用)☆731Aug 10, 2023Updated 3 years ago
Are these results useful?