Another ChatGLM2 implementation for GPTQ quantization
☆55Oct 15, 2023Updated 2 years ago
Alternatives and similar repositories for chatglm-q
Users that are interested in chatglm-q are comparing it to the libraries listed below. We may earn a commission when you buy through links labeled 'Ad' on this page.
Sorting:
- ☆90Jun 30, 2023Updated 2 years ago
- run ChatGLM2-6B in BM1684X☆49Mar 1, 2024Updated 2 years ago
- A prompt set of ChatGLM-6B☆15Jul 21, 2023Updated 2 years ago
- （1）弹性区间标准化的旋转位置词嵌入编码器+peft LORA量化训练，提高万级tokens性能支持。（2）证据理论解释学习，提升模型的复杂逻辑推理能力（3）兼容alpaca数据格式。☆45Jul 19, 2023Updated 2 years ago
- LLaMa/RWKV onnx models, quantization and testcase☆366Jul 6, 2023Updated 2 years ago
- DigitalOcean Gradient AI Platform • AdBuild production-ready AI agents using customizable tools or access multiple LLMs through a single endpoint. Create custom knowledge bases or connect external data.
- ☆14Nov 20, 2022Updated 3 years ago
- 基于鼠标键盘操作的微信自动聊天机器人☆13Nov 26, 2024Updated last year
- 本项目采用PyTorch和transformers模块实现英语序列标注，其中对BERT进行微调。☆19Feb 1, 2021Updated 5 years ago
- chatglm-6b微调/LORA/PPO/推理, 样本为自动生成的整数/小数加减乘除运算, 可gpu/cpu☆165Aug 24, 2023Updated 2 years ago
- A high-throughput and memory-efficient inference and serving engine for LLMs☆12Nov 14, 2025Updated 4 months ago
- 第一名克莱登大学二队方案分享☆18Mar 5, 2021Updated 5 years ago
- 基于pytorch的不平衡数据的文本分类☆12Dec 26, 2021Updated 4 years ago
- Asynchronous event I/O driven quantitative trading framework.☆12Aug 29, 2020Updated 5 years ago
- 纯c++的全平台llm加速库，支持python调用，支持chatglm-6B, llama, baichuan, moss基座，x86 / ARM☆12Jan 30, 2026Updated last month
- GPU virtual machines on DigitalOcean Gradient AI • AdGet to production fast with high-performance AMD and NVIDIA GPUs you can spin up in seconds. The definition of operational simplicity.
- ☆16Mar 6, 2026Updated 2 weeks ago
- use chatGLM to perform text embedding☆45Apr 9, 2023Updated 2 years ago
- 使用peft库，对chatGLM-6B/chatGLM2-6B实现4bit的QLoRA高效微调，并做lora model和base model的merge及4bit的量化（quantize）。☆360Aug 22, 2023Updated 2 years ago
- Accelerating GOT-OCRv2 with VLLM☆11Nov 15, 2024Updated last year
- 人工精调的中文对话数据集和一段chatglm的微调代码☆1,194May 3, 2025Updated 10 months ago
- Firefly中文LLaMA-2大模型，支持增量预训练Baichuan2、Llama2、Llama、Falcon、Qwen、Baichuan、InternLM、Bloom等大模型☆416Oct 21, 2023Updated 2 years ago
- ☆15Aug 21, 2023Updated 2 years ago
- Simple implementation of using lora form the peft library to fine-tune the chatglm-6b☆84Apr 3, 2023Updated 2 years ago
- [ICML 2023] Optimizing the Collaboration Structure in Cross-Silo Federated Learning. Wenxuan Bao, Haohan Wang, Jun Wu, Jingrui He.☆20Jul 25, 2023Updated 2 years ago
- Proton VPN Special Offer - Get 70% off • AdSpecial partner offer. Trusted by over 100 million users worldwide. Tested, Approved and Recommended by Experts.
- Machine Translation 2018 / Hailong Cao, HIT☆11Apr 17, 2018Updated 7 years ago
- Asynchronous event I/O driven quantitative trading framework.☆20Mar 15, 2021Updated 5 years ago
- Adversarial learning by utilizing model interpretation☆10Oct 19, 2018Updated 7 years ago
- fastllm是后端无依赖的高性能大模型推理库。同时支持张量并行推理稠密模型和混合模式推理MOE模型，任意10G以上显卡即可推理满血DeepSeek。双路9004/9005服务器+单显卡部署DeepSeek满血满精度原版模型，单并发20tps；INT4量化模型单并发30tp…☆4,173Updated this week
- DETR tensor去除推理过程无用辅助头+fp16部署再次加速+解决转tensorrt 输出全为0问题的新方法。☆10Jan 9, 2024Updated 2 years ago
- Fine-tuning ChatGLM-6B with PEFT | 基于 PEFT 的高效 ChatGLM 微调☆3,730Oct 12, 2023Updated 2 years ago
- Research project leveraging Abstract Syntax Trees and Knowledge Graphs with Retrieval-Augmented Generation to develop an advanced, contex…☆12Jul 18, 2024Updated last year
- GEMM by WMMA (tensor core)☆15Jul 31, 2022Updated 3 years ago
- ☆59Aug 1, 2023Updated 2 years ago
- Proton VPN Special Offer - Get 70% off • AdSpecial partner offer. Trusted by over 100 million users worldwide. Tested, Approved and Recommended by Experts.
- ☆17Jun 1, 2022Updated 3 years ago
- Kanchil（鼷鹿）是世界 上最小的偶蹄目动物，这个开源项目意在探索小模型（6B以下）是否也能具备和人类偏好对齐的能力。☆112Apr 1, 2023Updated 2 years ago
- Cicada is an open source audio annotation tool that lets you annotate audio files in .wav format and also enables you to look into each a…☆22Dec 8, 2022Updated 3 years ago
- Official code for Guiding Language Model Math Reasoning with Planning Tokens☆19Feb 29, 2024Updated 2 years ago
- 基于chatglm快速搭建文档问答机器人☆87May 20, 2023Updated 2 years ago
- This project is targeted to detect which parking lot (actually any user defined polygon) are occupied by any object.☆11Aug 30, 2018Updated 7 years ago
- ChatYuan: Large Language Model for Dialogue in Chinese and English☆1,880Jun 16, 2023Updated 2 years ago