Another ChatGLM2 implementation for GPTQ quantization
☆55Oct 15, 2023Updated 2 years ago
Alternatives and similar repositories for chatglm-q
Users that are interested in chatglm-q are comparing it to the libraries listed below. We may earn a commission when you buy through links labeled 'Ad' on this page.
Sorting:
- run ChatGLM2-6B in BM1684X☆49Mar 1, 2024Updated 2 years ago
- 基于自由度（熵）、凝固度 新词发现算法实现☆12Oct 7, 2018Updated 8 years ago
- An End-to-end Mutually Interactive Emotion-Cause Pair Extractor via Soft-sharing☆13Aug 11, 2022Updated 4 years ago
- 东南大学本科毕业设计（论文）模版☆104Mar 9, 2024Updated 2 years ago
- A simple cycle-accurate DaDianNao simulator☆13Mar 27, 2019Updated 7 years ago
- Serverless GPU API endpoints on Runpod - Get Bonus Credits • AdSkip the infrastructure headaches. Auto-scaling, pay-as-you-go, no-ops approach lets you focus on innovating your application.
- An implementation of LazyLLM token pruning for LLaMa 2 model family.☆13Jan 6, 2025Updated last year
- （1）弹性区间标准化的旋转位置词嵌入编码器+peft LORA量化训练，提高万级tokens性能支持。（2）证据理论解释学习，提升模型的复杂逻辑推理能力（3）兼容alpaca数据格式。☆43Jul 19, 2023Updated 3 years ago
- ☆14Nov 20, 2022Updated 3 years ago
- Simple Structured Perceptron tagger in Python☆10May 30, 2017Updated 9 years ago
- 基于鼠标键盘操作的微信自动聊天机器人☆13Nov 26, 2024Updated last year
- chatglm-6b微调/LORA/PPO/推理, 样本为自动生成的整数/小数加减乘除运算, 可gpu/cpu☆165Aug 24, 2023Updated 3 years ago
- ☆23Aug 7, 2023Updated 3 years ago
- A high-throughput and memory-efficient inference and serving engine for LLMs☆12Nov 14, 2025Updated 11 months ago
- A package for filtering sensitive data (parameters, keys) from a variety of JS objects☆10Feb 17, 2026Updated 7 months ago
- Managed Kubernetes at scale on DigitalOcean • AdDigitalOcean Kubernetes includes the control plane, bandwidth allowance, container registry, automatic updates, and more for free.
- Asynchronous event I/O driven quantitative trading framework.☆12Aug 29, 2020Updated 6 years ago
- 纯c++的全平台llm加速库，支持python调用，支持chatglm-6B, llama, baichuan, moss基座，x86 / ARM☆13Aug 21, 2026Updated last month
- Some skills of English research paper writing☆19Aug 4, 2020Updated 6 years ago
- Echelon Blockchain Node - Cosmos SDK, IBC, and EVM compatible☆17Jan 19, 2026Updated 8 months ago
- Accelerating GOT-OCRv2 with VLLM☆10Nov 15, 2024Updated last year
- Diagram-first LLM architecture, memory, hardware-fit, throughput, and verified cloud-cost explorer.☆22Aug 24, 2026Updated last month
- This project is targeted to detect which parking lot (actually any user defined polygon) are occupied by any object.☆12Aug 30, 2018Updated 8 years ago
- Research project leveraging Abstract Syntax Trees and Knowledge Graphs with Retrieval-Augmented Generation to develop an advanced, contex…☆13Jul 18, 2024Updated 2 years ago
- 使用peft库，对chatGLM-6B/chatGLM2-6B实现4bit的QLoRA高效微调，并做lora model和base model的merge及4bit的量化（quantize）。☆356Aug 22, 2023Updated 3 years ago
- Deploy on Railway without the complexity - Free Credits Offer • AdConnect your repo and Railway handles the rest with instant previews. Quickly provision container image services, databases, and storage volumes.
- Instruct-tune LLaMA on consumer hardware☆71Jun 3, 2023Updated 3 years ago
- Mujoco Playground experiment for Open Duck Mini V2☆40Feb 24, 2025Updated last year
- Firefly中文LLaMA-2大模型，支持增量预训练Baichuan2、Llama2、Llama、Falcon、Qwen、Baichuan、InternLM、Bloom等大模型☆415Oct 21, 2023Updated 2 years ago
- FedNew: A Communication-Efficient and Privacy-Preserving Newton-Type Method for Federated Learning☆18Jun 2, 2022Updated 4 years ago
- This the code of paper "Generative Adversarial Network Based Abnormal Behavior Detection in Massive Crowd Videos: A Hajj Case Study"☆11Jun 8, 2021Updated 5 years ago
- Adaptive floating-point based numerical format for resilient deep learning☆14Apr 11, 2022Updated 4 years ago
- C++ implementation of ChatGLM-6B & ChatGLM2-6B & ChatGLM3 & GLM4(V)☆2,958Jul 31, 2024Updated 2 years ago
- ☆17Jun 1, 2022Updated 4 years ago
- Machine Translation 2018 / Hailong Cao, HIT☆11Apr 17, 2018Updated 8 years ago
- Deploy to Railway using AI coding agents - Free Credits Offer • AdUse Claude Code, Codex, OpenCode, and more. Autonomous software development now has the infrastructure to match with Railway.
- DETR tensor去除推理过程无用辅助头+fp16部署再次加速+解决转tensorrt 输出全为0问题的新方法。☆12Jan 9, 2024Updated 2 years ago
- Simple implementation of using lora form the peft library to fine-tune the chatglm-6b☆84Apr 3, 2023Updated 3 years ago
- use chatGLM to perform text embedding☆45Apr 9, 2023Updated 3 years ago
- Asynchronous event I/O driven quantitative trading framework.☆20Mar 15, 2021Updated 5 years ago
- A corpus of short answers written by learners of English and graded with CEFR levels☆13Dec 17, 2021Updated 4 years ago
- ☆23Apr 21, 2023Updated 3 years ago
- fastllm是后端无依赖的高性能大模型推理库。同时支持张量并行推理稠密模型和混合模式推理MOE模型，任意10G以上显卡即可推理满血DeepSeek。双路9004/9005服务器+单显卡部署DeepSeek满血满精度原版模型，单并发20tps；INT4量化模型单并发30tp…☆5,102Updated this week