GreenBitAI / green-bit-llmLinks
A toolkit for fine-tuning, inferencing, and evaluating GreenBitAI's LLMs.
☆85Updated this week
Alternatives and similar repositories for green-bit-llm
Users that are interested in green-bit-llm are comparing it to the libraries listed below
Sorting:
- Support mixed-precsion inference with vllm☆83Updated 4 months ago
- [COLM 2024] TriForce: Lossless Acceleration of Long Sequence Generation with Hierarchical Speculative Decoding☆251Updated 9 months ago
- Code and dataset of CodeSteer☆56Updated 2 months ago
- Mixed precision inference by Tensorrt-LLM☆80Updated 7 months ago
- MIXQ: Taming Dynamic Outliers in Mixed-Precision Quantization by Online Prediction☆89Updated 7 months ago
- This is the official code repository of MoTCoder: Elevating Large Language Models with Modular of Thought for Challenging Programming Tas…☆82Updated 2 months ago
- The nanoGPT-style implementation of RWKV Language Model - an RNN with GPT-level LLM performance.☆185Updated last year
- APOLLO: SGD-like Memory, AdamW-level Performance☆232Updated last month
- RobustFT: Robust Supervised Fine-tuning for Large Language Models under Noisy Response☆41Updated 5 months ago
- (ACL 2025 Main) A Comprehensive Benchmark for Code Information Retrieval.☆94Updated last week
- [ICLR 2025🔥] SVD-LLM & [NAACL 2025🔥] SVD-LLM V2☆208Updated 2 months ago
- [ICML 2025 Spotlight] ShadowKV: KV Cache in Shadows for High-Throughput Long-Context LLM Inference☆193Updated last month
- A Contamination-free Multi-task Language Understanding Benchmark [Official, ACL 2025]☆117Updated 2 weeks ago
- ☆195Updated 3 weeks ago
- MPLSandbox is an out-of-the-box multi-programming language sandbox designed to provide unified and comprehensive feedback from compiler a…☆176Updated last month
- PB-LLM: Partially Binarized Large Language Models☆152Updated last year
- Repo hosting codes and materials related to speeding LLMs' inference using token merging.☆36Updated last year
- Grimoire is All You Need for Enhancing Large Language Models☆115Updated last year
- ☆50Updated 7 months ago
- A repository for research on medium sized language models.☆76Updated last year
- This tool(enhance_long) aims to enhance the LlaMa2 long context extrapolation capability in the lowest-cost approach, preferably without …☆45Updated last year
- This includes the original implementation of CtrlA: Adaptive Retrieval-Augmented Generation via Inherent Control.☆60Updated 7 months ago
- Work in progress.☆67Updated this week
- Hybrid Latent Reasoning via Reinforcement Learning☆28Updated last week
- ☆53Updated last year
- An acceleration library that supports arbitrary bit-width combinatorial quantization operations☆223Updated 8 months ago
- Parameter-Efficient Sparsity Crafting From Dense to Mixture-of-Experts for Instruction Tuning on General Tasks☆143Updated 8 months ago
- [ICLR2025] Breaking Throughput-Latency Trade-off for Long Sequences with Speculative Decoding☆116Updated 6 months ago
- The official repo for "LLoCo: Learning Long Contexts Offline"☆116Updated 11 months ago
- A general 2-8 bits quantization toolbox with GPTQ/AWQ/HQQ/VPTQ, and export to onnx/onnx-runtime easily.☆172Updated 2 months ago