wangqinsi1/CoreInfer external links

---

GitHub - View repository

GitHub.dev - Open in online code editor

Star history - Growth chart over time

deps.dev - Dependencies and security vulnerabilities

Gitingest - Export source code for LLM usage

Repomix - Export source code for LLM usage

uithub - Export source code for LLM usage

Close

wangqinsi1/CoreInfer

Readme badge preview -

If you own this repo, copy the snippet below and add it to your README.md

---

Copy

[![RelatedRepos](https://img.shields.io/badge/related-repos-yellow)](https://relatedrepos.com/gh/wangqinsi1/CoreInfer)

Close

wangqinsi1 / CoreInferView on GitHubMore

• External links
• Readme badge

This is the official Python version of CoreInfer: Accelerating Large Language Model Inference with Semantics-Inspired Adaptive Sparse Activation.

☆17Oct 25, 2024Updated last year

Alternatives and similar repositories for CoreInfer

Users that are interested in CoreInfer are comparing it to the libraries listed below

• linyueqian / HippoMM

  View on GitHub
  HippoMM: Hippocampal-inspired Multimodal Memory
  ☆15May 22, 2025Updated 9 months ago
• Ting-Justin-Jiang / sada-icml

  View on GitHub
  [ICML 2025] Official Repo for Stability-guided Adaptive Diffusion Acceleration. 🚀🌙Accelerating off-the-shelf diffusion model with a uni…
  ☆39Jul 24, 2025Updated 7 months ago
• ROIM1998 / APT

  View on GitHub
  [ICML'24 Oral] APT: Adaptive Pruning and Tuning Pretrained Language Models for Efficient Training and Inference
  ☆47Jun 4, 2024Updated last year
• zjysteven / mink-plus-plus

  View on GitHub
  [ICLR'25 Spotlight] Min-K%++: Improved baseline for detecting pre-training data of LLMs
  ☆52May 26, 2025Updated 9 months ago
• hyx1999 / SAM-Decoding

  View on GitHub
  Official Implementation of SAM-Decoding: Speculative Decoding via Suffix Automaton
  ☆40Feb 13, 2025Updated last year
• betarixm / CSED423

  View on GitHub
  POSTECH: Compiler Construction (Spring 2022)
  ☆10Mar 10, 2023Updated 2 years ago
• HarryWu99 / llm_kvcache_sparsity

  View on GitHub
  Implement some method of LLM KV Cache Sparsity
  ☆41Jun 6, 2024Updated last year
• diku-dk / dpp-e2023-pub

  View on GitHub
  Repository for the DPP'23 course
  ☆11May 2, 2024Updated last year
• rhubarbwu / neural-collapse

  View on GitHub
  Generic library for neural collapse and several derivative works on the phenomenon.
  ☆18Apr 14, 2025Updated 10 months ago
• SuDIS-ZJU / nlcTables

  View on GitHub
  ☆15Jan 27, 2026Updated last month
• tsinghua-ideal / Twilight

  View on GitHub
  [NeurIPS'25 Spotlight] Adaptive Attention Sparsity with Hierarchical Top-p Pruning
  ☆87Nov 29, 2025Updated 3 months ago
• DerrickYLJ / TidalDecode

  View on GitHub
  [ICLR 2025] TidalDecode: A Fast and Accurate LLM Decoding with Position Persistent Sparse Attention
  ☆52Aug 6, 2025Updated 6 months ago
• Shwai-He / MEO

  View on GitHub
  The source code of "Merging Experts into One: Improving Computational Efficiency of Mixture of Experts (EMNLP 2023)":
  ☆44Feb 18, 2026Updated last week
• mbalesni / deepspeed_llama

  View on GitHub
  Finetuning LLaMA with DeepSpeed
  ☆10Apr 14, 2023Updated 2 years ago
• yuny220 / NAR-Former

  View on GitHub
  Pytorch code of [CVPR 2023] "NAR-Former: Neural Architecture Representation Learning towards Holistic Attributes Prediction".
  ☆11Mar 14, 2023Updated 2 years ago
• TerryPei / CSP

  View on GitHub
  Cross-Self KV Cache Pruning for Efficient Vision-Language Inference
  ☆10Dec 15, 2024Updated last year
• ycao5602 / KAFAL

  View on GitHub
  Code for the paper "Knowledge-Aware Federated Active Learning with Non-IID Data", ICCV2023
  ☆10Sep 8, 2023Updated 2 years ago
• linyueqian / VERA

  View on GitHub
  ☆118Nov 4, 2025Updated 3 months ago
• gccnlp / Light-PEFT

  View on GitHub
  [ACL 2024 Findings] Light-PEFT: Lightening Parameter-Efficient Fine-Tuning via Early Pruning
  ☆13Sep 2, 2024Updated last year
• wuch15 / FedAttack

  View on GitHub
  Source code of FedAttack.
  ☆11Feb 9, 2022Updated 4 years ago
• abdelfattah-lab / shadow_llm

  View on GitHub
  ☆11Sep 20, 2024Updated last year
• UbiquitousLearning / NNV12

  View on GitHub
  ☆13May 11, 2023Updated 2 years ago
• hao-ai-lab / cse234-w25

  View on GitHub
  Website for CSE 234, Winter 2025
  ☆13Mar 24, 2025Updated 11 months ago
• ustc-hyin / HiMAP

  View on GitHub
  Code for paper: Unraveling the Shift of Visual Information Flow in MLLMs: From Phased Interaction to Efficient Inference
  ☆13Jun 7, 2025Updated 8 months ago
• AndraIonescu / reproducing-schema-matching

  View on GitHub
  Master thesis - reproducing state-of-the-art schema matching algorithms
  ☆14Jul 6, 2023Updated 2 years ago
• Crypt0knights / OpenTrack

  View on GitHub
  An Efficient Supply Chain Management System using Blockchain & Machine Learning.
  ☆10Nov 27, 2019Updated 6 years ago
• TUDB-Labs / Awesome-LLM-LoRA

  View on GitHub
  ☆17May 2, 2024Updated last year
• Daftstone / TrialAttack

  View on GitHub
  Tensorflow implementation of TrialAttack (Triple Adversarial Learning for Influence based Poisoning Attack in Recommender Systems. KDD 20…
  ☆12Sep 2, 2021Updated 4 years ago
• xytpai / retinanet

  View on GitHub
  ☆10May 30, 2020Updated 5 years ago
• srush / Hierarchical-Bayes-Compiler

  View on GitHub
  Hal Daume's hbc
  ☆20Jan 23, 2010Updated 16 years ago
• brucespang / sammy

  View on GitHub
  Smoothing video traffic to make it a friendlier internet neighbor
  ☆14Apr 23, 2024Updated last year
• hemingkx / SWIFT

  View on GitHub
  [ICLR 2025] SWIFT: On-the-Fly Self-Speculative Decoding for LLM Inference Acceleration
  ☆62Feb 21, 2025Updated last year
• jiazhihao / attention_superoptimizer

  View on GitHub
  An Attention Superoptimizer
  ☆22Jan 20, 2025Updated last year
• wangyiqiu / pargeo

  View on GitHub
  A Collection of Parallel Algorithms for Computational Geometry
  ☆12Mar 10, 2022Updated 3 years ago
• daemyung / practice-triton

  View on GitHub
  삼각형의 실전! Triton
  ☆16Feb 15, 2024Updated 2 years ago
• HankYe / Once-for-Both

  View on GitHub
  [CVPR'24] Once for Both: Single Stage of Importance and Sparsity Search for Vision Transformer Compression
  ☆15Jul 1, 2024Updated last year
• pzs19 / TokenSelect

  View on GitHub
  ☆18Mar 11, 2025Updated 11 months ago
• artemisart / EuroSAT-image-classification

  View on GitHub
  Satellite images classification
  ☆15Nov 30, 2019Updated 6 years ago
• mkantwala / DeepSeek-R1-TrainingSuite

  View on GitHub
  Advanced implementation of DeepSeek-R1 featuring Group Relative Policy Optimization (GRPO) for mathematical reasoning AI. Integrates safe…
  ☆13Jan 29, 2025Updated last year