hemingkx / SWIFT

Related projects ⓘ

Alternatives and complementary repositories for SWIFT

• princeton-nlp / ProLong
  Homepage for ProLong (Princeton long-context language models) and paper "How to Train Long-Context Language Models (Effectively)"
  ☆113Updated last week
• mutonix / pyramidinfer
  ☆31Updated 2 months ago
• raymin0223 / fast_robust_early_exit
  Fast and Robust Early-Exiting Framework for Autoregressive Language Models with Synchronized Parallel Decoding (EMNLP 2023 Long)
  ☆52Updated last month
• songmzhang / DSKD
  Repo for the EMNLP'24 Paper "Dual-Space Knowledge Distillation for Large Language Models".
  ☆36Updated this week
• October2001 / ProLong
  [ACL 2024 (Oral)] A Prospector of Long-Dependency Data for Large Language Models
  ☆53Updated 3 months ago
• Shwai-He / MEO
  The source code of "Merging Experts into One: Improving Computational Efficiency of Mixture of Experts (EMNLP 2023)":
  ☆34Updated 7 months ago
• NJUNLP / MCSD
  Multi-Candidate Speculative Decoding
  ☆28Updated 6 months ago
• Jikai0Wang / OPT-Tree
  OPT-Tree: Speculative Decoding with Adaptive Draft Tree Structure
  ☆18Updated 3 months ago
• namespace-Pt / UltraGist
  ☆15Updated last month
• hkust-nlp / dart-math
  [NeurIPS'24] Official code for *🎯DART-Math: Difficulty-Aware Rejection Tuning for Mathematical Problem-Solving*
  ☆75Updated last month
• chujiezheng / LLM-Extrapolation
  Official repository for paper "Weak-to-Strong Extrapolation Expedites Alignment"
  ☆67Updated 5 months ago
• Zanette-Labs / SpeculativeRejection
  [NeurIPS 2024] Fast Best-of-N Decoding via Speculative Rejection
  ☆21Updated 2 weeks ago
• sail-sg / SimLayerKV
  The official implementation of paper: SimLayerKV: A Simple Framework for Layer-Level KV Cache Reduction.
  ☆36Updated 3 weeks ago
• GATECH-EIC / ACT
  [ICML 2024] Unveiling and Harnessing Hidden Attention Sinks: Enhancing Large Language Models without Training through Attention Calibrati…
  ☆21Updated 4 months ago
• thunlp / Ouroboros
  Ouroboros: Speculative Decoding with Large Model Enhanced Drafting (EMNLP 2024 main)
  ☆76Updated 3 weeks ago
• yyDing1 / ScaleQuest
  We introduce ScaleQuest, a scalable, novel and cost-effective data synthesis method to unleash the reasoning capability of LLMs.
  ☆47Updated 2 weeks ago
• jongwooko / distillm
  Official PyTorch implementation of DistiLLM: Towards Streamlined Distillation for Large Language Models (ICML 2024)
  ☆134Updated last month
• alisawuffles / proxy-tuning
  Code associated with Tuning Language Models by Proxy (Liu et al., 2024)
  ☆96Updated 7 months ago
• OpenLMLab / LongWanjuan
  Towards Systematic Measurement for Long Text Quality
  ☆28Updated 2 months ago
• ldery / Bonsai
  Code for "Everybody Prune Now: Structured Pruning of LLMs with only Forward Passes"
  ☆28Updated 7 months ago
• KbsdJames / Omni-MATH
  The official repository of the Omni-MATH benchmark.
  ☆47Updated last week
• HKUNLP / STRING
  Data and code for our paper "Why Does the Effective Context Length of LLMs Fall Short?"
  ☆61Updated last week
• zhiyuanhubj / LongRecipe
  LongRecipe: Recipe for Efficient Long Context Generalization in Large Language Models
  ☆66Updated 3 weeks ago
• Leooyii / LCEG
  Long Context Extension and Generalization in LLMs
  ☆39Updated last month
• hemingkx / SpecDec
  Codes for our paper "Speculative Decoding: Exploiting Speculative Execution for Accelerating Seq2seq Generation" (EMNLP 2023 Findings)
  ☆33Updated 11 months ago
• zjunlp / KnowledgeCircuits
  [NeurIPS 2024] Knowledge Circuits in Pretrained Transformers
  ☆68Updated 3 weeks ago
• DAMO-NLP-SG / CLEX
  [ICLR 2024] CLEX: Continuous Length Extrapolation for Large Language Models
  ☆72Updated 8 months ago
• r-three / smear
  ☆27Updated last year
• OrangeInSouth / DeePEn
  A method of ensemble learning for heterogeneous large language models.
  ☆30Updated 3 months ago
• dvlab-research / Q-LLM
  This is the official repo of "QuickLLaMA: Query-aware Inference Acceleration for Large Language Models"
  ☆38Updated 3 months ago