Alternatives and similar repositories for llm-compressive:

Users that are interested in llm-compressive are comparing it to the libraries listed below

• thunlp / Ouroboros
  Ouroboros: Speculative Decoding with Large Model Enhanced Drafting (EMNLP 2024 main)
  ☆85Updated 3 months ago
• NormXU / Consistent-DynamicNTKRoPE
  An Experiment on Dynamic NTK Scaling RoPE
  ☆62Updated last year
• DAMO-NLP-SG / CLEX
  [ICLR 2024] CLEX: Continuous Length Extrapolation for Large Language Models
  ☆75Updated 10 months ago
• Zanette-Labs / SpeculativeRejection
  [NeurIPS 2024] Fast Best-of-N Decoding via Speculative Rejection
  ☆38Updated 2 months ago
• fla-org / flame
  🔥 A minimal training framework for scaling FLA models
  ☆24Updated this week
• shaochenze / PatchTrain
  Code for paper "Patch-Level Training for Large Language Models"
  ☆75Updated 2 months ago
• RUCAIBox / BAMBOO
  ☆33Updated 9 months ago
• cofe-ai / Mu-scaling
  Research without Re-search: Maximal Update Parametrization Yields Accurate Loss Prediction across Scales
  ☆31Updated last year
• OpenLMLab / scaling-rope
  code for Scaling Laws of RoPE-based Extrapolation
  ☆71Updated last year
• yegcjs / mixinglaws
  ☆93Updated 3 months ago
• GAIR-NLP / Entropy-ABF
  Official implementation for 'Extending LLMs’ Context Window with 100 Samples'
  ☆76Updated last year
• whyNLP / LCKV
  Layer-Condensed KV cache w/ 10 times larger batch size, fewer params and less computation. Dramatic speed up with better task performance…
  ☆146Updated last month
• feifeibear / Odysseus-Transformer
  Odysseus: Playground of LLM Sequence Parallelism
  ☆64Updated 7 months ago
• yyDing1 / ScaleQuest
  We introduce ScaleQuest, a scalable, novel and cost-effective data synthesis method to unleash the reasoning capability of LLMs.
  ☆58Updated 2 months ago
• AI21Labs / Parallel-Context-Windows
  ☆105Updated last year
• SalesforceAIResearch / GemFilter
  ☆69Updated this week
• meowpass / FollowComplexInstruction
  Official implementation of the paper "From Complex to Simple: Enhancing Multi-Constraint Complex Instruction Following Ability of Large L…
  ☆42Updated 6 months ago
• wxjiao / InstructMT
  A collection of instruction data and scripts for machine translation.
  ☆20Updated last year
• IST-DASLab / QIGen
  Repository for CPU Kernel Generation for LLM Inference
  ☆25Updated last year
• YuchuanTian / RethinkTinyLM
  [ICML'24] The official implementation of “Rethinking Optimization and Architecture for Tiny Language Models”
  ☆119Updated this week
• Aleph-Alpha / NeurIPS-WANT-submission-efficient-parallelization-layouts
  ☆22Updated last year
• infinigence / LVEval
  Repository of LV-Eval Benchmark
  ☆56Updated 4 months ago
• shreyansh26 / Speculative-Sampling
  Implementation of Speculative Sampling as described in "Accelerating Large Language Model Decoding with Speculative Sampling" by Deepmind
  ☆85Updated 10 months ago
• zexuanqiu / CLongEval
  CLongEval: A Chinese Benchmark for Evaluating Long-Context Large Language Models
  ☆38Updated 10 months ago
• thu-ml / low-bit-optimizers
  Low-bit optimizers for PyTorch
  ☆125Updated last year
• princeton-nlp / ProLong
  Homepage for ProLong (Princeton long-context language models) and paper "How to Train Long-Context Language Models (Effectively)"
  ☆147Updated last month
• MayDomine / Burst-Attention
  Distributed IO-aware Attention algorithm
  ☆18Updated 4 months ago
• AniZpZ / AutoSmoothQuant
  An easy-to-use package for implementing SmoothQuant for LLMs
  ☆89Updated 8 months ago
• chujiezheng / LLM-Extrapolation
  Official repository for paper "Weak-to-Strong Extrapolation Expedites Alignment"
  ☆71Updated 7 months ago
• gpt4life / alpagasus
  Unofficial implementation of AlpaGasus
  ☆90Updated last year