Glaciohound / LM-Infinite

Related projects: ⓘ

• princeton-nlp / CEPE
  [ACL 2024] Long-Context Language Modeling with Parallel Encodings
  ☆133Updated 3 months ago
• thunlp / Ouroboros
  Ouroboros: Speculative Decoding with Large Model Enhanced Drafting
  ☆60Updated 6 months ago
• bigai-nlco / LooGLE
  ACL 2024 | LooGLE: Long Context Evaluation for Long-Context Language Models
  ☆148Updated 6 months ago
• THUDM / ReST-MCTS
  ReST-MCTS*: LLM Self-Training via Process Reward Guided Tree Search
  ☆91Updated 3 months ago
• nightdessert / Retrieval_Head
  open-source code for paper: Retrieval Head Mechanistically Explains Long-Context Factuality
  ☆135Updated last month
• OpenBMB / InfiniteBench
  Codes for the paper "∞Bench: Extending Long Context Evaluation Beyond 100K Tokens": https://arxiv.org/abs/2402.13718
  ☆244Updated last week
• hkust-nlp / llm-compression-intelligence
  Official github repo for the paper "Compression Represents Intelligence Linearly"
  ☆121Updated 3 months ago
• jongwooko / distillm
  Official PyTorch implementation of DistiLLM: Towards Streamlined Distillation for Large Language Models (ICML 2024)
  ☆106Updated this week
• ZubinGou / math-evaluation-harness
  A simple toolkit for benchmarking LLMs on mathematical reasoning tasks. 🧮✨
  ☆72Updated 4 months ago
• TIGER-AI-Lab / LongICLBench
  Code and Data for "Long-context LLMs Struggle with Long In-context Learning"
  ☆87Updated 2 months ago
• FasterDecoding / SnapKV
  ☆164Updated 4 months ago
• THUDM / LongAlign
  LongAlign: A Recipe for Long Context Alignment Encompassing Data, Training, and Evaluation
  ☆194Updated 4 months ago
• infinigence / LVEval
  Repository of LV-Eval Benchmark
  ☆41Updated 2 weeks ago
• DAMO-NLP-SG / CLEX
  [ICLR 2024] CLEX: Continuous Length Extrapolation for Large Language Models
  ☆72Updated 6 months ago
• YuchuanTian / RethinkTinyLM
  [ICML'24] The official implementation of “Rethinking Optimization and Architecture for Tiny Language Models”
  ☆114Updated 2 months ago
• FasterDecoding / REST
  REST: Retrieval-Based Speculative Decoding, NAACL 2024
  ☆158Updated 4 months ago
• dwzhu-pku / PoSE
  Positional Skip-wise Training for Efficient Context Window Extension of LLMs to Extremely Length (ICLR 2024)
  ☆195Updated 3 months ago
• DRSY / EasyKV
  Easy control for Key-Value Constrained Generative LLM Inference(https://arxiv.org/abs/2402.06262)
  ☆56Updated 7 months ago
• hkust-nlp / dart-math
  Official implementation for the paper *🎯DART-Math: Difficulty-Aware Rejection Tuning for Mathematical Problem-Solving*
  ☆57Updated 3 weeks ago
• princeton-nlp / QuRating
  [ICML 2024] Selecting High-Quality Data for Training Language Models
  ☆134Updated 2 months ago
• OFA-Sys / gsm8k-ScRel
  Codes and Data for Scaling Relationship on Learning Mathematical Reasoning with Large Language Models
  ☆208Updated last week
• AI21Labs / Parallel-Context-Windows
  ☆99Updated last year
• astramind-ai / Mixture-of-depths
  Unofficial implementation for the paper "Mixture-of-Depths: Dynamically allocating compute in transformer-based language models"
  ☆123Updated 2 months ago
• FasterDecoding / TEAL
  ☆75Updated this week
• thunlp / MoEfication
  ☆104Updated last month
• lucidrains / speculative-decoding
  Explorations into some recent techniques surrounding speculative decoding
  ☆190Updated 11 months ago
• Equationliu / Kangaroo
  Implementation of Kangaroo: Lossless Self-Speculative Decoding via Double Early Exiting
  ☆39Updated 2 months ago
• tianyi-lab / Superfiltering
  [ACL'24] Superfiltering: Weak-to-Strong Data Filtering for Fast Instruction-Tuning
  ☆101Updated last week
• yegcjs / mixinglaws
  ☆87Updated 4 months ago
• TemporaryLoRA / Temp-LoRA
  ☆82Updated 5 months ago