Saibo-creator / Awesome-LLM-Constrained-Decoding
A curated list of papers related to constrained decoding of LLM, along with their relevant code and resources.
☆190Updated last month
Alternatives and similar repositories for Awesome-LLM-Constrained-Decoding:
Users that are interested in Awesome-LLM-Constrained-Decoding are comparing it to the libraries listed below
- open-source code for paper: Retrieval Head Mechanistically Explains Long-Context Factuality☆185Updated 8 months ago
- ☆221Updated 8 months ago
- [EMNLP 2023] Adapting Language Models to Compress Long Contexts☆302Updated 7 months ago
- Implementation of paper Data Engineering for Scaling Language Models to 128K Context☆459Updated last year
- A simple toolkit for benchmarking LLMs on mathematical reasoning tasks. 🧮✨☆203Updated 11 months ago
- ACL 2024 | LooGLE: Long Context Evaluation for Long-Context Language Models☆182Updated 6 months ago
- Homepage for ProLong (Princeton long-context language models) and paper "How to Train Long-Context Language Models (Effectively)"☆175Updated last month
- Offical Repo for "Programming Every Example: Lifting Pre-training Data Quality Like Experts at Scale"☆236Updated this week
- ☆149Updated 4 months ago
- Reproducible, flexible LLM evaluations☆191Updated 3 weeks ago
- [ACL 2024] Long-Context Language Modeling with Parallel Encodings☆154Updated 10 months ago
- Awesome LLM Self-Consistency: a curated list of Self-consistency in Large Language Models☆96Updated 8 months ago
- A Survey on Data Selection for Language Models☆225Updated 6 months ago
- A curated list of LLM Interpretability related material - Tutorial, Library, Survey, Paper, Blog, etc..☆223Updated last month
- "Improving Mathematical Reasoning with Process Supervision" by OPENAI☆108Updated 2 weeks ago
- LOFT: A 1 Million+ Token Long-Context Benchmark☆187Updated 2 weeks ago
- Codes for the paper "∞Bench: Extending Long Context Evaluation Beyond 100K Tokens": https://arxiv.org/abs/2402.13718☆319Updated 6 months ago
- A simple unified framework for evaluating LLMs☆209Updated last week
- Code and data for "Lost in the Middle: How Language Models Use Long Contexts"☆340Updated last year
- The repo for In-context Autoencoder☆122Updated 11 months ago
- DSIR large-scale data selection framework for language model training☆246Updated last year
- [NeurIPS 2024] Knowledge Circuits in Pretrained Transformers☆141Updated 2 months ago
- Official repository for "Scaling Retrieval-Based Langauge Models with a Trillion-Token Datastore".☆196Updated 2 weeks ago
- Positional Skip-wise Training for Efficient Context Window Extension of LLMs to Extremely Length (ICLR 2024)☆205Updated 11 months ago
- REST: Retrieval-Based Speculative Decoding, NAACL 2024☆199Updated 4 months ago
- 🌾 OAT: A research-friendly framework for LLM online alignment, including preference learning, reinforcement learning, etc.☆325Updated this week
- Evaluating LLMs with fewer examples☆151Updated last year
- Reproducing R1 for Code with Reliable Rewards☆179Updated this week
- Explorations into some recent techniques surrounding speculative decoding☆259Updated 4 months ago
- [NeurIPS'24] Official code for *🎯DART-Math: Difficulty-Aware Rejection Tuning for Mathematical Problem-Solving*☆101Updated 4 months ago