anadim / the-little-retrieval-testLinks
☆34Updated 2 years ago
Alternatives and similar repositories for the-little-retrieval-test
Users that are interested in the-little-retrieval-test are comparing it to the libraries listed below
Sorting:
- ☆38Updated last year
- [ACL'24 Oral] Analysing The Impact of Sequence Composition on Language Model Pre-Training☆22Updated 10 months ago
- ☆74Updated last year
- Skill-It! A Data-Driven Skills Framework for Understanding and Training Language Models☆46Updated last year
- The official code of EMNLP 2022, "SCROLLS: Standardized CompaRison Over Long Language Sequences".☆70Updated last year
- Language models scale reliably with over-training and on downstream tasks☆97Updated last year
- Repo for the paper "Large Language Models Struggle to Learn Long-Tail Knowledge"☆77Updated 2 years ago
- Pile Deduplication Code☆19Updated 2 years ago
- Large language models (LLMs) made easy, EasyLM is a one stop solution for pre-training, finetuning, evaluating and serving LLMs in JAX/Fl…☆75Updated 10 months ago
- Revisiting Mid-training in the Era of RL Scaling☆62Updated 2 months ago
- ☆11Updated last year
- A toolkit for scaling law research ⚖☆49Updated 5 months ago
- The source code of our work "Prepacking: A Simple Method for Fast Prefilling and Increased Throughput in Large Language Models" [AISTATS …☆59Updated 8 months ago
- A framework for few-shot evaluation of autoregressive language models.☆24Updated last year
- A Kernel-Based View of Language Model Fine-Tuning https://arxiv.org/abs/2210.05643☆75Updated last year
- ☆13Updated last month
- ☆29Updated 11 months ago
- A repository for transformer critique learning and generation☆90Updated last year
- ☆51Updated last year
- ☆28Updated last year
- Repository for "Propagating Knowledge Updates to LMs Through Distillation" (NeurIPS 2023).☆25Updated 10 months ago
- [AAAI 2024] Investigating the Effectiveness of Task-Agnostic Prefix Prompt for Instruction Following☆79Updated 9 months ago
- Official code repo for paper "Great Memory, Shallow Reasoning: Limits of kNN-LMs"☆23Updated last month
- Data and code for the preprint "In-Context Learning with Long-Context Models: An In-Depth Exploration"☆37Updated 10 months ago
- Long Context Extension and Generalization in LLMs☆57Updated 9 months ago
- ☆48Updated last month
- Code and Configs for Asynchronous RLHF: Faster and More Efficient RL for Language Models☆57Updated 2 months ago
- [ICLR 2023] Guess the Instruction! Flipped Learning Makes Language Models Stronger Zero-Shot Learners☆116Updated 9 months ago
- Retrieval as Attention☆82Updated 2 years ago
- A fusion of a linear layer and a cross entropy loss, written for pytorch in triton.☆68Updated 10 months ago