thoppe / The-Pile-PhilPapersLinks
Download, parse, and filter data from Phil Papers. Data-ready for The-Pile.
☆19Updated 2 years ago
Alternatives and similar repositories for The-Pile-PhilPapers
Users that are interested in The-Pile-PhilPapers are comparing it to the libraries listed below
Sorting:
- Embedding Recycling for Language models☆38Updated 2 years ago
- SWIM-IR is a Synthetic Wikipedia-based Multilingual Information Retrieval training set with 28 million query-passage pairs spanning 33 la…☆49Updated 2 years ago
- Aioli: A unified optimization framework for language model data mixing☆31Updated 11 months ago
- ☆53Updated last year
- Anchored Preference Optimization and Contrastive Revisions: Addressing Underspecification in Alignment☆60Updated last year
- Entailment self-training☆25Updated 2 years ago
- Reference implementation for Reward-Augmented Decoding: Efficient Controlled Text Generation With a Unidirectional Reward Model☆45Updated 2 months ago
- ☆23Updated 10 months ago
- Minimum Description Length probing for neural network representations☆20Updated 10 months ago
- Plug-and-play Search Interfaces with Pyserini and Hugging Face☆32Updated 2 years ago
- Using open source LLMs to build synthetic datasets for direct preference optimization☆71Updated last year
- Code for SaGe subword tokenizer (EACL 2023)☆27Updated last year
- A framework for pitting LLMs against each other in an evolving library of games ⚔☆34Updated 8 months ago
- Dataset and evaluation suite enabling LLM instruction-following for scientific literature understanding.☆46Updated 9 months ago
- This is a new metric that can be used to evaluate faithfulness of text generated by LLMs. The work behind this repository can be found he…☆31Updated 2 years ago
- ☆20Updated 2 weeks ago
- Trully flash implementation of DeBERTa disentangled attention mechanism.☆67Updated 2 months ago
- Code for our EMNLP '22 paper "Fixing Model Bugs with Natural Language Patches"☆19Updated 3 years ago
- Implementation of the model: "Reka Core, Flash, and Edge: A Series of Powerful Multimodal Language Models" in PyTorch☆29Updated 2 weeks ago
- Official repository for "BLEUBERI: BLEU is a surprisingly effective reward for instruction following"☆31Updated 6 months ago
- ☆55Updated last year
- ☆15Updated 3 months ago
- ☆14Updated last year
- Starbucks: Improved Training for 2D Matryoshka Embeddings☆22Updated 5 months ago
- ☆38Updated last year
- BPE modification that implements removing of the intermediate tokens during tokenizer training.☆25Updated last year
- Code for our paper Resources and Evaluations for Multi-Distribution Dense Information Retrieval☆15Updated last year
- Learning to route instances for Human vs AI Feedback (ACL Main '25)☆26Updated 4 months ago
- A massively multilingual modern encoder language model☆116Updated 2 months ago
- ☆39Updated last year