thoppe / The-Pile-PubMedLinks
Download, parse, and filter data PubMed, data-ready for The-Pile
☆23Updated 3 years ago
Alternatives and similar repositories for The-Pile-PubMed
Users that are interested in The-Pile-PubMed are comparing it to the libraries listed below
Sorting:
- A script for collecting the PubMed Central dataset in a language modelling friendly format.☆24Updated 4 years ago
- Skill-It! A Data-Driven Skills Framework for Understanding and Training Language Models☆47Updated last year
- Code for "Seeking Neural Nuggets: Knowledge Transfer in Large Language Models from a Parametric Perspective"☆33Updated last year
- Few-shot Learning with Auxiliary Data☆31Updated last year
- Retrieval as Attention☆83Updated 2 years ago
- ☆74Updated last year
- the instructions and demonstrations for building a formal logical reasoning capable GLM☆54Updated last year
- Pretraining Efficiently on S2ORC!☆169Updated 11 months ago
- Repo for the paper "Large Language Models Struggle to Learn Long-Tail Knowledge"☆78Updated 2 years ago
- Generating diverse counterfactual data for Natural Language Understanding tasks using Large Language Models (LLMs). The generator support…☆37Updated 2 years ago
- ☆28Updated 6 months ago
- Code for paper 'Data-Efficient FineTuning'☆28Updated 2 years ago
- PyTorch codes for the paper "An Empirical Study of Multimodal Model Merging"☆37Updated last year
- Code for our EMNLP '22 paper "Fixing Model Bugs with Natural Language Patches"☆19Updated 2 years ago
- Adding new tasks to T0 without catastrophic forgetting☆33Updated 2 years ago
- ☆128Updated last year
- ☆95Updated last year
- Repository for NPHardEval, a quantified-dynamic benchmark of LLMs☆59Updated last year
- Dataset and evaluation suite enabling LLM instruction-following for scientific literature understanding.☆42Updated 6 months ago
- A Kernel-Based View of Language Model Fine-Tuning https://arxiv.org/abs/2210.05643☆78Updated 2 years ago
- This is the official implementation for our ACL 2024 paper: "Causal Estimation of Memorisation Profiles".☆23Updated 6 months ago
- Pre-trained Language Model for Scientific Text☆46Updated last year
- In-BoXBART: Get Instructions into Biomedical Multi-task Learning☆14Updated 3 years ago
- ☆38Updated 3 years ago
- Transformers at any scale☆41Updated last year
- Embedding Recycling for Language models☆39Updated 2 years ago
- Aligning with Human Judgement: The Role of Pairwise Preference in Large Language Model Evaluators (Liu et al.; COLM 2024)☆48Updated 8 months ago
- Official implementation of Privacy Implications of Retrieval-Based Language Models (EMNLP 2023). https://arxiv.org/abs/2305.14888☆36Updated last year
- Repository for "Propagating Knowledge Updates to LMs Through Distillation" (NeurIPS 2023).☆26Updated last year
- Official implementation of the ACL 2024: Scientific Inspiration Machines Optimized for Novelty☆85Updated last year