Alternatives and similar repositories for The-Pile-PubMed

Users that are interested in The-Pile-PubMed are comparing it to the libraries listed below

• EleutherAI / pile-pubmedcentral
  A script for collecting the PubMed Central dataset in a language modelling friendly format.
  ☆24Updated 4 years ago
• alon-albalak / FLAD
  Few-shot Learning with Auxiliary Data
  ☆31Updated last year
• allenai / SciRIFF
  Dataset and evaluation suite enabling LLM instruction-following for scientific literature understanding.
  ☆40Updated 5 months ago
• Alab-NII / Awesome-SciLM
  Pre-trained Language Model for Scientific Text
  ☆46Updated last year
• EagleW / Scientific-Inspiration-Machines-Optimized-for-Novelty
  Official implementation of the ACL 2024: Scientific Inspiration Machines Optimized for Novelty
  ☆85Updated last year
• maszhongming / ParaKnowTransfer
  Code for "Seeking Neural Nuggets: Knowledge Transfer in Large Language Models from a Parametric Perspective"
  ☆32Updated last year
• ylsung / vl-merging
  PyTorch codes for the paper "An Empirical Study of Multimodal Model Merging"
  ☆37Updated last year
• jzbjyb / ReAtt
  Retrieval as Attention
  ☆83Updated 2 years ago
• hartvigsen-group / composable-interventions
  ☆28Updated 6 months ago
• eric11eca / disco
  Generating diverse counterfactual data for Natural Language Understanding tasks using Large Language Models (LLMs). The generator support…
  ☆37Updated 2 years ago
• HazyResearch / skill-it
  Skill-It! A Data-Driven Skills Framework for Understanding and Training Language Models
  ☆46Updated last year
• cambridgeltl / PairS
  Aligning with Human Judgement: The Role of Pairwise Preference in Large Language Model Evaluators (Liu et al.; COLM 2024)
  ☆48Updated 7 months ago
• ShiZhengyan / PowerfulPromptFT
  [NeurIPS 2023 Main Track] This is the repository for the paper titled "Don’t Stop Pretraining? Make Prompt-based Fine-tuning Powerful Lea…
  ☆75Updated last year
• googleinterns / localizing-paragraph-memorization
  ☆14Updated last year
• csitfun / LogiCoT
  the instructions and demonstrations for building a formal logical reasoning capable GLM
  ☆54Updated last year
• abhika-m / FAVA
  ☆74Updated last year
• msakarvadia / AttentionLens
  Interpretating the latent space representations of attention head outputs for LLMs
  ☆34Updated last year
• facebookresearch / UNIREX
  This is the official PyTorch repo for "UNIREX: A Unified Learning Framework for Language Model Rationale Extraction" (ICML 2022).
  ☆26Updated 2 years ago
• hamishivi / automated-instruction-selection
  Exploration of automated dataset selection approaches at large scales.
  ☆47Updated 6 months ago
• joeljang / ELM
  [ICML 2023] Exploring the Benefits of Training Expert Language Models over Instruction Tuning
  ☆99Updated 2 years ago
• allenai / peS2o
  Pretraining Efficiently on S2ORC!
  ☆166Updated 10 months ago
• google / belief-localization
  This repository includes code for the paper "Does Localization Inform Editing? Surprising Differences in Where Knowledge Is Stored vs. Ca…
  ☆61Updated 2 years ago
• mandyyyyii / scibench
  ☆125Updated last year
• EleutherAI / pile_dedupe
  Pile Deduplication Code
  ☆19Updated 2 years ago
• ctlllll / reward_collapse
  ☆27Updated 2 years ago
• terarachang / DataICL
  Data Valuation on In-Context Examples (ACL23)
  ☆24Updated 7 months ago
• felixzli / synthetic_pretraining
  ☆38Updated 3 years ago
• xlang-ai / icl-selective-annotation
  [ICLR 2023] Code for our paper "Selective Annotation Makes Language Models Better Few-Shot Learners"
  ☆110Updated 2 years ago
• ekinakyurek / google-research
  Google Research
  ☆45Updated 2 years ago
• ThomasScialom / T0_continual_learning
  Adding new tasks to T0 without catastrophic forgetting
  ☆33Updated 2 years ago