Alternatives and similar repositories for The-Pile-PubMed

Users that are interested in The-Pile-PubMed are comparing it to the libraries listed below

• EleutherAI / pile-pubmedcentral
  A script for collecting the PubMed Central dataset in a language modelling friendly format.
  ☆24Updated 4 years ago
• allenai / SciRIFF
  Dataset and evaluation suite enabling LLM instruction-following for scientific literature understanding.
  ☆40Updated 4 months ago
• alon-albalak / FLAD
  Few-shot Learning with Auxiliary Data
  ☆31Updated last year
• maszhongming / ParaKnowTransfer
  Code for "Seeking Neural Nuggets: Knowledge Transfer in Large Language Models from a Parametric Perspective"
  ☆32Updated last year
• Alab-NII / Awesome-SciLM
  Pre-trained Language Model for Scientific Text
  ☆45Updated last year
• HazyResearch / skill-it
  Skill-It! A Data-Driven Skills Framework for Understanding and Training Language Models
  ☆46Updated last year
• princeton-nlp / LM-Kernel-FT
  A Kernel-Based View of Language Model Fine-Tuning https://arxiv.org/abs/2210.05643
  ☆78Updated last year
• hartvigsen-group / composable-interventions
  ☆28Updated 5 months ago
• eric11eca / disco
  Generating diverse counterfactual data for Natural Language Understanding tasks using Large Language Models (LLMs). The generator support…
  ☆37Updated 2 years ago
• jzbjyb / ReAtt
  Retrieval as Attention
  ☆83Updated 2 years ago
• allenai / peS2o
  Pretraining Efficiently on S2ORC!
  ☆165Updated 9 months ago
• joeljang / ELM
  [ICML 2023] Exploring the Benefits of Training Expert Language Models over Instruction Tuning
  ☆99Updated 2 years ago
• mandyyyyii / scibench
  ☆125Updated last year
• Xianjun-Yang / DNA-GPT
  Offiical codes for DNA-GPT (ICLR 2024)
  ☆50Updated last year
• Mihir3009 / In-BoXBART
  In-BoXBART: Get Instructions into Biomedical Multi-task Learning
  ☆14Updated 2 years ago
• microsoft / augmented-interpretable-models
  Interpretable and efficient predictors using pre-trained language models. Scikit-learn compatible.
  ☆42Updated 5 months ago
• THUDM / SciGLM
  SciGLM: Training Scientific Language Models with Self-Reflective Instruction Annotation and Tuning (NeurIPS D&B Track 2024)
  ☆79Updated last year
• ylsung / vl-merging
  PyTorch codes for the paper "An Empirical Study of Multimodal Model Merging"
  ☆37Updated last year
• archiki / ReCEval
  Supporting code for ReCEval paper
  ☆29Updated 10 months ago
• felixzli / synthetic_pretraining
  ☆39Updated 3 years ago
• abhika-m / FAVA
  ☆73Updated last year
• csitfun / LogiCoT
  the instructions and demonstrations for building a formal logical reasoning capable GLM
  ☆54Updated 11 months ago
• nkandpa2 / long_tail_knowledge
  Repo for the paper "Large Language Models Struggle to Learn Long-Tail Knowledge"
  ☆77Updated 2 years ago
• feyzaakyurek / rl4f
  Code for RL4F: Generating Natural Language Feedback with Reinforcement Learning for Repairing Model Outputs. ACL 2023.
  ☆64Updated 8 months ago
• frankaging / Causal-Distill
  The Codebase for Causal Distillation for Language Models (NAACL '22)
  ☆25Updated 3 years ago
• JeremyAlain / imitation_learning_from_language_feedback
  This repository contains some of the code used in the paper "Training Language Models with Langauge Feedback at Scale"
  ☆27Updated 2 years ago
• EagleW / Scientific-Inspiration-Machines-Optimized-for-Novelty
  Official implementation of the ACL 2024: Scientific Inspiration Machines Optimized for Novelty
  ☆84Updated last year
• bpwu1 / confidence-regulation-neurons
  Confidence Regulation Neurons in Language Models (NeurIPS 2024)
  ☆10Updated 6 months ago
• pietrolesci / memorisation-profiles
  This is the official implementation for our ACL 2024 paper: "Causal Estimation of Memorisation Profiles".
  ☆23Updated 4 months ago
• princeton-nlp / WhatICLLearns
  [ACL 2023 Findings] What In-Context Learning “Learns” In-Context: Disentangling Task Recognition and Task Learning
  ☆21Updated 2 years ago