Alternatives and similar repositories for Conditional-Pretraining-of-Large-Language-Models

Users that are interested in Conditional-Pretraining-of-Large-Language-Models are comparing it to the libraries listed below

• HKUNLP / efficient-attention
  [EVA ICLR'23; LARA ICML'22] Efficient attention mechanisms via control variates, random features, and importance sampling
  ☆87Updated 2 years ago
• LAION-AI / laion50BU
  Un-*** 50 billions multimodality dataset
  ☆23Updated 3 years ago
• ahennequ / pytorch-custom-mma
  ☆29Updated 3 years ago
• rwightman / imagenet-12k
  ImageNet-12k subset of ImageNet-21k (fall11)
  ☆21Updated 2 years ago
• ctlllll / reward_collapse
  ☆26Updated 2 years ago
• locuslab / scaling_laws_data_filtering
  ☆64Updated last year
• facebookresearch / dmae_st
  Directed masked autoencoders
  ☆14Updated this week
• shizhediao / DaVinci
  Source code for the paper "Prefix Language Models are Unified Modal Learners"
  ☆44Updated 2 years ago
• allenai / grit_official
  Official repository for the General Robust Image Task (GRIT) Benchmark
  ☆54Updated 2 years ago
• ylsung / vl-merging
  PyTorch codes for the paper "An Empirical Study of Multimodal Model Merging"
  ☆37Updated 2 years ago
• lucidrains / MaMMUT-pytorch
  Implementation of MaMMUT, a simple vision-encoder text-decoder architecture for multimodal tasks from Google, in Pytorch
  ☆104Updated 2 years ago
• mshukor / EvALign-ICL
  [ICLR2024] (EvALign-ICL Benchmark) Beyond Task Performance: Evaluating and Reducing the Flaws of Large Multimodal Models with In-Context …
  ☆22Updated last year
• CyndxAI / QKNorm
  Code for the paper "Query-Key Normalization for Transformers"
  ☆51Updated 4 years ago
• facebookresearch / DejaVu
  Repository for the paper Do SSL Models Have Déjà Vu? A Case of Unintended Memorization in Self-supervised Learning
  ☆36Updated 2 years ago
• locuslab / T-MARS
  Code for T-MARS data filtering
  ☆35Updated 2 years ago
• allenai / gpv2
  ☆32Updated 3 years ago
• guilk / VLC
  Research code for "Training Vision-Language Transformers from Captions Alone"
  ☆33Updated 3 years ago
• mlfoundations / patching
  Patching open-vocabulary models by interpolating weights
  ☆91Updated 2 years ago
• RobertCsordas / linear_layer_as_attention
  The official repository for our paper "The Dual Form of Neural Networks Revisited: Connecting Test Time Predictions to Training Patterns …
  ☆16Updated 8 months ago
• mlfoundations / VisIT-Bench
  ☆50Updated 2 years ago
• OFA-Sys / TouchStone
  Touchstone: Evaluating Vision-Language Models by Language Models
  ☆83Updated 2 years ago
• twinkle0331 / LGTM
  [ACL 2023] Code for paper “Tailoring Instructions to Student’s Learning Levels Boosts Knowledge Distillation”(https://arxiv.org/abs/2305.…
  ☆38Updated 2 years ago
• yonatanbitton / data_efficient_masked_language_modeling_for_vision_and_language
  Repository for the paper "Data Efficient Masked Language Modeling for Vision and Language".
  ☆18Updated 4 years ago
• kyegomez / Blockwise-Parallel-Transformer
  32 times longer context window than vanilla Transformers and up to 4 times longer than memory efficient Transformers.
  ☆50Updated 2 years ago
• mlfoundations / dataset2metadata
  ☆27Updated last year
• BaohaoLiao / mefts
  [NeurIPS 2023] Make Your Pre-trained Model Reversible: From Parameter to Memory Efficient Fine-Tuning
  ☆33Updated 2 years ago
• AllanYangZhou / generative-invariance-transfer
  ☆26Updated 3 years ago
• ml-jku / semantic-image-text-alignment
  ☆25Updated 2 years ago
• facebookresearch / iclmlp
  Experiments for "A Closer Look at In-Context Learning under Distribution Shifts"
  ☆19Updated 2 years ago
• LAION-AI / General-GPT
  ☆65Updated 2 years ago