Alternatives and similar repositories for Conditional-Pretraining-of-Large-Language-Models

Users that are interested in Conditional-Pretraining-of-Large-Language-Models are comparing it to the libraries listed below

• rwightman / imagenet-12k
  ImageNet-12k subset of ImageNet-21k (fall11)
  ☆21Updated 2 years ago
• allenai / grit_official
  Official repository for the General Robust Image Task (GRIT) Benchmark
  ☆54Updated 2 years ago
• locuslab / T-MARS
  Code for T-MARS data filtering
  ☆35Updated last year
• HKUNLP / efficient-attention
  [EVA ICLR'23; LARA ICML'22] Efficient attention mechanisms via control variates, random features, and importance sampling
  ☆86Updated 2 years ago
• mlfoundations / dataset2metadata
  ☆26Updated last year
• lucidrains / tableformer-pytorch
  Implementation of TableFormer, Robust Transformer Modeling for Table-Text Encoding, in Pytorch
  ☆39Updated 3 years ago
• facebookresearch / iclmlp
  Experiments for "A Closer Look at In-Context Learning under Distribution Shifts"
  ☆19Updated 2 years ago
• lucidrains / MaMMUT-pytorch
  Implementation of MaMMUT, a simple vision-encoder text-decoder architecture for multimodal tasks from Google, in Pytorch
  ☆103Updated last year
• mlfoundations / patching
  Patching open-vocabulary models by interpolating weights
  ☆91Updated last year
• LAION-AI / laion50BU
  Un-*** 50 billions multimodality dataset
  ☆23Updated 2 years ago
• ylsung / vl-merging
  PyTorch codes for the paper "An Empirical Study of Multimodal Model Merging"
  ☆37Updated last year
• guilk / VLC
  Research code for "Training Vision-Language Transformers from Captions Alone"
  ☆34Updated 3 years ago
• yulonghui / MOCA
  Official implementation of "Continual Learning by Modeling Intra-Class Variation" (MOCA). [TMLR 2023]
  ☆16Updated 2 years ago
• facebookresearch / ViP-MAE
  This is a PyTorch implementation of the paperViP A Differentially Private Foundation Model for Computer Vision
  ☆36Updated 2 years ago
• ctlllll / reward_collapse
  ☆27Updated 2 years ago
• VITA-Group / AsViT
  [ICLR 2022] "As-ViT: Auto-scaling Vision Transformers without Training" by Wuyang Chen, Wei Huang, Xianzhi Du, Xiaodan Song, Zhangyang Wa…
  ☆76Updated 3 years ago
• TencentARC / pi-Tuning
  Official code for "pi-Tuning: Transferring Multimodal Foundation Models with Optimal Multi-task Interpolation", ICML 2023.
  ☆33Updated last year
• ahennequ / pytorch-custom-mma
  ☆29Updated 2 years ago
• OpenGVLab / DiffAgent
  [CVPR 2024] DiffAgent: Fast and Accurate Text-to-Image API Selection with Large Language Model
  ☆17Updated last year
• locuslab / scaling_laws_data_filtering
  ☆64Updated last year
• changlin31 / AutoProg
  (CVPR 2022) Automated Progressive Learning for Efficient Training of Vision Transformers
  ☆25Updated 4 months ago
• mshukor / EvALign-ICL
  [ICLR2024] (EvALign-ICL Benchmark) Beyond Task Performance: Evaluating and Reducing the Flaws of Large Multimodal Models with In-Context …
  ☆22Updated last year
• AllanYangZhou / generative-invariance-transfer
  ☆26Updated 3 years ago
• shizhediao / DaVinci
  Source code for the paper "Prefix Language Models are Unified Modal Learners"
  ☆43Updated 2 years ago
• mlfoundations / VisIT-Bench
  ☆50Updated last year
• OFA-Sys / TouchStone
  Touchstone: Evaluating Vision-Language Models by Language Models
  ☆83Updated last year
• yonatanbitton / data_efficient_masked_language_modeling_for_vision_and_language
  Repository for the paper "Data Efficient Masked Language Modeling for Vision and Language".
  ☆18Updated 3 years ago
• twinkle0331 / LGTM
  [ACL 2023] Code for paper “Tailoring Instructions to Student’s Learning Levels Boosts Knowledge Distillation”(https://arxiv.org/abs/2305.…
  ☆38Updated 2 years ago
• kyegomez / Blockwise-Parallel-Transformer
  32 times longer context window than vanilla Transformers and up to 4 times longer than memory efficient Transformers.
  ☆48Updated 2 years ago
• facebookresearch / DejaVu
  Repository for the paper Do SSL Models Have Déjà Vu? A Case of Unintended Memorization in Self-supervised Learning
  ☆36Updated 2 years ago