Alternatives and similar repositories for Conditional-Pretraining-of-Large-Language-Models

Users that are interested in Conditional-Pretraining-of-Large-Language-Models are comparing it to the libraries listed below

• ctlllll / reward_collapse
  ☆27Updated 2 years ago
• HKUNLP / efficient-attention
  [EVA ICLR'23; LARA ICML'22] Efficient attention mechanisms via control variates, random features, and importance sampling
  ☆86Updated 2 years ago
• facebookresearch / dmae_st
  Directed masked autoencoders
  ☆14Updated 2 years ago
• locuslab / scaling_laws_data_filtering
  ☆65Updated last year
• LAION-AI / laion50BU
  Un-*** 50 billions multimodality dataset
  ☆23Updated 2 years ago
• mlfoundations / dataset2metadata
  ☆26Updated last year
• rwightman / imagenet-12k
  ImageNet-12k subset of ImageNet-21k (fall11)
  ☆21Updated 2 years ago
• ylsung / vl-merging
  PyTorch codes for the paper "An Empirical Study of Multimodal Model Merging"
  ☆37Updated last year
• locuslab / T-MARS
  Code for T-MARS data filtering
  ☆35Updated 2 years ago
• mlfoundations / VisIT-Bench
  ☆50Updated last year
• lucidrains / tableformer-pytorch
  Implementation of TableFormer, Robust Transformer Modeling for Table-Text Encoding, in Pytorch
  ☆39Updated 3 years ago
• lucidrains / MaMMUT-pytorch
  Implementation of MaMMUT, a simple vision-encoder text-decoder architecture for multimodal tasks from Google, in Pytorch
  ☆103Updated last year
• tianyu-z / VCR
  Official Repo for the paper: VCR: Visual Caption Restoration. Check arxiv.org/pdf/2406.06462 for details.
  ☆31Updated 6 months ago
• shizhediao / DaVinci
  Source code for the paper "Prefix Language Models are Unified Modal Learners"
  ☆43Updated 2 years ago
• mlfoundations / patching
  Patching open-vocabulary models by interpolating weights
  ☆91Updated last year
• guilk / VLC
  Research code for "Training Vision-Language Transformers from Captions Alone"
  ☆34Updated 3 years ago
• donglixp / ICL_PaperList
  Paper List for In-context Learning 🌷
  ☆20Updated 2 years ago
• CyndxAI / QKNorm
  Code for the paper "Query-Key Normalization for Transformers"
  ☆47Updated 4 years ago
• ahennequ / pytorch-custom-mma
  ☆29Updated 2 years ago
• OFA-Sys / TouchStone
  Touchstone: Evaluating Vision-Language Models by Language Models
  ☆83Updated last year
• allenai / grit_official
  Official repository for the General Robust Image Task (GRIT) Benchmark
  ☆54Updated 2 years ago
• kyegomez / Blockwise-Parallel-Transformer
  32 times longer context window than vanilla Transformers and up to 4 times longer than memory efficient Transformers.
  ☆49Updated 2 years ago
• twinkle0331 / LGTM
  [ACL 2023] Code for paper “Tailoring Instructions to Student’s Learning Levels Boosts Knowledge Distillation”(https://arxiv.org/abs/2305.…
  ☆38Updated 2 years ago
• facebookresearch / iclmlp
  Experiments for "A Closer Look at In-Context Learning under Distribution Shifts"
  ☆19Updated 2 years ago
• RobertCsordas / linear_layer_as_attention
  The official repository for our paper "The Dual Form of Neural Networks Revisited: Connecting Test Time Predictions to Training Patterns …
  ☆16Updated 2 months ago
• VITA-Group / o1-planning
  On The Planning Abilities of OpenAI's o1 Models: Feasibility, Optimality, and Generalizability
  ☆40Updated last month
• facebookresearch / DejaVu
  Repository for the paper Do SSL Models Have Déjà Vu? A Case of Unintended Memorization in Self-supervised Learning
  ☆36Updated 2 years ago
• microsoft / AutoMoE
  AutoMoE: Neural Architecture Search for Efficient Sparsely Activated Transformers
  ☆47Updated 2 years ago
• yulonghui / MOCA
  Official implementation of "Continual Learning by Modeling Intra-Class Variation" (MOCA). [TMLR 2023]
  ☆16Updated 2 years ago
• OpenGVLab / Awesome-LLM4Tool
  A curated list of the papers, repositories, tutorials, and anythings related to the large language models for tools
  ☆68Updated 2 years ago