LAION-AI / Conditional-Pretraining-of-Large-Language-Models

Related projects ⓘ

Alternatives and complementary repositories for Conditional-Pretraining-of-Large-Language-Models

• huggingface / docmatix
  A huge dataset for Document Visual Question Answering
  ☆14Updated 3 months ago
• rwightman / imagenet-12k
  ImageNet-12k subset of ImageNet-21k (fall11)
  ☆20Updated last year
• lucidrains / rela-transformer
  Implementation of a Transformer using ReLA (Rectified Linear Attention) from https://arxiv.org/abs/2104.07012
  ☆49Updated 2 years ago
• ahennequ / pytorch-custom-mma
  ☆29Updated 2 years ago
• juvi21 / CoPE-cuda
  Contextual Position Encoding but with some custom CUDA Kernels https://arxiv.org/abs/2405.18719
  ☆20Updated 5 months ago
• RobertCsordas / linear_layer_as_attention
  The official repository for our paper "The Dual Form of Neural Networks Revisited: Connecting Test Time Predictions to Training Patterns …
  ☆16Updated last year
• Optimization-AI / fast_clip
  ☆19Updated last month
• kyegomez / Blockwise-Parallel-Transformer
  32 times longer context window than vanilla Transformers and up to 4 times longer than memory efficient Transformers.
  ☆43Updated last year
• yuweihao / LV-BERT
  LV-BERT: Exploiting Layer Variety for BERT (Findings of ACL 2021)
  ☆18Updated last year
• locuslab / scaling_laws_data_filtering
  ☆64Updated 7 months ago
• mlfoundations / VisIT-Bench
  ☆45Updated last year
• shizhediao / DaVinci
  Source code for the paper "Prefix Language Models are Unified Modal Learners"
  ☆43Updated last year
• shreyansh26 / Attention-Mask-Patterns
  Using FlexAttention to compute attention with different masking patterns
  ☆40Updated 2 months ago
• kakaobrain / coyo-vit
  ViT trained on COYO-Labeled-300M dataset
  ☆29Updated 2 years ago
• yonatanbitton / data_efficient_masked_language_modeling_for_vision_and_language
  Repository for the paper "Data Efficient Masked Language Modeling for Vision and Language".
  ☆17Updated 3 years ago
• HazyResearch / prefix-linear-attention
  ☆45Updated 4 months ago
• donglixp / ICL_PaperList
  Paper List for In-context Learning 🌷
  ☆20Updated last year
• HYPJUDY / Sparkles
  Sparkles: Unlocking Chats Across Multiple Images for Multimodal Instruction-Following Models
  ☆43Updated 5 months ago
• yikangshen / megablocks
  ☆18Updated 5 months ago
• lucidrains / tableformer-pytorch
  Implementation of TableFormer, Robust Transformer Modeling for Table-Text Encoding, in Pytorch
  ☆36Updated 2 years ago
• OpenGVLab / DiffAgent
  [CVPR 2024] DiffAgent: Fast and Accurate Text-to-Image API Selection with Large Language Model
  ☆16Updated 7 months ago
• simonsanvil / DALL-E-Explained
  Description and applications of OpenAI's paper about DALL-E (2021) and implementation of other (CLIP-guided) zero-shot text-to-image gene…
  ☆30Updated 2 years ago
• yuzhenmao / IceFormer
  Implementation of IceFormer: Accelerated Inference with Long-Sequence Transformers on CPUs (ICLR 2024).
  ☆20Updated 5 months ago
• yale-nlp / refdpo
  ☆15Updated 4 months ago
• zinengtang / Perceiver_VL
  PyTorch code for "Perceiver-VL: Efficient Vision-and-Language Modeling with Iterative Latent Attention" (WACV 2023)
  ☆32Updated last year
• allenai / grit_official
  Official repository for the General Robust Image Task (GRIT) Benchmark
  ☆50Updated last year
• microsoft / GEM
  ☆24Updated 3 years ago
• HubHop / vit-attention-benchmark
  Benchmarking Attention Mechanism in Vision Transformers.
  ☆16Updated 2 years ago