facebookresearch / Qinco

Related projects ⓘ

Alternatives and complementary repositories for Qinco

• facebookresearch / spdl
  Scalable and Performant Data Loading
  ☆42Updated this week
• teelinsan / parallel-decoding
  Repository of the paper "Accelerating Transformer Inference for Translation via Parallel Decoding"
  ☆108Updated 7 months ago
• tml-epfl / why-weight-decay
  Why Do We Need Weight Decay in Modern Deep Learning? [NeurIPS 2024]
  ☆49Updated last month
• microsoft / ReinMax
  Beyond Straight-Through
  ☆90Updated last year
• bojone / FSQ
  Keras implement of Finite Scalar Quantization
  ☆63Updated last year
• gregorbachmann / scaling_mlps
  ☆50Updated 4 months ago
• lucidrains / autoregressive-linear-attention-cuda
  CUDA implementation of autoregressive linear attention, with all the latest research findings
  ☆43Updated last year
• lucidrains / rvq-vae-gpt
  My attempts at applying Soundstream design on learned tokenization of text and then applying hierarchical attention to text generation
  ☆81Updated 3 weeks ago
• BlinkDL / LinearAttentionArena
  Here we will test various linear attention designs.
  ☆56Updated 6 months ago
• minyoungg / vqtorch
  ☆113Updated 8 months ago
• lucidrains / hourglass-transformer-pytorch
  Implementation of Hourglass Transformer, in Pytorch, from Google and OpenAI
  ☆84Updated 2 years ago
• glassroom / heinsen_attention
  Reference implementation of "Softmax Attention with Constant Cost per Token" (Heinsen, 2024)
  ☆23Updated 5 months ago
• mit-han-lab / patch_conv
  Patch convolution to avoid large GPU memory usage of Conv2D
  ☆79Updated 5 months ago
• kylehkhsu / latent_quantization
  ☆32Updated 9 months ago
• lsj2408 / URPE
  [NeurIPS 2022] Your Transformer May Not be as Powerful as You Expect (official implementation)
  ☆33Updated last year
• guillaumeBellec / multitask
  ☆22Updated 2 weeks ago
• shikaiqiu / compute-better-spent
  ☆46Updated last month
• lucidrains / self-reasoning-tokens-pytorch
  Exploration into the proposed "Self Reasoning Tokens" by Felipe Bonetto
  ☆53Updated 5 months ago
• apple / ml-agm
  ☆42Updated 6 months ago
• TencentARC / BEBR
  Official code for "Binary embedding based retrieval at Tencent"
  ☆42Updated 8 months ago
• google-research / diffstride
  TF/Keras code for DiffStride, a pooling layer with learnable strides.
  ☆124Updated 2 years ago
• mgmalek / efficient_cross_entropy
  ☆76Updated 5 months ago
• kyegomez / Blockwise-Parallel-Transformer
  32 times longer context window than vanilla Transformers and up to 4 times longer than memory efficient Transformers.
  ☆42Updated last year
• igul222 / plaid
  ☆75Updated last year
• RobertCsordas / linear_layer_as_attention
  The official repository for our paper "The Dual Form of Neural Networks Revisited: Connecting Test Time Predictions to Training Patterns …
  ☆16Updated 11 months ago
• lucidrains / taylor-series-linear-attention
  Explorations into the recently proposed Taylor Series Linear Attention
  ☆89Updated 2 months ago
• ldery / Bonsai
  Code for "Everybody Prune Now: Structured Pruning of LLMs with only Forward Passes"
  ☆28Updated 7 months ago
• lucidrains / RQ-Transformer
  Implementation of RQ Transformer, proposed in the paper "Autoregressive Image Generation using Residual Quantization"
  ☆94Updated 2 years ago
• kuleshov-group / awesome-discrete-diffusion-models
  A curated list for awesome discrete diffusion models resources.
  ☆61Updated this week
• gle-bellier / discrete-fm
  Educational implementation of the Discrete Flow Matching paper
  ☆48Updated 2 months ago