facebookresearch / GCD

Related projects ⓘ

Alternatives and complementary repositories for GCD

• srush / drop7
  ☆18Updated 6 months ago
• GindaChen / FlexFlashAttention3
  FlexAttention w/ FlashAttention3 Support
  ☆26Updated last month
• EleutherAI / mdl
  Minimum Description Length probing for neural network representations
  ☆16Updated last week
• lianakoleva / no-libtorch-compile
  ☆17Updated 2 weeks ago
• emalach / LinearLM
  Code for the paper: https://arxiv.org/pdf/2309.06979.pdf
  ☆16Updated 3 months ago
• Avmb / inverse_scaling_prize_code_identifier_swap
  Submission to the inverse scaling prize
  ☆23Updated last year
• EleutherAI / rnngineering
  Engineering the state of RNN language models (Mamba, RWKV, etc.)
  ☆32Updated 5 months ago
• Ryu1845 / hyena-jax
  Implementation of Hyena Hierarchy in JAX
  ☆10Updated last year
• NVIDIA / free-threaded-python
  No-GIL Python environment featuring NVIDIA Deep Learning libraries.
  ☆20Updated this week
• RodkinIvan / associative-recurrent-memory-transformer
  [ICML 24 NGSM workshop] Associative Recurrent Memory Transformer implementation and scripts for training and evaluating
  ☆29Updated this week
• google-research / pynsy
  Heavyweight Python dynamic analysis framework
  ☆13Updated 6 months ago
• srush / tangent
  Source-to-Source Debuggable Derivatives in Pure Python
  ☆14Updated 9 months ago
• facebookresearch / loop_nest
  Loop Nest - Linear algebra compiler and code generator.
  ☆22Updated 2 years ago
• alexzhang13 / Triton-Puzzles-Solutions
  Personal solutions to the Triton Puzzles
  ☆15Updated 3 months ago
• srush / triton-autodiff
  Experiment of using Tangent to autodiff triton
  ☆71Updated 9 months ago
• Doraemonzzz / hgru2-pytorch
  ☆21Updated last month
• HazyResearch / embroid
  Embroid: Unsupervised Prediction Smoothing Can Improve Few-Shot Classification
  ☆11Updated last year
• Doraemonzzz / Awesome-Triton-Resources
  Awesome Triton Resources
  ☆18Updated 3 weeks ago
• FrancescoSaverioZuppichini / pytorch-2.0-benchmark
  Benchmarking PyTorch 2.0 different models
  ☆21Updated last year
• ethansmith2000 / TransformerExperiments
  ☆18Updated last month
• lucidrains / quartic-transformer
  Exploring an idea where one forgets about efficiency and carries out attention across each edge of the nodes (tokens)
  ☆43Updated last month
• amirzandieh / HyperAttention
  Triton Implementation of HyperAttention Algorithm
  ☆46Updated 10 months ago
• prateeky2806 / ComPEFT
  ☆25Updated 11 months ago
• Edward-Sun / gpt-accelera
  Simple and efficient pytorch-native transformer training and inference (batched)
  ☆61Updated 7 months ago
• lucaslingle / mu_transformer
  Transformer with Mu-Parameterization, implemented in Jax/Flax. Supports FSDP on TPU pods.
  ☆29Updated last week
• gordicaleksa / OpenGemini
  Effort to open-source 10.5 trillion parameter Gemini model.
  ☆17Updated 11 months ago
• recursal / GoldFinch-paper
  GoldFinch and other hybrid transformer components
  ☆39Updated 3 months ago
• srush / anynp
  Proof-of-concept of global switching between numpy/jax/pytorch in a library.
  ☆18Updated 4 months ago
• yixiaoer / tpu-training-example
  ☆13Updated 4 months ago