Alternatives and similar repositories for tinyBIG:

Users that are interested in tinyBIG are comparing it to the libraries listed below

• Chaos96 / fourierft
  ☆134Updated 3 months ago
• pengzhangzhi / Awesome-Mamba
  Awesome list of papers that extend Mamba to various applications.
  ☆128Updated 2 months ago
• transformer-vq / transformer_vq
  ☆182Updated last year
• kyegomez / SwitchTransformers
  Implementation of Switch Transformers from the paper: "Switch Transformers: Scaling to Trillion Parameter Models with Simple and Efficien…
  ☆62Updated last month
• badripatro / mamba360
  State Space Models
  ☆64Updated 7 months ago
• miniHuiHui / awesome-high-order-neural-network
  ☆41Updated 2 months ago
• kyegomez / Griffin
  Implementation of Griffin from the paper: "Griffin: Mixing Gated Linear Recurrences with Local Attention for Efficient Language Models"
  ☆51Updated last month
• qhduan / cn-chat-arxiv
  ☆152Updated this week
• cheerss / SciPIP
  The official repository for the Scientific Paper Idea Proposer (SciPIP)
  ☆45Updated last week
• WailordHe / DenseSSM
  A repository for DenseSSMs
  ☆87Updated 8 months ago
• Caiyun-AI / DCFormer
  ☆186Updated this week
• cheng-haha / KANs
  🕹️The toy examples of Kolmogorov-Arnold Network (Get Started Quickly)
  ☆74Updated 7 months ago
• vulus98 / Rethinking-attention
  My implementation of the original transformer model (Vaswani et al.). I've additionally included the playground.py file for visualizing o…
  ☆42Updated this week
• YihongDong / FAN
  ☆158Updated last week
• akaashdash / kansformers
  ☆121Updated 7 months ago
• kyegomez / Jamba
  PyTorch Implementation of Jamba: "Jamba: A Hybrid Transformer-Mamba Language Model"
  ☆149Updated last month
• qitianwu / DIFFormer
  The official implementation for ICLR23 spotlight paper "DIFFormer: Scalable (Graph) Transformers Induced by Energy Constrained Diffusion"
  ☆303Updated 4 months ago
• kyegomez / MambaTransformer
  Integrating Mamba/SSMs with Transformer for Enhanced Long Context and High-Quality Sequence Modeling
  ☆174Updated last month
• erwanplantec / LNDP
  ☆50Updated 2 months ago
• ranpox / openreview-visualization
  OpenReivew Submission Visualization (ICLR 2024/2025)
  ☆145Updated 2 months ago
• open-sciencelab / Social_Science
  Multi-Agent System for Science of Science
  ☆64Updated last week
• withinmiaov / A-Survey-on-Mixture-of-Experts
  The official GitHub page for the survey paper "A Survey on Mixture of Experts".
  ☆162Updated last week
• Jerry-Master / KAN-benchmarking
  Benchmark for efficiency in memory and time of different KAN implementations.
  ☆113Updated 3 months ago
• test-time-training / ttt-lm-jax
  Official JAX implementation of Learning to (Learn at Test Time): RNNs with Expressive Hidden States
  ☆375Updated 4 months ago
• Chongjie-Si / Subspace-Tuning
  A generalized framework for subspace tuning methods in parameter efficient fine-tuning.
  ☆113Updated 3 months ago
• GistNoesis / FusedFourierKAN
  C++ and Cuda ops for fused FourierKAN
  ☆73Updated 7 months ago
• syassami / FourierKAN-mnist
  MNIST example using Kolmogorov-Arnold Networks
  ☆27Updated 7 months ago
• PKU-Alignment / AlignmentSurvey
  AI Alignment: A Comprehensive Survey
  ☆131Updated last year
• nanowell / Differential-Transformer-PyTorch
  PyTorch implementation of the Differential-Transformer architecture for sequence modeling, specifically tailored as a decoder-only model …
  ☆48Updated last month
• OpenNLPLab / lightning-attention
  Lightning Attention-2: A Free Lunch for Handling Unlimited Sequence Lengths in Large Language Models
  ☆189Updated 7 months ago