Alternatives and similar repositories for tinyBIG:

Users that are interested in tinyBIG are comparing it to the libraries listed below

• badripatro / mamba360
  State Space Models
  ☆67Updated 10 months ago
• cheng-haha / KANs
  🕹️The toy examples of Kolmogorov-Arnold Network (Get Started Quickly)
  ☆75Updated 10 months ago
• Chaos96 / fourierft
  ☆142Updated 6 months ago
• badripatro / simba
  Simba
  ☆203Updated last year
• kyegomez / Griffin
  Implementation of Griffin from the paper: "Griffin: Mixing Gated Linear Recurrences with Local Attention for Efficient Language Models"
  ☆51Updated last month
• kyegomez / SwitchTransformers
  Implementation of Switch Transformers from the paper: "Switch Transformers: Scaling to Trillion Parameter Models with Simple and Efficien…
  ☆89Updated last month
• qhduan / cn-chat-arxiv
  ☆161Updated this week
• jlamprou / Fourier-Analysis-Networks-FAN
  A pytorch implementation of Fourier Analysis Networks (FAN)
  ☆32Updated 5 months ago
• open-sciencelab / Virtual-Scientists
  Multi-Agent System for Science of Science
  ☆69Updated last week
• daxin007 / ARMD
  [AAAI 2025] Official Implementation of "Auto-Regressive Moving Diffusion Models for Time Series Forecasting"
  ☆61Updated last month
• miniHuiHui / awesome-high-order-neural-network
  ☆43Updated 5 months ago
• vulus98 / Rethinking-attention
  My implementation of the original transformer model (Vaswani et al.). I've additionally included the playground.py file for visualizing o…
  ☆43Updated 3 months ago
• cheerss / SciPIP
  The official repository for the Scientific Paper Idea Proposer (SciPIP)
  ☆62Updated 3 weeks ago
• THUMNLab / CurML
  ☆83Updated 5 months ago
• Zhangyanbo / MLP-KAN
  Kolmogorov–Arnold Networks with modified activation (using MLP to represent the activation)
  ☆103Updated 4 months ago
• kyegomez / MoE-Mamba
  Implementation of MoE Mamba from the paper: "MoE-Mamba: Efficient Selective State Space Models with Mixture of Experts" in Pytorch and Ze…
  ☆100Updated last month
• yu-rp / KANbeFair
  A More Fair and Comprehensive Comparison between KAN and MLP
  ☆161Updated 7 months ago
• kyegomez / MambaTransformer
  Integrating Mamba/SSMs with Transformer for Enhanced Long Context and High-Quality Sequence Modeling
  ☆190Updated last month
• WailordHe / DenseSSM
  A repository for DenseSSMs
  ☆87Updated 11 months ago
• xmindflow / Awesome_Mamba
  Computation-Efficient Era: A Comprehensive Survey of State Space Models in Medical Image Analysis
  ☆226Updated last month
• akaashdash / kansformers
  ☆127Updated 10 months ago
• pengzhangzhi / Awesome-Mamba
  Awesome list of papers that extend Mamba to various applications.
  ☆132Updated 3 months ago
• kyegomez / Jamba
  PyTorch Implementation of Jamba: "Jamba: A Hybrid Transformer-Mamba Language Model"
  ☆160Updated last month
• transformer-vq / transformer_vq
  ☆189Updated last year
• Caiyun-AI / DCFormer
  ☆193Updated last month
• liuyixin-louis / arxiv2latex
  Download the source latex code of multiple arXiv paper with one click
  ☆105Updated last year
• nanowell / Differential-Transformer-PyTorch
  PyTorch implementation of the Differential-Transformer architecture for sequence modeling, specifically tailored as a decoder-only model …
  ☆57Updated 4 months ago
• kyegomez / DifferentialTransformer
  An open source community implementation of the model from "DIFFERENTIAL TRANSFORMER" paper by Microsoft.
  ☆24Updated last week
• qitianwu / DIFFormer
  The official implementation for ICLR23 spotlight paper "DIFFormer: Scalable (Graph) Transformers Induced by Energy Constrained Diffusion"
  ☆295Updated 2 weeks ago
• yuanyige / pde-add
  [AAAI 2024] PDE+: Enhancing Generalization via PDE with Adaptive Distributional Diffusion
  ☆22Updated last year