Alternatives and similar repositories for tinyBIG:

Users that are interested in tinyBIG are comparing it to the libraries listed below

• Chaos96 / fourierft
  ☆142Updated 6 months ago
• kyegomez / Griffin
  Implementation of Griffin from the paper: "Griffin: Mixing Gated Linear Recurrences with Local Attention for Efficient Language Models"
  ☆51Updated last month
• cheng-haha / KANs
  🕹️The toy examples of Kolmogorov-Arnold Network (Get Started Quickly)
  ☆75Updated 10 months ago
• badripatro / mamba360
  State Space Models
  ☆66Updated 10 months ago
• daxin007 / ARMD
  [AAAI 2025] Official Implementation of "Auto-Regressive Moving Diffusion Models for Time Series Forecasting"
  ☆60Updated last month
• qitianwu / DIFFormer
  The official implementation for ICLR23 spotlight paper "DIFFormer: Scalable (Graph) Transformers Induced by Energy Constrained Diffusion"
  ☆295Updated this week
• kyegomez / SwitchTransformers
  Implementation of Switch Transformers from the paper: "Switch Transformers: Scaling to Trillion Parameter Models with Simple and Efficien…
  ☆87Updated last month
• miniHuiHui / awesome-high-order-neural-network
  ☆43Updated 5 months ago
• pengzhangzhi / Awesome-Mamba
  Awesome list of papers that extend Mamba to various applications.
  ☆132Updated 2 months ago
• open-sciencelab / Virtual-Scientists
  Multi-Agent System for Science of Science
  ☆69Updated 3 weeks ago
• WailordHe / DenseSSM
  A repository for DenseSSMs
  ☆87Updated 11 months ago
• YihongDong / FAN
  ☆209Updated last week
• Jerry-Master / KAN-benchmarking
  Benchmark for efficiency in memory and time of different KAN implementations.
  ☆119Updated 6 months ago
• jlamprou / Fourier-Analysis-Networks-FAN
  A pytorch implementation of Fourier Analysis Networks (FAN)
  ☆31Updated 5 months ago
• kyegomez / Jamba
  PyTorch Implementation of Jamba: "Jamba: A Hybrid Transformer-Mamba Language Model"
  ☆159Updated last month
• vulus98 / Rethinking-attention
  My implementation of the original transformer model (Vaswani et al.). I've additionally included the playground.py file for visualizing o…
  ☆43Updated 3 months ago
• qhduan / cn-chat-arxiv
  ☆161Updated this week
• MadryLab / modelcomponents
  Decomposing and Editing Predictions by Modeling Model Computation
  ☆138Updated 9 months ago
• badripatro / simba
  Simba
  ☆202Updated 11 months ago
• transformer-vq / transformer_vq
  ☆188Updated last year
• akaashdash / kansformers
  ☆127Updated 10 months ago
• chr26195 / PMLP
  This is the official code repository for "Graph Neural Networks are Inherently Good Generalizers: Insights by Bridging GNNs and MLPs", wh…
  ☆87Updated 9 months ago
• cheerss / SciPIP
  The official repository for the Scientific Paper Idea Proposer (SciPIP)
  ☆61Updated 2 weeks ago
• mindspore-lab / models
  ☆41Updated 2 weeks ago
• waltonfuture / Diff-eRank
  [NeurIPS 2024] A Novel Rank-Based Metric for Evaluating Large Language Models
  ☆41Updated 3 months ago
• kyegomez / DifferentialTransformer
  An open source community implementation of the model from "DIFFERENTIAL TRANSFORMER" paper by Microsoft.
  ☆23Updated last month
• kyegomez / MambaTransformer
  Integrating Mamba/SSMs with Transformer for Enhanced Long Context and High-Quality Sequence Modeling
  ☆188Updated last month
• OpenNLPLab / lightning-attention
  Lightning Attention-2: A Free Lunch for Handling Unlimited Sequence Lengths in Large Language Models
  ☆265Updated 2 weeks ago
• syassami / FourierKAN-mnist
  MNIST example using Kolmogorov-Arnold Networks
  ☆27Updated 10 months ago
• nanowell / Differential-Transformer-PyTorch
  PyTorch implementation of the Differential-Transformer architecture for sequence modeling, specifically tailored as a decoder-only model …
  ☆55Updated 4 months ago