jwzhanggy / tinyBIGLinks
tinybig for deep function learning
☆61Updated 6 months ago
Alternatives and similar repositories for tinyBIG
Users that are interested in tinyBIG are comparing it to the libraries listed below
Sorting:
- State Space Models☆71Updated last year
- ☆152Updated last year
- ☆172Updated last week
- ☆95Updated last month
- A More Fair and Comprehensive Comparison between KAN and MLP☆176Updated last year
- ☆87Updated 7 months ago
- Implementation of Switch Transformers from the paper: "Switch Transformers: Scaling to Trillion Parameter Models with Simple and Efficien…☆135Updated 2 months ago
- Time-R1: Framework and resources for endowing LLMs with comprehensive temporal reasoning (understanding, prediction, creative generation)…☆60Updated 6 months ago
- Awesome list of papers that extend Mamba to various applications.☆139Updated 6 months ago
- ☆221Updated 10 months ago
- Implementation of Griffin from the paper: "Griffin: Mixing Gated Linear Recurrences with Local Attention for Efficient Language Models"☆56Updated 2 months ago
- Parameter-Efficient Fine-Tuning for Foundation Models☆104Updated 9 months ago
- ☆252Updated 2 months ago
- [ACL 2025 Main] Multi-Agent System for Science of Science☆118Updated 5 months ago
- A repository for DenseSSMs☆88Updated last year
- ☆77Updated 10 months ago
- Implementation of MoE Mamba from the paper: "MoE-Mamba: Efficient Selective State Space Models with Mixture of Experts" in Pytorch and Ze…☆119Updated 2 months ago
- ☆205Updated 4 months ago
- 🕹️The toy examples of Kolmogorov-Arnold Network (Get Started Quickly)☆75Updated last year
- Official implementation of our ICML 2024 paper "UP2ME: Univariate Pre-training to Multivariate Fine-tuning as a General-purpose Framework…☆35Updated 7 months ago
- The official repository for the Scientific Paper Idea Proposer (SciPIP)☆67Updated 10 months ago
- An open source community implementation of the model from "DIFFERENTIAL TRANSFORMER" paper by Microsoft.☆38Updated last week
- Now, Stronger AI Pushes Frontiers, Stronger Our Shared Future.☆270Updated last month
- LibMOON is a standard and flexible framework to study gradient-based multiobjective optimization.☆120Updated 9 months ago
- [NeurIPS 2025 Spotlight] TPA: Tensor ProducT ATTenTion Transformer (T6) (https://arxiv.org/abs/2501.06425)☆438Updated 2 weeks ago
- ☆13Updated last year
- The official implementation for [NeurIPS2025 Oral] Gated Attention for Large Language Models: Non-linearity, Sparsity, and Attention-Sink…☆728Updated last week
- My implementation of the original transformer model (Vaswani et al.). I've additionally included the playground.py file for visualizing o…☆44Updated last year
- PyTorch implementation of the Differential-Transformer architecture for sequence modeling, specifically tailored as a decoder-only model …☆85Updated last year
- ☆140Updated last year