Decentralised-AI / LFM-Liquid-AI-Liquid-Foundation-Models
An open source implementation of LFMs from Liquid AI: Liquid Foundation Models
☆86Updated 5 months ago
Alternatives and similar repositories for LFM-Liquid-AI-Liquid-Foundation-Models:
Users that are interested in LFM-Liquid-AI-Liquid-Foundation-Models are comparing it to the libraries listed below
- An open source implementation of LFMs from Liquid AI: Liquid Foundation Models☆153Updated 3 weeks ago
- A single repo with all scripts and utils to train / fine-tune the Mamba model with or without FIM☆52Updated 10 months ago
- ☆171Updated 2 months ago
- PyTorch Implementation of Jamba: "Jamba: A Hybrid Transformer-Mamba Language Model"☆158Updated last month
- Source code of "How to Correctly do Semantic Backpropagation on Language-based Agentic Systems" 🤖☆62Updated 2 months ago
- Code for ExploreTom☆76Updated 2 months ago
- PyTorch implementation of models from the Zamba2 series.☆177Updated last month
- Q-GaLore: Quantized GaLore with INT4 Projection and Layer-Adaptive Low-Rank Gradients.☆195Updated 7 months ago
- Block Transformer: Global-to-Local Language Modeling for Fast Inference (NeurIPS 2024)☆149Updated 2 months ago
- The simplest, fastest repository for training/finetuning medium-sized xLSTMs.☆40Updated 9 months ago
- ☆181Updated this week
- working implimention of deepseek MLA☆35Updated last month
- Training small GPT-2 style models using Kolmogorov-Arnold networks.☆114Updated 9 months ago
- Official repository for the paper "NeuZip: Memory-Efficient Training and Inference with Dynamic Compression of Neural Networks". This rep…☆54Updated 4 months ago
- Tree Attention: Topology-aware Decoding for Long-Context Attention on GPU clusters☆117Updated 3 months ago
- Collection of autoregressive model implementation☆81Updated 2 weeks ago
- Train, tune, and infer Bamba model☆86Updated last month
- ☆100Updated 2 months ago
- A framework to study AI models in Reasoning, Alignment, and use of Memory (RAM).☆204Updated last week
- Normalized Transformer (nGPT)☆156Updated 3 months ago
- Code repository for Black Mamba☆239Updated last year
- RWKV-7: Surpassing GPT☆79Updated 3 months ago
- A easy, reliable, fluid template for python packages complete with docs, testing suites, readme's, github workflows, linting and much muc…☆162Updated last month
- Set of scripts to finetune LLMs☆36Updated 11 months ago
- Preference-based Recursive Language Modeling for Exploratory Optimization of Reasoning☆119Updated last week
- ☆125Updated 6 months ago