SmerkyG / GoldFinch-paperLinks
GoldFinch and other hybrid transformer components
☆12Updated last month
Alternatives and similar repositories for GoldFinch-paper
Users that are interested in GoldFinch-paper are comparing it to the libraries listed below
Sorting:
- GoldFinch and other hybrid transformer components☆45Updated last year
- https://x.com/BlinkDL_AI/status/1884768989743882276☆28Updated 8 months ago
- ☆12Updated last year
- ☆39Updated 8 months ago
- An open source replication of the stawberry method that leverages Monte Carlo Search with PPO and or DPO☆29Updated last month
- JAX Scalify: end-to-end scaled arithmetics☆17Updated last year
- My Implementation of Q-Sparse: All Large Language Models can be Fully Sparsely-Activated☆33Updated last year
- RWKV-7: Surpassing GPT☆103Updated last year
- Universal Reasoning Model☆113Updated 2 weeks ago
- ☆52Updated last year
- implementation of https://arxiv.org/pdf/2312.09299☆21Updated last year
- An unofficial pytorch implementation of 'Efficient Infinite Context Transformers with Infini-attention'☆54Updated last year
- Here we will test various linear attention designs.☆62Updated last year
- ☆66Updated 9 months ago
- new optimizer☆20Updated last year
- A repository for research on medium sized language models.☆77Updated last year
- A single repo with all scripts and utils to train / fine-tune the Mamba model with or without FIM☆61Updated last year
- EvaByte: Efficient Byte-level Language Models at Scale☆114Updated 8 months ago
- Official Repository for Task-Circuit Quantization☆24Updated 7 months ago
- Parameter-Efficient Sparsity Crafting From Dense to Mixture-of-Experts for Instruction Tuning on General Tasks☆31Updated last year
- ☆39Updated last year
- ☆18Updated last year
- Fork of Flame repo for training of some new stuff in development☆19Updated this week
- Implementation of the Mamba SSM with hf_integration.☆56Updated last year
- ☆178Updated 8 months ago
- A large-scale RWKV v7(World, PRWKV, Hybrid-RWKV) inference. Capable of inference by combining multiple states(Pseudo MoE). Easy to deploy…☆46Updated 2 months ago
- This library supports evaluating disparities in generated image quality, diversity, and consistency between geographic regions.☆20Updated last year
- ☆69Updated 6 months ago
- ☆62Updated 6 months ago
- Implementation of Mind Evolution, Evolving Deeper LLM Thinking, from Deepmind☆57Updated 7 months ago