vcskaushik / LLMzipLinks
☆60Updated 8 months ago
Alternatives and similar repositories for LLMzip
Users that are interested in LLMzip are comparing it to the libraries listed below
Sorting:
- Token Omission Via Attention☆128Updated 11 months ago
- ☆51Updated last year
- RWKV-7: Surpassing GPT☆95Updated 10 months ago
- Tree Attention: Topology-aware Decoding for Long-Context Attention on GPU clusters☆129Updated 9 months ago
- Pytorch implementation of the PEER block from the paper, Mixture of A Million Experts, by Xu Owen He at Deepmind☆128Updated last year
- An open source replication of the stawberry method that leverages Monte Carlo Search with PPO and or DPO☆29Updated this week
- Repo for "LoLCATs: On Low-Rank Linearizing of Large Language Models"☆246Updated 7 months ago
- Samples of good AI generated CUDA kernels☆90Updated 3 months ago
- GoldFinch and other hybrid transformer components☆45Updated last year
- ☆154Updated last year
- Simple high-throughput inference library☆128Updated 4 months ago
- ☆146Updated 10 months ago
- QuIP quantization☆59Updated last year
- Official repository for the paper "NeuZip: Memory-Efficient Training and Inference with Dynamic Compression of Neural Networks". This rep…☆60Updated 10 months ago
- ☆85Updated last year
- OpenCoconut implements a latent reasoning paradigm where we generate thoughts before decoding.☆172Updated 8 months ago
- ☆46Updated last year
- https://x.com/BlinkDL_AI/status/1884768989743882276☆28Updated 4 months ago
- ☆64Updated 6 months ago
- [ICML 2023] "Outline, Then Details: Syntactically Guided Coarse-To-Fine Code Generation", Wenqing Zheng, S P Sharan, Ajay Kumar Jaiswal, …☆41Updated last year
- RWKV in nanoGPT style☆193Updated last year
- A single repo with all scripts and utils to train / fine-tune the Mamba model with or without FIM☆59Updated last year
- DeMo: Decoupled Momentum Optimization☆190Updated 9 months ago
- Normalized Transformer (nGPT)☆190Updated 10 months ago
- Implementation of Mind Evolution, Evolving Deeper LLM Thinking, from Deepmind☆56Updated 3 months ago
- PyTorch implementation of models from the Zamba2 series.☆185Updated 8 months ago
- Landing repository for the paper "Softpick: No Attention Sink, No Massive Activations with Rectified Softmax"☆84Updated 2 weeks ago
- Explorations into the proposal from the paper "Grokfast, Accelerated Grokking by Amplifying Slow Gradients"☆101Updated 9 months ago
- ☆102Updated 2 months ago
- Storing long contexts in tiny caches with self-study☆190Updated last week