Jellyfish042 / Sudoku-RWKV
☆71Updated this week
Related projects ⓘ
Alternatives and complementary repositories for Sudoku-RWKV
- RWKV-7: Surpassing GPT☆47Updated last week
- A fast RWKV Tokenizer written in Rust☆36Updated 2 months ago
- ☆33Updated 4 months ago
- Fast modular code to create and train cutting edge LLMs☆65Updated 6 months ago
- Normalized Transformer (nGPT)☆94Updated this week
- RWKV in nanoGPT style☆178Updated 5 months ago
- Fast approximate inference on a single GPU with sparsity aware offloading☆38Updated 10 months ago
- ☆44Updated 4 months ago
- Evaluating LLMs with Dynamic Data☆72Updated 2 weeks ago
- PyTorch implementation of models from the Zamba2 series.☆159Updated this week
- Inference of Mamba models in pure C☆179Updated 8 months ago
- ☆57Updated 11 months ago
- Implementation of the Quiet-STAR paper (https://arxiv.org/pdf/2403.09629.pdf)☆42Updated 3 months ago
- ☆51Updated 7 months ago
- Collection of autoregressive model implementation☆67Updated this week
- An easy-to-understand framework for LLM samplers that rewind and revise generated tokens☆113Updated 3 weeks ago
- ☆53Updated 5 months ago
- an implementation of Self-Extend, to expand the context window via grouped attention☆118Updated 10 months ago
- Gpu benchmark☆43Updated last month
- Video+code lecture on building nanoGPT from scratch☆64Updated 5 months ago
- Tree Attention: Topology-aware Decoding for Long-Context Attention on GPU clusters☆104Updated 2 months ago
- A repository for research on medium sized language models.☆74Updated 6 months ago
- A byte-level decoder architecture that matches the performance of tokenized Transformers.☆59Updated 7 months ago
- XVERSE-MoE-A36B: A multilingual large language model developed by XVERSE Technology Inc.☆36Updated 2 months ago
- A pipeline for LLM knowledge distillation☆78Updated 3 months ago
- A single repo with all scripts and utils to train / fine-tune the Mamba model with or without FIM☆50Updated 7 months ago
- My Implementation of Q-Sparse: All Large Language Models can be Fully Sparsely-Activated☆30Updated 3 months ago
- ☆118Updated 3 months ago
- ☆28Updated 5 months ago
- This is the official repository for Inheritune.☆105Updated last month