Jellyfish042 / Sudoku-RWKV
☆111Updated last month
Alternatives and similar repositories for Sudoku-RWKV:
Users that are interested in Sudoku-RWKV are comparing it to the libraries listed below
- RWKV-7: Surpassing GPT☆71Updated 2 months ago
- Tree Attention: Topology-aware Decoding for Long-Context Attention on GPU clusters☆111Updated last month
- Evaluating LLMs with Dynamic Data☆72Updated 2 months ago
- A specialized RWKV-7 model for Othello(a.k.a. Reversi) that predicts legal moves, evaluates positions, and performs in-context search. It…☆29Updated last week
- Memory layers use a trainable key-value lookup mechanism to add extra parameters to a model without increasing FLOPs. Conceptually, spars…☆277Updated last month
- RWKV in nanoGPT style☆184Updated 7 months ago
- Expert Specialized Fine-Tuning☆167Updated 3 months ago
- OpenCoconut implements a latent reasoning paradigm where we generate thoughts before decoding.☆154Updated this week
- Normalized Transformer (nGPT)☆145Updated 2 months ago
- Fast modular code to create and train cutting edge LLMs☆64Updated 8 months ago
- Implementation of the Quiet-STAR paper (https://arxiv.org/pdf/2403.09629.pdf)☆48Updated 5 months ago
- Inference of Mamba models in pure C☆183Updated 10 months ago
- ☆58Updated 8 months ago
- ☆180Updated this week
- ☆89Updated this week
- PyTorch implementation of models from the Zamba2 series.☆168Updated last month
- An efficent implementation of the method proposed in "The Era of 1-bit LLMs"☆154Updated 3 months ago
- Code for the paper "QMoE: Practical Sub-1-Bit Compression of Trillion-Parameter Models".☆263Updated last year
- ☆69Updated 5 months ago
- My Implementation of Q-Sparse: All Large Language Models can be Fully Sparsely-Activated☆31Updated 5 months ago
- A single repo with all scripts and utils to train / fine-tune the Mamba model with or without FIM☆50Updated 9 months ago
- Token Omission Via Attention☆122Updated 3 months ago
- NanoGPT (124M) quality in 2.67B tokens☆26Updated this week
- ☆97Updated 3 weeks ago
- A pipeline for LLM knowledge distillation☆83Updated 5 months ago
- A repository for research on medium sized language models.☆76Updated 7 months ago
- Beyond Language Models: Byte Models are Digital World Simulators☆316Updated 7 months ago
- ☆60Updated this week
- My fork os allen AI's OLMo for educational purposes.☆30Updated last month
- ☆140Updated 8 months ago