Jellyfish042 / Sudoku-RWKV
☆120Updated 3 months ago
Alternatives and similar repositories for Sudoku-RWKV:
Users that are interested in Sudoku-RWKV are comparing it to the libraries listed below
- RWKV-7: Surpassing GPT☆79Updated 3 months ago
- RWKV in nanoGPT style☆187Updated 8 months ago
- Evaluating LLMs with Dynamic Data☆75Updated last week
- A specialized RWKV-7 model for Othello(a.k.a. Reversi) that predicts legal moves, evaluates positions, and performs in-context search. It…☆38Updated 3 weeks ago
- Fast modular code to create and train cutting edge LLMs☆65Updated 9 months ago
- Inference of Mamba models in pure C☆183Updated 11 months ago
- Tree Attention: Topology-aware Decoding for Long-Context Attention on GPU clusters☆116Updated 2 months ago
- Normalized Transformer (nGPT)☆152Updated 3 months ago
- Memory layers use a trainable key-value lookup mechanism to add extra parameters to a model without increasing FLOPs. Conceptually, spars…☆297Updated 2 months ago
- OpenCoconut implements a latent reasoning paradigm where we generate thoughts before decoding.☆167Updated last month
- ☆73Updated this week
- Beyond Language Models: Byte Models are Digital World Simulators☆319Updated 8 months ago
- Implementation of the Quiet-STAR paper (https://arxiv.org/pdf/2403.09629.pdf)☆51Updated 6 months ago
- ☆104Updated this week
- ☆58Updated 9 months ago
- ☆52Updated 9 months ago
- A pipeline for LLM knowledge distillation☆91Updated 3 weeks ago
- A repository for research on medium sized language models.☆76Updated 8 months ago
- ☆71Updated 6 months ago
- ☆141Updated 9 months ago
- Token Omission Via Attention☆123Updated 4 months ago
- An easy-to-understand framework for LLM samplers that rewind and revise generated tokens☆130Updated this week
- Experiments on speculative sampling with Llama models☆124Updated last year
- Docker image NVIDIA GH200 machines - optimized for vllm serving and hf trainer finetuning☆35Updated this week
- RWKV infctx trainer, for training arbitary context sizes, to 10k and beyond!☆144Updated 6 months ago