BlinkDL / fast.c
Prepare for DeekSeek R1 inference: Benchmark CPU, DRAM, SSD, iGPU, GPU, ... with efficient code.
☆70Updated last month
Alternatives and similar repositories for fast.c:
Users that are interested in fast.c are comparing it to the libraries listed below
- RWKV-7: Surpassing GPT☆82Updated 4 months ago
- ☆47Updated this week
- Tree Attention: Topology-aware Decoding for Long-Context Attention on GPU clusters☆125Updated 3 months ago
- Fast modular code to create and train cutting edge LLMs☆66Updated 10 months ago
- https://x.com/BlinkDL_AI/status/1884768989743882276☆27Updated last month
- tinygrad port of the RWKV large language model.☆44Updated 2 weeks ago
- QuIP quantization☆52Updated last year
- A large-scale RWKV v6, v7(World, ARWKV, PRWKV) inference. Capable of inference by combining multiple states(Pseudo MoE). Easy to deploy o…☆33Updated this week
- RWKV, in easy to read code☆71Updated 3 months ago
- My Implementation of Q-Sparse: All Large Language Models can be Fully Sparsely-Activated☆31Updated 7 months ago
- ☆131Updated 4 months ago
- Inference of Mamba models in pure C☆186Updated last year
- An efficent implementation of the method proposed in "The Era of 1-bit LLMs"☆154Updated 5 months ago
- A toolkit for fine-tuning, inferencing, and evaluating GreenBitAI's LLMs.☆79Updated last week
- ☆32Updated this week
- EvaByte: Efficient Byte-level Language Models at Scale☆85Updated this week
- ☆49Updated last year
- A repository for research on medium sized language models.☆76Updated 10 months ago
- Token Omission Via Attention☆124Updated 5 months ago
- FlexAttention w/ FlashAttention3 Support☆26Updated 5 months ago
- Repo for "LoLCATs: On Low-Rank Linearizing of Large Language Models"☆226Updated last month
- Make triton easier☆47Updated 9 months ago
- KV cache compression for high-throughput LLM inference☆117Updated last month
- Experiments with BitNet inference on CPU☆53Updated 11 months ago
- A specialized RWKV-7 model for Othello(a.k.a. Reversi) that predicts legal moves, evaluates positions, and performs in-context search. It…☆39Updated 2 months ago
- ☆91Updated 2 months ago
- ☆46Updated 8 months ago
- ☆112Updated 2 months ago
- RWKV in nanoGPT style☆187Updated 9 months ago
- Fine-tunes a student LLM using teacher feedback for improved reasoning and answer quality. Implements GRPO with teacher-provided evaluati…☆39Updated 3 weeks ago