Alternatives and similar repositories for uncheatable_eval

Users that are interested in uncheatable_eval are comparing it to the libraries listed below

• JL-er / RWKV-PEFT
  ☆121Updated this week
• BlinkDL / modded-nanogpt-rwkv
  RWKV-7: Surpassing GPT
  ☆84Updated 5 months ago
• SmerkyG / RWKV_Explained
  RWKV, in easy to read code
  ☆72Updated last month
• wuhy68 / Parameter-Efficient-MoE
  Parameter-Efficient Sparsity Crafting From Dense to Mixture-of-Experts for Instruction Tuning on General Tasks
  ☆143Updated 7 months ago
• SmerkyG / gptcore
  Fast modular code to create and train cutting edge LLMs
  ☆66Updated last year
• GAIR-NLP / Entropy-ABF
  Official implementation for 'Extending LLMs’ Context Window with 100 Samples'
  ☆77Updated last year
• RWKV / RWKV-infctx-trainer
  RWKV infctx trainer, for training arbitary context sizes, to 10k and beyond!
  ☆148Updated 9 months ago
• yynil / RWKVinLLAMA
  ☆18Updated 4 months ago
• dwzhu-pku / PoSE
  Positional Skip-wise Training for Efficient Context Window Extension of LLMs to Extremely Length (ICLR 2024)
  ☆205Updated 11 months ago
• kyegomez / Infini-attention
  Implementation of the paper: "Leave No Context Behind: Efficient Infinite Context Transformers with Infini-attention" from Google in pyTO…
  ☆55Updated 3 weeks ago
• kernelmachine / cbtm
  Code repository for the c-BTM paper
  ☆106Updated last year
• wdlctc / mini-s
  ☆51Updated 6 months ago
• OpenMOSE / RWKV-Infer
  A large-scale RWKV v6, v7(World, ARWKV, PRWKV) inference. Capable of inference by combining multiple states(Pseudo MoE). Easy to deploy o…
  ☆35Updated last week
• qwopqwop200 / gptqlora
  GPTQLoRA: Efficient Finetuning of Quantized LLMs with GPTQ
  ☆103Updated last year
• dust-tt / llama-ssp
  Experiments on speculative sampling with Llama models
  ☆126Updated last year
• hkust-nlp / llm-compression-intelligence
  Official github repo for the paper "Compression Represents Intelligence Linearly" [COLM 2024]
  ☆134Updated 7 months ago
• nanowell / Q-Sparse-LLM
  My Implementation of Q-Sparse: All Large Language Models can be Fully Sparsely-Activated
  ☆32Updated 9 months ago
• BlinkDL / nanoRWKV
  RWKV in nanoGPT style
  ☆189Updated 11 months ago
• imoneoi / multipack_sampler
  Multipack distributed sampler for fast padding-free training of LLMs
  ☆189Updated 9 months ago
• chu-tianxiang / QuIP-for-all
  QuIP quantization
  ☆52Updated last year
• NolanoOrg / sparse_quant_llms
  SparseGPT + GPTQ Compression of LLMs like LLaMa, OPT, Pythia
  ☆41Updated 2 years ago
• TRI-ML / linear_open_lm
  A repository for research on medium sized language models.
  ☆76Updated 11 months ago
• whyNLP / LCKV
  Layer-Condensed KV cache w/ 10 times larger batch size, fewer params and less computation. Dramatic speed up with better task performance…
  ☆149Updated last month
• BBuf / RWKV-World-HF-Tokenizer
  ☆34Updated 9 months ago
• siyan-zhao / prepacking
  The source code of our work "Prepacking: A Simple Method for Fast Prefilling and Increased Throughput in Large Language Models" [AISTATS …
  ☆59Updated 7 months ago
• Digitous / LLM-SLERP-Merge
  Spherical Merge Pytorch/HF format Language Models with minimal feature loss.
  ☆121Updated last year
• Infini-AI-Lab / gsm_infinite
  ☆45Updated 2 months ago
• OpenMOSE / RWKV-LM-RLHF
  Reinforcement Learning Toolkit for RWKV.(v6,v7,ARWKV) Distillation,SFT,RLHF(DPO,ORPO), infinite context training, Aligning. Exploring the…
  ☆40Updated last week
• PiotrNawrot / nano-sparse-attention
  The simplest implementation of recent Sparse Attention patterns for efficient LLM inference.
  ☆60Updated 3 months ago
• YuchuanTian / RethinkTinyLM
  [ICML'24] The official implementation of “Rethinking Optimization and Architecture for Tiny Language Models”
  ☆121Updated 4 months ago