Alternatives and similar repositories for NSA-Test

Users that are interested in NSA-Test are comparing it to the libraries listed below

• Noumena-Network / nmoe
  MoE training for Me and You and maybe other people
  ☆335Updated last month
• HazyResearch / cartridges
  Storing long contexts in tiny caches with self-study
  ☆236Updated 2 months ago
• PrimeIntellect-ai / pi-quant
  SIMD quantization kernels
  ☆94Updated 5 months ago
• RiddleHe / llm-interp
  A collection of lightweight interpretability scripts to understand how LLMs think
  ☆89Updated 2 weeks ago
• tokenbender / avataRL
  rl from zero pretrain, can it be done? yes.
  ☆286Updated 4 months ago
• PrimeIntellect-ai / pccl
  PCCL (Prime Collective Communications Library) implements fault tolerant collective communications over IP
  ☆141Updated 4 months ago
• facebookresearch / llm-speedrunner
  The Automated LLM Speedrunning Benchmark measures how well LLM agents can reproduce previous innovations and discover new ones in languag…
  ☆128Updated 4 months ago
• xjdr-alt / llmri
  look how they massacred my boy
  ☆63Updated last year
• SinatrasC / entropix
  Entropy Based Sampling and Parallel CoT Decoding
  ☆17Updated last year
• SinatrasC / entropix-smollm
  smolLM with Entropix sampler on pytorch
  ☆149Updated last year
• JoeLi12345 / nGPT
  an open source reproduction of NVIDIA's nGPT (Normalized Transformer with Representation Learning on the Hypersphere)
  ☆110Updated 11 months ago
• brendanhogan / picoDeepResearch
  ☆67Updated 8 months ago
• TextArena / UnstableBaselines
  ☆118Updated 2 weeks ago
• VatsaDev / NanoPoor
  NanoGPT-speedrunning for the poor T4 enjoyers
  ☆73Updated 9 months ago
• s-smits / grpo-optuna
  Optimizing Causal LMs through GRPO with weighted reward functions and automated hyperparameter tuning using Optuna
  ☆59Updated 3 months ago
• Zyphra / tree_attention
  Tree Attention: Topology-aware Decoding for Long-Context Attention on GPU clusters
  ☆131Updated last year
• xjdr-alt / muzero_sketch
  ☆40Updated last year
• arcee-ai / pybubble
  ☆73Updated last week
• PrimeIntellect-ai / genesys
  ☆137Updated 10 months ago
• microsoft / ArchScale
  Simple & Scalable Pretraining for Neural Architecture Research
  ☆307Updated 2 months ago
• xjdr-alt / simple_transformer
  Simple Transformer in Jax
  ☆142Updated last year
• doomslide / hyperobject
  Plotting (entropy, varentropy) for small LMs
  ☆99Updated 8 months ago
• HazyResearch / train-tk
  train with kittens!
  ☆63Updated last year
• xjdr-alt / entropix-trainer
  train entropix like a champ!
  ☆20Updated last year
• N8python / mlx-pretrain
  A simple MLX implementation for pretraining LLMs on Apple Silicon.
  ☆85Updated 5 months ago
• magicproduct / hash-hop
  Long context evaluation for large language models
  ☆226Updated 11 months ago
• casper-hansen / OpenCoconut
  OpenCoconut implements a latent reasoning paradigm where we generate thoughts before decoding.
  ☆175Updated last year
• cloneofsimo / ptx-tutorial-by-aislop
  PTX-Tutorial Written Purely By AIs (Deep Research of Openai and Claude 3.7)
  ☆66Updated 10 months ago
• tilde-research / MoMoE-impl
  Memory optimized Mixture of Experts
  ☆73Updated 6 months ago
• bloc97 / DeMo
  DeMo: Decoupled Momentum Optimization
  ☆198Updated last year