Alternatives and similar repositories for attention-graph

Users that are interested in attention-graph are comparing it to the libraries listed below

• xjdr-alt / llmri
  look how they massacred my boy
  ☆64Updated 10 months ago
• doomslide / hyperobject
  Plotting (entropy, varentropy) for small LMs
  ☆98Updated 3 months ago
• xjdr-alt / simple_transformer
  Simple Transformer in Jax
  ☆139Updated last year
• SinatrasC / entropix-smollm
  smolLM with Entropix sampler on pytorch
  ☆150Updated 9 months ago
• N8python / n8loom
  A tree-based prefix cache library that allows rapid creation of looms: hierarchal branching pathways of LLM generations.
  ☆73Updated 6 months ago
• samefarrar / entropix_mlx
  Modify Entropy Based Sampling to work with Mac Silicon via MLX
  ☆49Updated 9 months ago
• xjdr-alt / entropix-local
  smol models are fun too
  ☆93Updated 9 months ago
• smolorg / smoltropix
  MLX port for xjdr's entropix sampler (mimics jax implementation)
  ☆63Updated 9 months ago
• doomslide / autoloom
  Approximating the joint distribution of language models via MCTS
  ☆21Updated 9 months ago
• vgel / logitloom
  explore token trajectory trees on instruct and base models
  ☆133Updated 2 months ago
• PrimeIntellect-ai / pi-quant
  SIMD quantization kernels
  ☆79Updated 2 weeks ago
• JoeLi12345 / nGPT
  an open source reproduction of NVIDIA's nGPT (Normalized Transformer with Representation Learning on the Hypersphere)
  ☆105Updated 5 months ago
• xjdr-alt / muzero_sketch
  ☆39Updated last year
• NeoVertex1 / ComplexTensor
  ComplexTensor: Machine Learning By Bridging Classical and Quantum Computation
  ☆77Updated 9 months ago
• jerber / lang-jepa
  ☆118Updated 8 months ago
• JD-P / RetroInstruct
  Synthetic data derived by templating, few shot prompting, transformations on public domain corpora, and monte carlo tree search.
  ☆32Updated 5 months ago
• N8python / mlx-pretrain
  A simple MLX implementation for pretraining LLMs on Apple Silicon.
  ☆84Updated this week
• brendanhogan / picoDeepResearch
  ☆66Updated 3 months ago
• Pleias / Quest-Best-Tokens
  An introduction to LLM Sampling
  ☆79Updated 8 months ago
• haraschax / nograd
  Gradient descent is cool and all, but what if we could delete it?
  ☆104Updated 2 weeks ago
• KempnerInstitute / traveling-waves-integrate
  Repository to create traveling waves integrate special information through time
  ☆54Updated 2 weeks ago
• JD-P / minihf
  MiniHF is an inference, human preference data collection, and fine-tuning tool for local language models. It is intended to help the user…
  ☆180Updated last month
• VatsaDev / NanoPoor
  NanoGPT-speedrunning for the poor T4 enjoyers
  ☆69Updated 4 months ago
• strangeloopcanon / LLMRank
  PageRank for LLMs
  ☆44Updated 4 months ago
• xjdr-alt / entropix-trainer
  train entropix like a champ!
  ☆20Updated 10 months ago
• kubernetes-bad / reward-composer
  Lego for GRPO
  ☆28Updated 2 months ago
• yacineMTB / just-large-models
  Just large language models. Hackable, with as little abstraction as possible. Done for my own purposes, feel free to rip.
  ☆44Updated last year
• aidanmclaughlin / AidanBench
  Aidan Bench attempts to measure <big_model_smell> in LLMs.
  ☆310Updated 2 months ago
• nano-R1 / resources
  Compiling useful links, papers, benchmarks, ideas, etc.
  ☆45Updated 5 months ago
• SinatrasC / entropix
  Entropy Based Sampling and Parallel CoT Decoding
  ☆17Updated 10 months ago