Alternatives and similar repositories for tokasaurus

Users that are interested in tokasaurus are comparing it to the libraries listed below

• valine / training-hot-swap
  Pytorch script hot swap: Change code without unloading your LLM from VRAM
  ☆126Updated 2 months ago
• em-llm / EM-LLM-model
  ☆211Updated 3 months ago
• kolinko / effort
  An implementation of bucketMul LLM inference
  ☆218Updated 11 months ago
• Foreseerr / TScale
  ☆196Updated last month
• codelion / pts
  Pivotal Token Search
  ☆107Updated last month
• mlecauchois / micrograd-cuda
  ☆248Updated last year
• apple / ml-recurrent-drafter
  ☆213Updated 5 months ago
• PaulPauls / llama3_interpretability_sae
  A complete end-to-end pipeline for LLM interpretability with sparse autoencoders (SAEs) using Llama 3.2, written in pure PyTorch and full…
  ☆616Updated 3 months ago
• OpenPipe / deductive-reasoning
  Train your own SOTA deductive reasoning model
  ☆96Updated 3 months ago
• Infini-AI-Lab / UMbreLLa
  LLM Inference on consumer devices
  ☆119Updated 3 months ago
• snowflakedb / ArcticTraining
  ArcticTraining is a framework designed to simplify and accelerate the post-training process for large language models (LLMs)
  ☆130Updated this week
• MinishLab / vicinity
  Lightweight Nearest Neighbors with Flexible Backends
  ☆291Updated last month
• babycommando / neuralgraffiti
  Live-bending a foundation model’s output at neural network level.
  ☆261Updated 2 months ago
• dicroce / hnsw
  Heirarchical Navigable Small Worlds
  ☆97Updated 2 months ago
• Zyphra / Zamba2
  PyTorch implementation of models from the Zamba2 series.
  ☆182Updated 5 months ago
• pyember / ember
  ☆184Updated this week
• SakanaAI / evo-memory
  Code to train and evaluate Neural Attention Memory Models to obtain universally-applicable memory systems for transformers.
  ☆312Updated 8 months ago
• willccbb / mlx_parallm
  Fast parallel LLM inference for MLX
  ☆194Updated 11 months ago
• HazyResearch / lolcats
  Repo for "LoLCATs: On Low-Rank Linearizing of Large Language Models"
  ☆239Updated 5 months ago
• llmonpy / needle-in-a-needlestack
  ☆116Updated 4 months ago
• Tsadoq / ErisForge
  Dead Simple LLM Abliteration
  ☆219Updated 4 months ago
• willkurt / token-explorer
  A simple tool that let's you explore different possible paths that an LLM might sample.
  ☆173Updated last month
• IST-DASLab / QUIK
  Repository for the QUIK project, enabling the use of 4bit kernels for generative inference - EMNLP 2024
  ☆180Updated last year
• jlscheerer / xtr-warp
  XTR/WARP (SIGIR'25) is an extremely fast and accurate retrieval engine based on Stanford's ColBERTv2/PLAID and Google DeepMind's XTR.
  ☆135Updated last month
• NimbleEdge / sparse_transformers
  Sparse Inferencing for transformer based LLMs
  ☆187Updated this week
• Mihaiii / backtrack_sampler
  An easy-to-understand framework for LLM samplers that rewind and revise generated tokens
  ☆140Updated 4 months ago
• antimatter15 / reverse-engineering-gemma-3n
  Reverse Engineering Gemma 3n: Google's New Edge-Optimized Language Model
  ☆138Updated last month
• eqimp / hogwild_llm
  Official PyTorch implementation for Hogwild! Inference: Parallel LLM Generation with a Concurrent Attention Cache
  ☆109Updated 2 months ago
• ScalingIntelligence / good-kernels
  Samples of good AI generated CUDA kernels
  ☆83Updated 3 weeks ago
• astramind-ai / BitMat
  An efficent implementation of the method proposed in "The Era of 1-bit LLMs"
  ☆154Updated 8 months ago