Alternatives and similar repositories for tokasaurus

Users that are interested in tokasaurus are comparing it to the libraries listed below

• valine / training-hot-swap
  Pytorch script hot swap: Change code without unloading your LLM from VRAM
  ☆126Updated last month
• Foreseerr / TScale
  ☆195Updated last month
• dicroce / hnsw
  Heirarchical Navigable Small Worlds
  ☆96Updated 2 months ago
• codelion / pts
  Pivotal Token Search
  ☆97Updated 3 weeks ago
• em-llm / EM-LLM-model
  ☆201Updated 3 months ago
• kolinko / effort
  An implementation of bucketMul LLM inference
  ☆217Updated 11 months ago
• babycommando / neuralgraffiti
  Live-bending a foundation model’s output at neural network level.
  ☆254Updated 2 months ago
• Tsadoq / ErisForge
  Dead Simple LLM Abliteration
  ☆218Updated 3 months ago
• IST-DASLab / QUIK
  Repository for the QUIK project, enabling the use of 4bit kernels for generative inference - EMNLP 2024
  ☆180Updated last year
• carsonpo / haystackdb
  ☆163Updated last year
• mlecauchois / micrograd-cuda
  ☆247Updated last year
• rentruewang / bocoel
  Bayesian Optimization as a Coverage Tool for Evaluating LLMs. Accurate evaluation (benchmarking) that's 10 times faster with just a few l…
  ☆285Updated last week
• Zyphra / Zamba2
  PyTorch implementation of models from the Zamba2 series.
  ☆182Updated 4 months ago
• apple / ml-recurrent-drafter
  ☆210Updated 4 months ago
• MinishLab / vicinity
  Lightweight Nearest Neighbors with Flexible Backends
  ☆283Updated last week
• vgel / logitloom
  explore token trajectory trees on instruct and base models
  ☆125Updated last week
• PaulPauls / llama3_interpretability_sae
  A complete end-to-end pipeline for LLM interpretability with sparse autoencoders (SAEs) using Llama 3.2, written in pure PyTorch and full…
  ☆615Updated 2 months ago
• fiddlecube / compliant-llm
  Build Secure and Compliant AI agents and MCP Servers. YC W23
  ☆140Updated this week
• willccbb / mlx_parallm
  Fast parallel LLM inference for MLX
  ☆189Updated 11 months ago
• haizelabs / j1-micro
  j1-micro (1.7B) & j1-nano (600M) are absurdly tiny but mighty reward models.
  ☆74Updated last week
• anordin95 / run-llama-locally
  Run and explore Llama models locally with minimal dependencies on CPU
  ☆189Updated 7 months ago
• neurallambda / awesome-reasoning
  a curated list of data for reasoning ai
  ☆136Updated 10 months ago
• jamsocket / forevervm
  Securely run AI-generated code in stateful sandboxes that run forever.
  ☆196Updated last month
• xjdr-alt / llmri
  look how they massacred my boy
  ☆63Updated 7 months ago
• arc53 / llm-price-compass
  This project collects GPU benchmarks from various cloud providers and compares them to fixed per token costs. Use our tool for efficient …
  ☆221Updated 5 months ago
• llmonpy / needle-in-a-needlestack
  ☆116Updated 4 months ago
• taylorai / aiq
  ai for jq
  ☆241Updated 8 months ago
• felafax / felafax
  Felafax is building AI infra for non-NVIDIA GPUs
  ☆560Updated 4 months ago
• SakanaAI / evo-memory
  Code to train and evaluate Neural Attention Memory Models to obtain universally-applicable memory systems for transformers.
  ☆310Updated 7 months ago
• tiiuae / onebitllms
  Lightweight toolkit package to train and fine-tune 1.58bit Language models
  ☆72Updated 2 weeks ago