Alternatives and similar repositories for sconce

Users that are interested in sconce are comparing it to the libraries listed below

• joey00072 / ohara
  Collection of autoregressive model implementation
  ☆85Updated 2 months ago
• graphcore-research / out-of-the-box-fp8-training
  Demo of the unit_scaling library, showing how a model can be easily adapted to train in FP8.
  ☆46Updated last year
• facebookresearch / llm-speedrunner
  The Automated LLM Speedrunning Benchmark measures how well LLM agents can reproduce previous innovations and discover new ones in languag…
  ☆89Updated 2 weeks ago
• main-horse / hnet
  H-Net Dynamic Hierarchical Architecture
  ☆22Updated this week
• rasbt / pytorch-memory-optim
  This code repository contains the code used for my "Optimizing Memory Usage for Training LLMs and Vision Transformers in PyTorch" blog po…
  ☆92Updated 2 years ago
• srush / triton-autodiff
  Experiment of using Tangent to autodiff triton
  ☆79Updated last year
• google-deepmind / asyncdiloco
  ☆45Updated last year
• VatsaDev / NanoPoor
  NanoGPT-speedrunning for the poor T4 enjoyers
  ☆68Updated 2 months ago
• IST-DASLab / QuEST
  Work in progress.
  ☆71Updated 3 weeks ago
• Zyphra / tree_attention
  Tree Attention: Topology-aware Decoding for Long-Context Attention on GPU clusters
  ☆128Updated 7 months ago
• minyoungg / LTE
  ☆68Updated last year
• EleutherAI / training-jacobian
  ☆23Updated 7 months ago
• PiotrNawrot / sparse-frontier
  The evaluation framework for training-free sparse attention in LLMs
  ☆83Updated last month
• BlinkDL / modded-nanogpt-rwkv
  RWKV-7: Surpassing GPT
  ☆92Updated 8 months ago
• NX-AI / mlstm_kernels
  Tiled Flash Linear Attention library for fast and efficient mLSTM Kernels.
  ☆64Updated 2 weeks ago
• cloneofsimo / min-fsdp
  ☆80Updated last year
• fal-ai / diffusion-speedrun
  Focused on fast experimentation and simplicity
  ☆76Updated 6 months ago
• zaydzuhri / softpick-attention
  Implementations of attention with the softpick function, naive and FlashAttention-2
  ☆80Updated 2 months ago
• zaydzuhri / flame
  Fork of Flame repo for training of some new stuff in development
  ☆14Updated last week
• LucasPrietoAl / grokking-at-the-edge-of-numerical-stability
  ☆98Updated 6 months ago
• amirzandieh / HyperAttention
  Triton Implementation of HyperAttention Algorithm
  ☆48Updated last year
• joey00072 / microjax
  Jax like function transformation engine but micro, microjax
  ☆33Updated 8 months ago
• cray-lm / cray-lm
  Cray-LM unified training and inference stack.
  ☆22Updated 5 months ago
• okarthikb / state-space-models
  ☆27Updated last year
• vdesai2014 / inference-optimization-blog-post
  ☆88Updated last year
• gpu-mode / discord-cluster-manager
  Write a fast kernel and run it on Discord. See how you compare against the best!
  ☆46Updated this week
• cloneofsimo / ptx-tutorial-by-aislop
  PTX-Tutorial Written Purely By AIs (Deep Research of Openai and Claude 3.7)
  ☆66Updated 3 months ago
• drisspg / transformer_nuggets
  A place to store reusable transformer components of my own creation or found on the interwebs
  ☆56Updated this week
• epfml / DenseFormer
  ☆81Updated last year
• tanaymeh / mamba-train
  A single repo with all scripts and utils to train / fine-tune the Mamba model with or without FIM
  ☆55Updated last year