Alternatives and similar repositories for sconce

Users that are interested in sconce are comparing it to the libraries listed below

• cloneofsimo / ptx-tutorial-by-aislop
  PTX-Tutorial Written Purely By AIs (Deep Research of Openai and Claude 3.7)
  ☆66Updated 10 months ago
• joey00072 / ohara
  Collection of autoregressive model implementation
  ☆85Updated 3 weeks ago
• zaydzuhri / softpick-attention
  Landing repository for the paper "Softpick: No Attention Sink, No Massive Activations with Rectified Softmax"
  ☆86Updated 4 months ago
• gpu-mode / kernelbot
  Write a fast kernel and run it on Discord. See how you compare against the best!
  ☆71Updated this week
• srush / triton-autodiff
  Experiment of using Tangent to autodiff triton
  ☆82Updated 2 years ago
• IST-DASLab / Quartet
  ☆119Updated last month
• minyoungg / LTE
  ☆71Updated last year
• main-horse / hnet-old
  H-Net Dynamic Hierarchical Architecture
  ☆81Updated 4 months ago
• vdesai2014 / inference-optimization-blog-post
  ☆91Updated last year
• google-deepmind / asyncdiloco
  ☆47Updated 2 years ago
• PiotrNawrot / sparse-frontier
  The evaluation framework for training-free sparse attention in LLMs
  ☆117Updated 2 weeks ago
• zaydzuhri / flame
  Fork of Flame repo for training of some new stuff in development
  ☆19Updated last month
• gau-nernst / quantized-training
  Explore training for quantized models
  ☆26Updated 6 months ago
• tspeterkim / mixed-precision-from-scratch
  Mixed precision training from scratch with Tensors and CUDA
  ☆28Updated last year
• Zyphra / tree_attention
  Tree Attention: Topology-aware Decoding for Long-Context Attention on GPU clusters
  ☆131Updated last year
• IST-DASLab / QuEST
  Work in progress.
  ☆79Updated 2 months ago
• hahnyuan / PB-LLM
  PB-LLM: Partially Binarized Large Language Models
  ☆157Updated 2 years ago
• IST-DASLab / SparseFinetuning
  Repository for Sparse Finetuning of LLMs via modified version of the MosaicML llmfoundry
  ☆42Updated 2 years ago
• RWKV / RWKV-LM
  RWKV is an RNN with transformer-level LLM performance. It can be directly trained like a GPT (parallelizable). So it's combining the best…
  ☆59Updated 10 months ago
• Anonymous1252022 / fp4-all-the-way
  ☆45Updated 8 months ago
• ScalingIntelligence / good-kernels
  Samples of good AI generated CUDA kernels
  ☆99Updated 8 months ago
• fal-ai / diffusion-speedrun
  Focused on fast experimentation and simplicity
  ☆80Updated last year
• BlinkDL / modded-nanogpt-rwkv
  RWKV-7: Surpassing GPT
  ☆104Updated last year
• tanaymeh / mamba-train
  A single repo with all scripts and utils to train / fine-tune the Mamba model with or without FIM
  ☆61Updated last year
• gpu-mode / triton-tutorials
  ☆16Updated 8 months ago
• thinking-machines-lab / manifolds
  Supporting code for the blog post on modular manifolds.
  ☆115Updated 4 months ago
• cloneofsimo / min-fsdp
  ☆92Updated last year
• Chillee / llm.c
  LLM training in simple, raw C/CUDA
  ☆18Updated last year
• amazon-science / mxfp4-llm
  Official implementation for Training LLMs with MXFP4
  ☆118Updated 9 months ago
• rasbt / pytorch-memory-optim
  This code repository contains the code used for my "Optimizing Memory Usage for Training LLMs and Vision Transformers in PyTorch" blog po…
  ☆92Updated 2 years ago