Alternatives and similar repositories for basedxl

Users that are interested in basedxl are comparing it to the libraries listed below

• WaveSpeedAI / QuantumAttention
  [WIP] Better (FP8) attention for Hopper
  ☆30Updated 3 months ago
• kaiokendev / cutoff-len-is-context-len
  Demonstration that finetuning RoPE model on larger sequences than the pre-trained model adapts the model context limit
  ☆62Updated last year
• sekstini / gpupoor
  ☆14Updated 6 months ago
• SonicCodes / subcloning
  implementation of https://arxiv.org/pdf/2312.09299
  ☆20Updated 11 months ago
• Birch-san / booru-embed
  [WIP] Transformer to embed Danbooru labelsets
  ☆13Updated last year
• cloneofsimo / efae
  ☆23Updated 11 months ago
• RyokoAI / BigKnow2022
  BigKnow2022: Bringing Language Models Up to Speed
  ☆15Updated 2 years ago
• ethansmith2000 / TransformerExperiments
  ☆19Updated 2 weeks ago
• evanatyourservice / llm-jax
  Train a SmolLM-style llm on fineweb-edu in JAX/Flax with an assortment of optimizers.
  ☆17Updated 2 months ago
• frankxwang / dpo-prefix-sharing
  DPO, but faster 🚀
  ☆42Updated 6 months ago
• cloneofsimo / repa-rf
  ☆33Updated 7 months ago
• ai-compiler-study / triton-kernels
  Triton kernels for Flux
  ☆20Updated 5 months ago
• shreyansh26 / Attention-Mask-Patterns
  Using FlexAttention to compute attention with different masking patterns
  ☆43Updated 8 months ago
• NolanoOrg / SpectraSuite
  ☆48Updated 10 months ago
• kyleliang919 / Super_Muon
  ☆56Updated 2 months ago
• graphcore-research / jax-scalify
  JAX Scalify: end-to-end scaled arithmetics
  ☆16Updated 7 months ago
• thecharlieblake / lovely-llama
  An implementation of the Llama architecture, to instruct and delight
  ☆21Updated this week
• ethansmith2000 / AutoLoRADiscovery
  ☆28Updated 10 months ago
• BlinkDL / LinearAttentionArena
  Here we will test various linear attention designs.
  ☆58Updated last year
• SwayStar123 / reimei
  ☆24Updated last month
• UmerHA / triton_util
  Make triton easier
  ☆47Updated 11 months ago
• SprocketLab / sparse_matrix_fine_tuning
  Official repository for ICML 2024 paper "MoRe Fine-Tuning with 10x Fewer Parameters"
  ☆18Updated 2 weeks ago
• chu-tianxiang / QuIP-for-all
  QuIP quantization
  ☆52Updated last year
• RE-N-Y / sae
  ☆15Updated 6 months ago
• GindaChen / FlexFlashAttention3
  FlexAttention w/ FlashAttention3 Support
  ☆26Updated 8 months ago
• fal-ai-community / minDDPD
  ☆33Updated 5 months ago
• fal-ai-community / nano-mdm
  Tiny re-implementation of MDM in style of LLaDA and nano-gpt speedrun
  ☆52Updated 2 months ago
• BlinkDL / modded-nanogpt-rwkv
  RWKV-7: Surpassing GPT
  ☆88Updated 6 months ago
• timudk / flux_triton
  Writing FLUX in Triton
  ☆33Updated 8 months ago
• cloneofsimo / auto_llm_codebase_analysis
  ☆26Updated last year