Alternatives and similar repositories for trailmet:

Users that are interested in trailmet are comparing it to the libraries listed below

• nyunAI / Faster-LLM-Survey
  ☆42Updated last year
• joey00072 / ohara
  Collection of autoregressive model implementation
  ☆85Updated this week
• hyperevolnet / Terminator
  The official repository for HyperZ⋅Z⋅W Operator Connects Slow-Fast Networks for Full Context Interaction.
  ☆36Updated 3 weeks ago
• satabios / sconce
  E2E AutoML Model Compression Package
  ☆47Updated last month
• RobertCsordas / moe
  Official repository for the paper "Approximating Two-Layer Feedforward Networks for Efficient Transformers"
  ☆37Updated last year
• smonsays / hypernetwork-attention
  Official code for the paper "Attention as a Hypernetwork"
  ☆30Updated 10 months ago
• ariG23498 / quantized-diffusion-inference
  Notebook and Scripts that showcase running quantized diffusion models on consumer GPUs
  ☆38Updated 6 months ago
• JeanKaddour / LAWA
  Latest Weight Averaging (NeurIPS HITY 2022)
  ☆30Updated last year
• graphcore-research / jax-scalify
  JAX Scalify: end-to-end scaled arithmetics
  ☆16Updated 5 months ago
• rishiraj / firerequests
  High-performance, asynchronous Python HTTP client library designed for faster file transfers using concurrency, semaphores, and fault-tol…
  ☆55Updated 2 weeks ago
• Qichuzyy / POA
  Official implementation of ECCV24 paper: POA
  ☆24Updated 8 months ago
• IST-DASLab / QuEST
  Work in progress.
  ☆56Updated 2 weeks ago
• sayakpaul / big_vision_experiments
  Contains my experiments with the `big_vision` repo to train ViTs on ImageNet-1k.
  ☆22Updated 2 years ago
• IST-DASLab / MicroAdam
  This repository contains code for the MicroAdam paper.
  ☆18Updated 4 months ago
• google-deepmind / asyncdiloco
  ☆43Updated last year
• attentionmech / dex
  Pokedex for LLMs
  ☆11Updated 2 weeks ago
• okarthikb / attention-visualizer
  LLM attention pattern visualizer
  ☆10Updated last year
• tanaymeh / mamba-train
  A single repo with all scripts and utils to train / fine-tune the Mamba model with or without FIM
  ☆54Updated last year
• r-three / RAD
  Reference implementation for Reward-Augmented Decoding: Efficient Controlled Text Generation With a Unidirectional Reward Model
  ☆45Updated last year
• The-Inscrutable-X / TACQ
  Official Repository for Task-Circuit Quantization
  ☆15Updated 2 weeks ago
• evanatyourservice / llm-jax
  Train a SmolLM-style llm on fineweb-edu in JAX/Flax with an assortment of optimizers.
  ☆17Updated last month
• SamsungSAILMontreal / nino
  Code for "Accelerating Training with Neuron Interaction and Nowcasting Networks" [to appear at ICLR 2025]
  ☆19Updated last month
• shreyansh26 / LLM-Sampling
  A collection of various LLM sampling methods implemented in pure Pytorch
  ☆23Updated 4 months ago
• flowritecom / flow-merge
  flow-merge is a powerful Python library that enables seamless merging of multiple transformer-based language models using the most popula…
  ☆17Updated 2 months ago
• VITA-Group / WeLore
  From GaLore to WeLore: How Low-Rank Weights Non-uniformly Emerge from Low-Rank Gradients. Ajay Jaiswal, Lu Yin, Zhenyu Zhang, Shiwei Liu,…
  ☆44Updated last week
• adihaviv / nopos
  ☆22Updated last year
• Niccolo-Ajroldi / plainLM
  Minimal pretraining script for language modeling in PyTorch. Supporting torch compilation and DDP. It includes a model implementation and…
  ☆12Updated last week
• kyleliang919 / Online-Subspace-Descent
  This repo is based on https://github.com/jiaweizzhao/GaLore
  ☆26Updated 7 months ago
• eth-easl / fmengine
  Utilities for Training Very Large Models
  ☆58Updated 7 months ago
• VijayLingam95 / SVFT
  ☆27Updated 2 months ago