Alternatives and similar repositories for curlora:

Users that are interested in curlora are comparing it to the libraries listed below

• tanaymeh / mamba-train
  A single repo with all scripts and utils to train / fine-tune the Mamba model with or without FIM
  ☆53Updated 11 months ago
• TRI-ML / linear_open_lm
  A repository for research on medium sized language models.
  ☆77Updated 9 months ago
• RobertCsordas / moeut
  ☆73Updated 6 months ago
• kyleliang919 / Online-Subspace-Descent
  This repo is based on https://github.com/jiaweizzhao/GaLore
  ☆26Updated 5 months ago
• orionw / promptriever
  The first dense retrieval model that can be prompted like an LM
  ☆66Updated 5 months ago
• samchaineau / llm_slerp_generation
  Repo hosting codes and materials related to speeding LLMs' inference using token merging.
  ☆35Updated 10 months ago
• Zyphra / tree_attention
  Tree Attention: Topology-aware Decoding for Long-Context Attention on GPU clusters
  ☆123Updated 3 months ago
• thepowerfuldeez / OLMo
  My fork os allen AI's OLMo for educational purposes.
  ☆30Updated 3 months ago
• Zyphra / Zamba2
  PyTorch implementation of models from the Zamba2 series.
  ☆177Updated last month
• NolanoOrg / SpectraSuite
  ☆46Updated 7 months ago
• minyoungg / LTE
  ☆67Updated 8 months ago
• BlinkDL / modded-nanogpt-rwkv
  RWKV-7: Surpassing GPT
  ☆80Updated 3 months ago
• Lagooon / LeanSTaR
  ☆36Updated 5 months ago
• sanyalsunny111 / LLM-Inheritune
  This is the official repository for Inheritune.
  ☆109Updated last month
• Zyphra / Zyda_processing
  ☆31Updated 8 months ago
• BorealisAI / flora-opt
  This is the official repository for the paper "Flora: Low-Rank Adapters Are Secretly Gradient Compressors" in ICML 2024.
  ☆102Updated 8 months ago
• VITA-Group / WeLore
  From GaLore to WeLore: How Low-Rank Weights Non-uniformly Emerge from Low-Rank Gradients. Ajay Jaiswal, Lu Yin, Zhenyu Zhang, Shiwei Liu,…
  ☆44Updated 7 months ago
• Zoeyyao27 / SirLLM
  This repository contains the code for the paper: SirLLM: Streaming Infinite Retentive LLM
  ☆57Updated 9 months ago
• kiddyboots216 / lottery-ticket-adaptation
  Lottery Ticket Adaptation
  ☆38Updated 3 months ago
• RobertCsordas / moe_attention
  Official repository for the paper "SwitchHead: Accelerating Transformers with Mixture-of-Experts Attention"
  ☆96Updated 5 months ago
• ContextualAI / CLAIR_and_APO
  Anchored Preference Optimization and Contrastive Revisions: Addressing Underspecification in Alignment
  ☆55Updated 6 months ago
• mwatkins1970 / SAE_Feature_Interpretability_Tool
  A tool to assist in the interpretation of learned features in sparse autoencoders (in particular the four SAE's trained by Joseph Bloom o…
  ☆18Updated 5 months ago
• mistralai / mistral-evals
  ☆63Updated last month
• JacobPfau / fillerTokens
  ☆59Updated 10 months ago
• SonicCodes / subcloning
  implementation of https://arxiv.org/pdf/2312.09299
  ☆20Updated 8 months ago