Alternatives and similar repositories for Python-Package-Template

Users that are interested in Python-Package-Template are comparing it to the libraries listed below

• tanaymeh / mamba-train
  A single repo with all scripts and utils to train / fine-tune the Mamba model with or without FIM
  ☆55Updated last year
• rasbt / dora-from-scratch
  LoRA and DoRA from Scratch Implementations
  ☆206Updated last year
• fangyuan-ksgk / Tiny-GRPO
  minimal GRPO implementation from scratch
  ☆92Updated 4 months ago
• kyegomez / Jamba
  PyTorch Implementation of Jamba: "Jamba: A Hybrid Transformer-Mamba Language Model"
  ☆173Updated 3 months ago
• wolfecameron / nanoMoE
  An extension of the nanoGPT repository for training small MOE models.
  ☆162Updated 4 months ago
• facebookresearch / RAM
  A framework to study AI models in Reasoning, Alignment, and use of Memory (RAM).
  ☆259Updated last month
• itsnamgyu / block-transformer
  Block Transformer: Global-to-Local Language Modeling for Fast Inference (NeurIPS 2024)
  ☆159Updated 3 months ago
• lucidrains / nGPT-pytorch
  Quick implementation of nGPT, learning entirely on the hypersphere, from NvidiaAI
  ☆287Updated last month
• Think-a-Tron / evolve
  open source alpha evolve
  ☆66Updated last month
• kyegomez / LFM
  An open source implementation of LFMs from Liquid AI: Liquid Foundation Models
  ☆176Updated 2 weeks ago
• NVlabs / hymba
  ☆181Updated 7 months ago
• bluorion-com / ZClip
  Official implementation of the paper: "ZClip: Adaptive Spike Mitigation for LLM Pre-Training".
  ☆130Updated 2 weeks ago
• lucidrains / llama-qrlhf
  Implementation of the Llama architecture with RLHF + Q-learning
  ☆165Updated 5 months ago
• Zyphra / BlackMamba
  Code repository for Black Mamba
  ☆250Updated last year
• kyegomez / MambaTransformer
  Integrating Mamba/SSMs with Transformer for Enhanced Long Context and High-Quality Sequence Modeling
  ☆197Updated 3 months ago
• OpenMachine-ai / transformer-tricks
  A collection of tricks and tools to speed up transformer models
  ☆170Updated last month
• CASE-Lab-UMD / LLM-Drop
  The official implementation of the paper "What Matters in Transformers? Not All Attention is Needed".
  ☆174Updated 3 months ago
• Zyphra / Zamba2
  PyTorch implementation of models from the Zamba2 series.
  ☆184Updated 5 months ago
• facebookresearch / memory
  Memory layers use a trainable key-value lookup mechanism to add extra parameters to a model without increasing FLOPs. Conceptually, spars…
  ☆341Updated 7 months ago
• kyegomez / zeta
  Build high-performance AI models with modular building blocks
  ☆533Updated this week
• llm-random / llm-random
  ☆191Updated last week
• Pleias / Various-Finetuning
  Set of scripts to finetune LLMs
  ☆37Updated last year
• lucidrains / PEER-pytorch
  Pytorch implementation of the PEER block from the paper, Mixture of A Million Experts, by Xu Owen He at Deepmind
  ☆127Updated 10 months ago
• HazyResearch / lolcats
  Repo for "LoLCATs: On Low-Rank Linearizing of Large Language Models"
  ☆244Updated 5 months ago
• joey00072 / ohara
  Collection of autoregressive model implementation
  ☆85Updated 2 months ago
• kyegomez / Mixture-of-Depths
  Implementation of the paper: "Mixture-of-Depths: Dynamically allocating compute in transformer-based language models"
  ☆99Updated last week
• LLM360 / amber-data-prep
  Data preparation code for Amber 7B LLM
  ☆91Updated last year
• foundation-model-stack / bamba
  Train, tune, and infer Bamba model
  ☆130Updated last month
• astramind-ai / BitMat
  An efficent implementation of the method proposed in "The Era of 1-bit LLMs"
  ☆153Updated 9 months ago
• Decentralised-AI / LFM-Liquid-AI-Liquid-Foundation-Models
  An open source implementation of LFMs from Liquid AI: Liquid Foundation Models
  ☆100Updated 9 months ago