Alternatives and similar repositories for TransformerX

Users that are interested in TransformerX are comparing it to the libraries listed below

• lucidrains / grokfast-pytorch
  Explorations into the proposal from the paper "Grokfast, Accelerated Grokking by Amplifying Slow Gradients"
  ☆99Updated 4 months ago
• rasbt / faster-pytorch-blog
  Outlining techniques for improving the training performance of your PyTorch model without compromising its accuracy
  ☆129Updated 2 years ago
• lucidrains / genetic-algorithm-pytorch
  Toy genetic algorithm in Pytorch
  ☆49Updated 2 weeks ago
• myscience / mamba
  Pytorch (Lightning) implementation of the Mamba model
  ☆28Updated 3 weeks ago
• lucidrains / pytorch-custom-utils
  Just some miscellaneous utility functions / decorators / modules related to Pytorch and Accelerate to help speed up implementation of new…
  ☆121Updated 9 months ago
• kabachuha / nanoGPKANT
  Testing KAN-based text generation GPT models
  ☆17Updated last year
• sidhu2690 / Deep-KAN
  This repository contains a better implementation of Kolmogorov-Arnold networks
  ☆61Updated last year
• angry-kratos / Simple_Llama3_from_scratch
  ☆31Updated 10 months ago
• kyegomez / swarms-pytorch
  Swarming algorithms like PSO, Ant Colony, Sakana, and more in PyTorch 😊
  ☆122Updated last month
• rasbt / RAGs
  RAGs: Simple implementations of Retrieval Augmented Generation (RAG) Systems
  ☆104Updated 3 months ago
• CG80499 / KAN-GPT-2
  Training small GPT-2 style models using Kolmogorov-Arnold networks.
  ☆117Updated 11 months ago
• tanaymeh / mamba-train
  A single repo with all scripts and utils to train / fine-tune the Mamba model with or without FIM
  ☆54Updated last year
• warner-benjamin / commented-transformers
  Highly commented implementations of Transformers in PyTorch
  ☆136Updated last year
• rasbt / cvpr2023
  ☆134Updated last year
• pchlenski / manify
  Generate graph/data embeddings multiple ways
  ☆52Updated this week
• epfml / DenseFormer
  ☆81Updated last year
• NielsRogge / awesome-huggingface
  Repository containing awesome resources regarding Hugging Face tooling.
  ☆47Updated last year
• d-kleine / NER_decoder
  Named Entity Recognition with an decoder-only (autoregressive) LLM using HuggingFace
  ☆42Updated 6 months ago
• Oxen-AI / mamba-dive
  This is the code that went into our practical dive using mamba as information extraction
  ☆54Updated last year
• rasbt / pytorch-memory-optim
  This code repository contains the code used for my "Optimizing Memory Usage for Training LLMs and Vision Transformers in PyTorch" blog po…
  ☆92Updated last year
• lucidrains / frame-averaging-pytorch
  Pytorch implementation of a simple way to enable (Stochastic) Frame Averaging for any network
  ☆50Updated 9 months ago
• ThinamXx / Meta-llama
  Complete implementation of Llama2 with/without KV cache & inference 🚀
  ☆46Updated 11 months ago
• AnswerDotAI / nbdev-template
  ☆91Updated last month
• The-AI-Summer / JAX-examples
  A set of of fundamental operations and deep learning models using JAX
  ☆13Updated 4 years ago
• Pleias / Various-Finetuning
  Set of scripts to finetune LLMs
  ☆37Updated last year
• lucidrains / agent-attention-pytorch
  Implementation of Agent Attention in Pytorch
  ☆89Updated 10 months ago
• rasbt / nn_plus_gzip
  Gzip and nearest neighbors for text classification
  ☆57Updated last year
• lucidrains / mixture-of-attention
  Some personal experiments around routing tokens to different autoregressive attention, akin to mixture-of-experts
  ☆118Updated 7 months ago
• capjamesg / sam-clip
  Use Grounding DINO, Segment Anything, and CLIP to label objects in images.
  ☆31Updated last year
• lucidrains / AMIE-pytorch
  Implementation of the general framework for AMIE, from the paper "Towards Conversational Diagnostic AI", out of Google Deepmind
  ☆62Updated 8 months ago