Alternatives and similar repositories for SwissArmyTransformer

Users that are interested in SwissArmyTransformer are comparing it to the libraries listed below

• ZhuiyiTechnology / roformer
  Rotary Transformer
  ☆959Updated 3 years ago
• GanjinZero / RRHF
  [NIPS2023] RRHF & Wombat
  ☆809Updated last year
• AetherCortex / Llama-X
  Open Academic Research on Improving LLaMA to SOTA LLM
  ☆1,619Updated last year
• OpenBMB / BMTrain
  Efficient Training (including pre-training and fine-tuning) for Big Models
  ☆592Updated this week
• eric-ai-lab / MiniGPT-5
  Official implementation of paper "MiniGPT-5: Interleaved Vision-and-Language Generation via Generative Vokens"
  ☆860Updated 3 weeks ago
• baaivision / Emu
  Emu Series: Generative Multimodal Models from BAAI
  ☆1,723Updated 8 months ago
• Tencent / TencentPretrain
  Tencent Pre-training framework in PyTorch & Pre-trained Model Zoo
  ☆1,071Updated 9 months ago
• thu-ml / unidiffuser
  Code and models for the paper "One Transformer Fits All Distributions in Multi-Modal Diffusion"
  ☆1,420Updated 2 years ago
• OpenLMLab / LOMO
  LOMO: LOw-Memory Optimization
  ☆984Updated 11 months ago
• OpenMOSS / CoLLiE
  Collaborative Training of Large Language Models in an Efficient Way
  ☆415Updated 9 months ago
• bojone / rerope
  Rectified Rotary Position Embeddings
  ☆367Updated last year
• thunlp / OpenDelta
  A plug-and-play library for parameter-efficient-tuning (Delta Tuning)
  ☆1,028Updated 8 months ago
• X-PLUG / mPLUG-Owl
  mPLUG-Owl: The Powerful Multi-modal Large Language Model Family
  ☆2,481Updated 2 months ago
• lucidrains / flamingo-pytorch
  Implementation of 🦩 Flamingo, state-of-the-art few-shot visual question answering attention net out of Deepmind, in Pytorch
  ☆1,241Updated 2 years ago
• lucidrains / MEGABYTE-pytorch
  Implementation of MEGABYTE, Predicting Million-byte Sequences with Multiscale Transformers, in Pytorch
  ☆642Updated 5 months ago
• pjlab-sys4nlp / llama-moe
  ⛷️ LLaMA-MoE: Building Mixture-of-Experts from LLaMA with Continual Pre-training (EMNLP 2024)
  ☆962Updated 5 months ago
• bigscience-workshop / Megatron-DeepSpeed
  Ongoing research training transformer language models at scale, including: BERT & GPT-2
  ☆1,391Updated last year
• OpenLMLab / MOSS-RLHF
  Secrets of RLHF in Large Language Models Part I: PPO
  ☆1,364Updated last year
• OFA-Sys / OFA
  Official repository of OFA (ICML 2022). Paper: OFA: Unifying Architectures, Tasks, and Modalities Through a Simple Sequence-to-Sequence L…
  ☆2,501Updated last year
• phellonchen / X-LLM
  X-LLM: Bootstrapping Advanced Large Language Models by Treating Multi-Modalities as Foreign Languages
  ☆310Updated last year
• alibaba / Megatron-LLaMA
  Best practice for training LLaMA models in Megatron-LM
  ☆654Updated last year
• git-cloner / aliendao
  huggingface mirror download
  ☆580Updated last month
• princeton-nlp / LLM-Shearing
  [ICLR 2024] Sheared LLaMA: Accelerating Language Model Pre-training via Structured Pruning
  ☆611Updated last year
• AGI-Edgerunners / LLM-Adapters
  Code for our EMNLP 2023 Paper: "LLM-Adapters: An Adapter Family for Parameter-Efficient Fine-Tuning of Large Language Models"
  ☆1,171Updated last year
• InternLM / InternLM-techreport
  ☆903Updated last year
• princeton-nlp / SimPO
  [NeurIPS 2024] SimPO: Simple Preference Optimization with a Reference-Free Reward
  ☆895Updated 3 months ago
• WeOpenML / PandaLM
  ☆914Updated last year
• bojone / bytepiece
  更纯粹、更高压缩率的Tokenizer
  ☆481Updated 6 months ago
• XueFuzhao / InstructionWild
  ☆459Updated 11 months ago
• shikras / shikra
  ☆778Updated 10 months ago