Alternatives and similar repositories for SwissArmyTransformer:

Users that are interested in SwissArmyTransformer are comparing it to the libraries listed below

• eric-ai-lab / MiniGPT-5
  Official implementation of paper "MiniGPT-5: Interleaved Vision-and-Language Generation via Generative Vokens"
  ☆858Updated last month
• AetherCortex / Llama-X
  Open Academic Research on Improving LLaMA to SOTA LLM
  ☆1,615Updated last year
• Tencent / TencentPretrain
  Tencent Pre-training framework in PyTorch & Pre-trained Model Zoo
  ☆1,054Updated 5 months ago
• GanjinZero / RRHF
  [NIPS2023] RRHF & Wombat
  ☆802Updated last year
• deepseek-ai / DeepSeek-MoE
  DeepSeekMoE: Towards Ultimate Expert Specialization in Mixture-of-Experts Language Models
  ☆1,083Updated last year
• pjlab-sys4nlp / llama-moe
  ⛷️ LLaMA-MoE: Building Mixture-of-Experts from LLaMA with Continual Pre-training (EMNLP 2024)
  ☆908Updated last month
• ZhuiyiTechnology / roformer
  Rotary Transformer
  ☆858Updated 2 years ago
• thunlp / OpenDelta
  A plug-and-play library for parameter-efficient-tuning (Delta Tuning)
  ☆1,009Updated 3 months ago
• thu-ml / unidiffuser
  Code and models for the paper "One Transformer Fits All Distributions in Multi-Modal Diffusion"
  ☆1,394Updated last year
• OpenLMLab / LOMO
  LOMO: LOw-Memory Optimization
  ☆979Updated 6 months ago
• OpenLMLab / MOSS-RLHF
  Secrets of RLHF in Large Language Models Part I: PPO
  ☆1,320Updated 10 months ago
• InternLM / InternLM-techreport
  ☆900Updated last year
• OpenBMB / BMTrain
  Efficient Training (including pre-training and fine-tuning) for Big Models
  ☆574Updated 5 months ago
• AGI-Edgerunners / LLM-Adapters
  Code for our EMNLP 2023 Paper: "LLM-Adapters: An Adapter Family for Parameter-Efficient Fine-Tuning of Large Language Models"
  ☆1,108Updated 10 months ago
• OpenMOSS / CoLLiE
  Collaborative Training of Large Language Models in an Efficient Way
  ☆411Updated 4 months ago
• WeOpenML / PandaLM
  ☆894Updated 7 months ago
• bigscience-workshop / Megatron-DeepSpeed
  Ongoing research training transformer language models at scale, including: BERT & GPT-2
  ☆1,354Updated 9 months ago
• baaivision / Emu
  Emu Series: Generative Multimodal Models from BAAI
  ☆1,673Updated 3 months ago
• lucidrains / MEGABYTE-pytorch
  Implementation of MEGABYTE, Predicting Million-byte Sequences with Multiscale Transformers, in Pytorch
  ☆632Updated 3 weeks ago
• baaivision / Emu3
  Next-Token Prediction is All You Need
  ☆1,965Updated 2 months ago
• BAAI-DCAI / Bunny
  A family of lightweight multimodal models.
  ☆972Updated last month
• princeton-nlp / SimPO
  [NeurIPS 2024] SimPO: Simple Preference Optimization with a Reference-Free Reward
  ☆800Updated 2 months ago
• mli / transformers-benchmarks
  real Transformer TeraFLOPS on various GPUs
  ☆892Updated last year
• bojone / rerope
  Rectified Rotary Position Embeddings
  ☆348Updated 7 months ago
• phellonchen / X-LLM
  X-LLM: Bootstrapping Advanced Large Language Models by Treating Multi-Modalities as Foreign Languages
  ☆307Updated last year
• X-PLUG / mPLUG-Owl
  mPLUG-Owl: The Powerful Multi-modal Large Language Model Family
  ☆2,393Updated last month
• FlagAI-Open / Aquila2
  The official repo of Aquila2 series proposed by BAAI, including pretrained & chat large language models.
  ☆440Updated 3 months ago
• PKU-Alignment / safe-rlhf
  Safe RLHF: Constrained Value Alignment via Safe Reinforcement Learning from Human Feedback
  ☆1,394Updated 7 months ago
• shikras / shikra
  ☆756Updated 6 months ago
• bojone / bytepiece
  更纯粹、更高压缩率的Tokenizer
  ☆468Updated last month