Alternatives and similar repositories for SwissArmyTransformer

Users that are interested in SwissArmyTransformer are comparing it to the libraries listed below

• eric-ai-lab / MiniGPT-5
  Official implementation of paper "MiniGPT-5: Interleaved Vision-and-Language Generation via Generative Vokens"
  ☆860Updated 4 months ago
• baaivision / Emu
  Emu Series: Generative Multimodal Models from BAAI
  ☆1,744Updated 11 months ago
• Tencent / TencentPretrain
  Tencent Pre-training framework in PyTorch & Pre-trained Model Zoo
  ☆1,077Updated last year
• AetherCortex / Llama-X
  Open Academic Research on Improving LLaMA to SOTA LLM
  ☆1,618Updated 2 years ago
• GanjinZero / RRHF
  [NIPS2023] RRHF & Wombat
  ☆812Updated last year
• ZhuiyiTechnology / roformer
  Rotary Transformer
  ☆1,020Updated 3 years ago
• git-cloner / aliendao
  huggingface mirror download
  ☆586Updated 5 months ago
• OpenBMB / BMTrain
  Efficient Training (including pre-training and fine-tuning) for Big Models
  ☆606Updated 2 weeks ago
• InternLM / InternLM-techreport
  ☆906Updated 2 years ago
• thu-ml / unidiffuser
  Code and models for the paper "One Transformer Fits All Distributions in Multi-Modal Diffusion"
  ☆1,436Updated 2 years ago
• bigscience-workshop / Megatron-DeepSpeed
  Ongoing research training transformer language models at scale, including: BERT & GPT-2
  ☆1,415Updated last year
• thunlp / OpenDelta
  A plug-and-play library for parameter-efficient-tuning (Delta Tuning)
  ☆1,034Updated 11 months ago
• OpenLMLab / LOMO
  LOMO: LOw-Memory Optimization
  ☆990Updated last year
• mli / transformers-benchmarks
  real Transformer TeraFLOPS on various GPUs
  ☆915Updated last year
• OpenMOSS / CoLLiE
  Collaborative Training of Large Language Models in an Efficient Way
  ☆416Updated last year
• pjlab-sys4nlp / llama-moe
  ⛷️ LLaMA-MoE: Building Mixture-of-Experts from LLaMA with Continual Pre-training (EMNLP 2024)
  ☆986Updated 9 months ago
• FlagAI-Open / Aquila2
  The official repo of Aquila2 series proposed by BAAI, including pretrained & chat large language models.
  ☆445Updated 11 months ago
• alibaba / Megatron-LLaMA
  Best practice for training LLaMA models in Megatron-LM
  ☆661Updated last year
• XueFuzhao / InstructionWild
  ☆460Updated last year
• deepspeedai / Megatron-DeepSpeed
  Ongoing research training transformer language models at scale, including: BERT & GPT-2
  ☆2,159Updated 3 weeks ago
• THUDM / P-tuning-v2
  An optimized deep prompt tuning strategy comparable to fine-tuning across scales and tasks
  ☆2,053Updated last year
• laekov / fastmoe
  A fast MoE impl for PyTorch
  ☆1,782Updated 7 months ago
• flageval-baai / FlagEval
  FlagEval is an evaluation toolkit for AI large foundation models.
  ☆339Updated 4 months ago
• jianzhnie / LLamaTuner
  Easy and Efficient Finetuning LLMs. (Supported LLama, LLama2, LLama3, Qwen, Baichuan, GLM , Falcon) 大模型高效量化训练+部署.
  ☆612Updated 7 months ago
• baaivision / Emu3
  Next-Token Prediction is All You Need
  ☆2,195Updated 5 months ago
• lichao-sun / SoraReview
  The official GitHub page for the review paper "Sora: A Review on Background, Technology, Limitations, and Opportunities of Large Vision M…
  ☆497Updated last year
• WeOpenML / PandaLM
  ☆922Updated last year
• X-PLUG / mPLUG-Owl
  mPLUG-Owl: The Powerful Multi-modal Large Language Model Family
  ☆2,512Updated 5 months ago
• bojone / bytepiece
  更纯粹、更高压缩率的Tokenizer
  ☆482Updated 9 months ago
• bojone / rerope
  Rectified Rotary Position Embeddings
  ☆381Updated last year