THUDM / SwissArmyTransformer

Related projects ⓘ

Alternatives and complementary repositories for SwissArmyTransformer

• GanjinZero / RRHF
  [NIPS2023] RRHF & Wombat
  ☆797Updated last year
• OpenMOSS / CoLLiE
  Collaborative Training of Large Language Models in an Efficient Way
  ☆411Updated 2 months ago
• thunlp / OpenDelta
  A plug-and-play library for parameter-efficient-tuning (Delta Tuning)
  ☆996Updated last month
• Tencent / TencentPretrain
  Tencent Pre-training framework in PyTorch & Pre-trained Model Zoo
  ☆1,028Updated 3 months ago
• THUDM / P-tuning-v2
  An optimized deep prompt tuning strategy comparable to fine-tuning across scales and tasks
  ☆1,981Updated 11 months ago
• ZhuiyiTechnology / roformer
  Rotary Transformer
  ☆811Updated 2 years ago
• AetherCortex / Llama-X
  Open Academic Research on Improving LLaMA to SOTA LLM
  ☆1,607Updated last year
• deepseek-ai / DeepSeek-MoE
  DeepSeekMoE: Towards Ultimate Expert Specialization in Mixture-of-Experts Language Models
  ☆1,000Updated 9 months ago
• OpenBMB / BMTrain
  Efficient Training (including pre-training and fine-tuning) for Big Models
  ☆560Updated 3 months ago
• eric-ai-lab / MiniGPT-5
  Official implementation of paper "MiniGPT-5: Interleaved Vision-and-Language Generation via Generative Vokens"
  ☆852Updated 7 months ago
• OpenLMLab / LOMO
  LOMO: LOw-Memory Optimization
  ☆978Updated 4 months ago
• laekov / fastmoe
  A fast MoE impl for PyTorch
  ☆1,560Updated 4 months ago
• bigscience-workshop / Megatron-DeepSpeed
  Ongoing research training transformer language models at scale, including: BERT & GPT-2
  ☆1,335Updated 7 months ago
• thu-ml / unidiffuser
  Code and models for the paper "One Transformer Fits All Distributions in Multi-Modal Diffusion"
  ☆1,368Updated last year
• XueFuzhao / InstructionWild
  ☆451Updated 5 months ago
• jianzhnie / LLamaTuner
  Easy and Efficient Finetuning LLMs. (Supported LLama, LLama2, LLama3, Qwen, Baichuan, GLM , Falcon) 大模型高效量化训练+部署.
  ☆575Updated 3 months ago
• baaivision / Emu
  Emu Series: Generative Multimodal Models from BAAI
  ☆1,659Updated last month
• microsoft / Megatron-DeepSpeed
  Ongoing research training transformer language models at scale, including: BERT & GPT-2
  ☆1,885Updated 3 weeks ago
• hiyouga / FastEdit
  🩹Editing large language models within 10 seconds⚡
  ☆1,281Updated last year
• ruixiangcui / AGIEval
  ☆707Updated 4 months ago
• pjlab-sys4nlp / llama-moe
  ⛷️ LLaMA-MoE: Building Mixture-of-Experts from LLaMA with Continual Pre-training (EMNLP 2024)
  ☆880Updated 4 months ago
• flageval-baai / FlagEval
  FlagEval is an evaluation toolkit for AI large foundation models.
  ☆299Updated 3 months ago
• AGI-Edgerunners / LLM-Adapters
  Code for our EMNLP 2023 Paper: "LLM-Adapters: An Adapter Family for Parameter-Efficient Fine-Tuning of Large Language Models"
  ☆1,074Updated 7 months ago
• WeOpenML / PandaLM
  ☆887Updated 5 months ago
• phellonchen / X-LLM
  X-LLM: Bootstrapping Advanced Large Language Models by Treating Multi-Modalities as Foreign Languages
  ☆305Updated last year
• THUDM / LongBench
  [ACL 2024] LongBench: A Bilingual, Multitask Benchmark for Long Context Understanding
  ☆657Updated last month
• git-cloner / aliendao
  huggingface mirror download
  ☆551Updated this week
• OpenBMB / BMPrinciples
  A collection of phenomenons observed during the scaling of big foundation models, which may be developed into consensus, principles, or l…
  ☆275Updated last year
• alibaba / Megatron-LLaMA
  Best practice for training LLaMA models in Megatron-LM
  ☆627Updated 10 months ago
• TencentARC / LLaMA-Pro
  [ACL 2024] Progressive LLaMA with Block Expansion.
  ☆479Updated 5 months ago