THUDM / SwissArmyTransformer

Related projects ⓘ

Alternatives and complementary repositories for SwissArmyTransformer

• GanjinZero / RRHF
  [NIPS2023] RRHF & Wombat
  ☆798Updated last year
• Tencent / TencentPretrain
  Tencent Pre-training framework in PyTorch & Pre-trained Model Zoo
  ☆1,031Updated 3 months ago
• eric-ai-lab / MiniGPT-5
  Official implementation of paper "MiniGPT-5: Interleaved Vision-and-Language Generation via Generative Vokens"
  ☆851Updated 8 months ago
• OpenBMB / BMTrain
  Efficient Training (including pre-training and fine-tuning) for Big Models
  ☆564Updated 3 months ago
• THUDM / P-tuning-v2
  An optimized deep prompt tuning strategy comparable to fine-tuning across scales and tasks
  ☆1,985Updated last year
• OpenMOSS / CoLLiE
  Collaborative Training of Large Language Models in an Efficient Way
  ☆411Updated 2 months ago
• InternLM / InternLM-techreport
  ☆901Updated last year
• WeOpenML / PandaLM
  ☆891Updated 5 months ago
• thunlp / OpenDelta
  A plug-and-play library for parameter-efficient-tuning (Delta Tuning)
  ☆998Updated 2 months ago
• OpenLMLab / LOMO
  LOMO: LOw-Memory Optimization
  ☆979Updated 4 months ago
• deepseek-ai / DeepSeek-MoE
  DeepSeekMoE: Towards Ultimate Expert Specialization in Mixture-of-Experts Language Models
  ☆1,008Updated 10 months ago
• bigscience-workshop / Megatron-DeepSpeed
  Ongoing research training transformer language models at scale, including: BERT & GPT-2
  ☆1,338Updated 8 months ago
• ZhuiyiTechnology / roformer
  Rotary Transformer
  ☆822Updated 2 years ago
• AetherCortex / Llama-X
  Open Academic Research on Improving LLaMA to SOTA LLM
  ☆1,607Updated last year
• luogen1996 / LaVIN
  [NeurIPS 2023] Official implementations of "Cheap and Quick: Efficient Vision-Language Instruction Tuning for Large Language Models"
  ☆509Updated 9 months ago
• hiyouga / FastEdit
  🩹Editing large language models within 10 seconds⚡
  ☆1,284Updated last year
• sail-sg / lorahub
  [COLM 2024] LoraHub: Efficient Cross-Task Generalization via Dynamic LoRA Composition
  ☆594Updated 3 months ago
• horseee / LLM-Pruner
  [NeurIPS 2023] LLM-Pruner: On the Structural Pruning of Large Language Models. Support Llama-3/3.1, Llama-2, LLaMA, BLOOM, Vicuna, Baich…
  ☆874Updated last month
• phellonchen / X-LLM
  X-LLM: Bootstrapping Advanced Large Language Models by Treating Multi-Modalities as Foreign Languages
  ☆306Updated last year
• princeton-nlp / LLM-Shearing
  [ICLR 2024] Sheared LLaMA: Accelerating Language Model Pre-training via Structured Pruning
  ☆558Updated 8 months ago
• alibaba / Megatron-LLaMA
  Best practice for training LLaMA models in Megatron-LM
  ☆628Updated 10 months ago
• baaivision / Emu
  Emu Series: Generative Multimodal Models from BAAI
  ☆1,662Updated last month
• jianzhnie / LLamaTuner
  Easy and Efficient Finetuning LLMs. (Supported LLama, LLama2, LLama3, Qwen, Baichuan, GLM , Falcon) 大模型高效量化训练+部署.
  ☆576Updated 4 months ago
• PKU-YuanGroup / LanguageBind
  【ICLR 2024🔥】 Extending Video-Language Pretraining to N-modality by Language-based Semantic Alignment
  ☆726Updated 7 months ago
• THUDM / LongBench
  [ACL 2024] LongBench: A Bilingual, Multitask Benchmark for Long Context Understanding
  ☆671Updated 2 months ago
• BAAI-DCAI / Bunny
  A family of lightweight multimodal models.
  ☆933Updated this week
• AGI-Edgerunners / LLM-Adapters
  Code for our EMNLP 2023 Paper: "LLM-Adapters: An Adapter Family for Parameter-Efficient Fine-Tuning of Large Language Models"
  ☆1,079Updated 8 months ago
• bojone / rerope
  Rectified Rotary Position Embeddings
  ☆341Updated 6 months ago
• pjlab-sys4nlp / llama-moe
  ⛷️ LLaMA-MoE: Building Mixture-of-Experts from LLaMA with Continual Pre-training (EMNLP 2024)
  ☆883Updated 4 months ago
• XueFuzhao / InstructionWild
  ☆453Updated 5 months ago