Alternatives and similar repositories for torchscale:

Users that are interested in torchscale are comparing it to the libraries listed below

• jzbjyb / ReAtt
  Retrieval as Attention
  ☆83Updated 2 years ago
• allenai / data-efficient-finetuning
  Code for paper 'Data-Efficient FineTuning'
  ☆29Updated last year
• kernelmachine / demix
  DEMix Layers for Modular Language Modeling
  ☆53Updated 3 years ago
• bigscience-workshop / architecture-objective
  ☆96Updated last year
• hpcaitech / ColossalAI-Pytorch-lightning
  ☆24Updated 2 years ago
• yxuansu / Contrastive_Search_versus_Contrastive_Decoding
  An Empirical Study On Contrastive Search And Contrastive Decoding For Open-ended Text Generation
  ☆27Updated 10 months ago
• lucidrains / coco-lm-pytorch
  Implementation of COCO-LM, Correcting and Contrasting Text Sequences for Language Model Pretraining, in Pytorch
  ☆45Updated 4 years ago
• martiansideofthemoon / rankgen
  Official code and model checkpoints for our EMNLP 2022 paper "RankGen - Improving Text Generation with Large Ranking Models" (https://arx…
  ☆136Updated last year
• frankxu2004 / knnlm-why
  Repo for ICML23 "Why do Nearest Neighbor Language Models Work?"
  ☆56Updated 2 years ago
• Lightning-Universe / lightning-ColossalAI
  Large Scale Distributed Model Training strategy with Colossal AI and Lightning AI
  ☆57Updated last year
• chijames / KERPLE
  ☆19Updated 2 years ago
• ghomasHudson / muld
  The Multitask Long Document Benchmark
  ☆38Updated 2 years ago
• EleutherAI / semantic-memorization
  ☆44Updated 5 months ago
• asahi417 / relbert
  The official implementation of "Distilling Relation Embeddings from Pre-trained Language Models, EMNLP 2021 main conference", a high-qual…
  ☆46Updated 5 months ago
• seonghyeonye / TAPP
  [AAAI 2024] Investigating the Effectiveness of Task-Agnostic Prefix Prompt for Instruction Following
  ☆79Updated 7 months ago
• EleutherAI / pile_dedupe
  Pile Deduplication Code
  ☆19Updated last year
• NormXU / Consistent-DynamicNTKRoPE
  An Experiment on Dynamic NTK Scaling RoPE
  ☆64Updated last year
• allenai / bff
  ☆38Updated last year
• hadasah / btm
  ☆72Updated last year
• yikangshen / megablocks
  ☆20Updated 11 months ago
• kyegomez / Reka-Torch
  Implementation of the model: "Reka Core, Flash, and Edge: A Series of Powerful Multimodal Language Models" in PyTorch
  ☆30Updated 2 weeks ago
• jungokasai / deep-shallow
  ☆44Updated 4 years ago
• salesforce / factualNLG
  Code for the arXiv paper: "LLMs as Factual Reasoners: Insights from Existing Benchmarks and Beyond"
  ☆59Updated 3 months ago
• jungokasai / beam_with_patience
  ☆46Updated 3 years ago
• lyutyuh / structured-span-selector
  A Structured Span Selector (NAACL 2022). A structured span selector with a WCFG for span selection tasks (coreference resolution, semanti…
  ☆21Updated 2 years ago
• renll / SeqBoat
  [NeurIPS 2023] Sparse Modular Activation for Efficient Sequence Modeling
  ☆36Updated last year
• kernelmachine / silo-lm
  SILO Language Models code repository
  ☆81Updated last year
• kyegomez / LM-Infinite
  Implementation of "LM-Infinite: Simple On-the-Fly Length Generalization for Large Language Models"
  ☆42Updated 5 months ago
• thu-coai / PICL
  Code for ACL2023 paper: Pre-Training to Learn in Context
  ☆108Updated 9 months ago
• allenai / staged-training
  Staged Training for Transformer Language Models
  ☆32Updated 3 years ago