Alternatives and similar repositories for Everything-about-LLMs

Users that are interested in Everything-about-LLMs are comparing it to the libraries listed below

• rasbt / dora-from-scratch
  LoRA and DoRA from Scratch Implementations
  ☆209Updated last year
• catid / dora
  Implementation of DoRA
  ☆301Updated last year
• OpenNLPLab / TransnormerLLM
  Official implementation of TransNormerLLM: A Faster and Better LLM
  ☆247Updated last year
• SkyworkAI / Skywork-MoE
  Skywork-MoE: A Deep Dive into Training Techniques for Mixture-of-Experts Language Models
  ☆136Updated last year
• LLM360 / amber-train
  Pre-training code for Amber 7B LLM
  ☆167Updated last year
• FranxYao / Long-Context-Data-Engineering
  Implementation of paper Data Engineering for Scaling Language Models to 128K Context
  ☆470Updated last year
• aju22 / LLaMA2
  This repository contains an implementation of the LLaMA 2 (Large Language Model Meta AI) model, a Generative Pretrained Transformer (GPT)…
  ☆70Updated last year
• fangyuan-ksgk / Tiny-GRPO
  minimal GRPO implementation from scratch
  ☆96Updated 5 months ago
• SumanthRH / tokenization
  A comprehensive deep dive into the world of tokens
  ☆226Updated last year
• wolfecameron / nanoMoE
  An extension of the nanoGPT repository for training small MOE models.
  ☆178Updated 5 months ago
• Strivin0311 / long-llms-learning
  A repository sharing the literatures about long-context large language models, including the methodologies and the evaluation benchmarks
  ☆265Updated last year
• Cohere-Labs-Community / parameter-efficient-moe
  ☆269Updated last year
• lucidrains / llama-qrlhf
  Implementation of the Llama architecture with RLHF + Q-learning
  ☆166Updated 6 months ago
• fangyuan-ksgk / Mini-LLaVA
  A minimal implementation of LLaVA-style VLM with interleaved image & text & video processing ability.
  ☆95Updated 8 months ago
• huggingface / datablations
  Scaling Data-Constrained Language Models
  ☆339Updated last month
• yihedeng9 / rlhf-summary-notes
  A brief and partial summary of RLHF algorithms.
  ☆132Updated 5 months ago
• GeneZC / MiniMA
  Code for paper titled "Towards the Law of Capacity Gap in Distilling Language Models"
  ☆102Updated last year
• astramind-ai / Mixture-of-depths
  Unofficial implementation for the paper "Mixture-of-Depths: Dynamically allocating compute in transformer-based language models"
  ☆170Updated last year
• vwxyzjn / summarize_from_feedback_details
  ☆150Updated 9 months ago
• arpita8 / Awesome-Mixture-of-Experts-Papers
  Survey: A collection of AWESOME papers and resources on the latest research in Mixture of Experts.
  ☆129Updated last year
• lucidrains / CALM-pytorch
  Implementation of CALM from the paper "LLM Augmented LLMs: Expanding Capabilities through Composition", out of Google Deepmind
  ☆177Updated 11 months ago
• huggingface / picotron_tutorial
  ☆211Updated 6 months ago
• YuchuanTian / RethinkTinyLM
  [ICML'24] The official implementation of “Rethinking Optimization and Architecture for Tiny Language Models”
  ☆123Updated 7 months ago
• llm-efficiency-challenge / neurips_llm_efficiency_challenge
  NeurIPS Large Language Model Efficiency Challenge: 1 LLM + 1GPU + 1Day
  ☆256Updated last year
• thu-ml / low-bit-optimizers
  Low-bit optimizers for PyTorch
  ☆130Updated last year
• dwzhu-pku / PoSE
  Positional Skip-wise Training for Efficient Context Window Extension of LLMs to Extremely Length (ICLR 2024)
  ☆206Updated last year
• neulab / gemini-benchmark
  ☆149Updated last year
• liutiedong / goat
  a Fine-tuned LLaMA that is Good at Arithmetic Tasks
  ☆178Updated last year
• rasbt / pytorch-memory-optim
  This code repository contains the code used for my "Optimizing Memory Usage for Training LLMs and Vision Transformers in PyTorch" blog po…
  ☆92Updated 2 years ago
• dzhulgakov / llama-mistral
  Inference code for Mistral and Mixtral hacked up into original Llama implementation
  ☆371Updated last year