Alternatives and similar repositories for Everything-about-LLMs

Users that are interested in Everything-about-LLMs are comparing it to the libraries listed below

• rasbt / dora-from-scratch
  LoRA and DoRA from Scratch Implementations
  ☆212Updated last year
• SumanthRH / tokenization
  A comprehensive deep dive into the world of tokens
  ☆226Updated last year
• SkyworkAI / Skywork-MoE
  Skywork-MoE: A Deep Dive into Training Techniques for Mixture-of-Experts Language Models
  ☆137Updated last year
• FranxYao / Long-Context-Data-Engineering
  Implementation of paper Data Engineering for Scaling Language Models to 128K Context
  ☆473Updated last year
• lucidrains / llama-qrlhf
  Implementation of the Llama architecture with RLHF + Q-learning
  ☆166Updated 7 months ago
• fangyuan-ksgk / Tiny-GRPO
  minimal GRPO implementation from scratch
  ☆97Updated 6 months ago
• OpenNLPLab / TransnormerLLM
  Official implementation of TransNormerLLM: A Faster and Better LLM
  ☆246Updated last year
• lucidrains / CALM-pytorch
  Implementation of CALM from the paper "LLM Augmented LLMs: Expanding Capabilities through Composition", out of Google Deepmind
  ☆177Updated last year
• wolfecameron / nanoMoE
  An extension of the nanoGPT repository for training small MOE models.
  ☆187Updated 6 months ago
• vwxyzjn / summarize_from_feedback_details
  ☆150Updated 9 months ago
• huggingface / picotron_tutorial
  ☆217Updated 7 months ago
• yihedeng9 / rlhf-summary-notes
  A brief and partial summary of RLHF algorithms.
  ☆132Updated 6 months ago
• catid / dora
  Implementation of DoRA
  ☆301Updated last year
• llm-efficiency-challenge / neurips_llm_efficiency_challenge
  NeurIPS Large Language Model Efficiency Challenge: 1 LLM + 1GPU + 1Day
  ☆256Updated last year
• sangmichaelxie / cs324_p2
  Project 2 (Building Large Language Models) for Stanford CS324: Understanding and Developing Large Language Models (Winter 2022)
  ☆105Updated 2 years ago
• Strivin0311 / long-llms-learning
  A repository sharing the literatures about long-context large language models, including the methodologies and the evaluation benchmarks
  ☆266Updated last year
• Mr-Tieguigui / LLM-Post-Training
  ☆62Updated 3 months ago
• Cohere-Labs-Community / parameter-efficient-moe
  ☆270Updated last year
• liutiedong / goat
  a Fine-tuned LLaMA that is Good at Arithmetic Tasks
  ☆177Updated 2 years ago
• astramind-ai / Mixture-of-depths
  Unofficial implementation for the paper "Mixture-of-Depths: Dynamically allocating compute in transformer-based language models"
  ☆170Updated last year
• dust-tt / llama-ssp
  Experiments on speculative sampling with Llama models
  ☆128Updated 2 years ago
• LLM360 / amber-train
  Pre-training code for Amber 7B LLM
  ☆167Updated last year
• GeneZC / MiniMA
  Code for paper titled "Towards the Law of Capacity Gap in Distilling Language Models"
  ☆102Updated last year
• SqueezeAILab / LLM2LLM
  [ACL 2024] LLM2LLM: Boosting LLMs with Novel Iterative Data Enhancement
  ☆190Updated last year
• rasbt / pytorch-memory-optim
  This code repository contains the code used for my "Optimizing Memory Usage for Training LLMs and Vision Transformers in PyTorch" blog po…
  ☆92Updated 2 years ago
• facebookresearch / RAM
  A framework to study AI models in Reasoning, Alignment, and use of Memory (RAM).
  ☆284Updated 2 weeks ago
• aju22 / LLaMA2
  This repository contains an implementation of the LLaMA 2 (Large Language Model Meta AI) model, a Generative Pretrained Transformer (GPT)…
  ☆71Updated last year
• huggingface / datablations
  Scaling Data-Constrained Language Models
  ☆342Updated 2 months ago
• dwzhu-pku / PoSE
  Positional Skip-wise Training for Efficient Context Window Extension of LLMs to Extremely Length (ICLR 2024)
  ☆206Updated last year
• mathllm / MathCoder
  [MathCoder, MathCoder-VL] Family of LLMs/LMMs for mathematical reasoning.
  ☆309Updated 3 weeks ago