Alternatives and similar repositories for Everything-about-LLMs

Users that are interested in Everything-about-LLMs are comparing it to the libraries listed below

• rasbt / dora-from-scratch
  LoRA and DoRA from Scratch Implementations
  ☆206Updated last year
• OpenNLPLab / TransnormerLLM
  Official implementation of TransNormerLLM: A Faster and Better LLM
  ☆247Updated last year
• FranxYao / Long-Context-Data-Engineering
  Implementation of paper Data Engineering for Scaling Language Models to 128K Context
  ☆463Updated last year
• GeneZC / MiniMA
  Code for paper titled "Towards the Law of Capacity Gap in Distilling Language Models"
  ☆99Updated last year
• SkyworkAI / Skywork-MoE
  Skywork-MoE: A Deep Dive into Training Techniques for Mixture-of-Experts Language Models
  ☆135Updated last year
• mathllm / MathCoder
  [MathCoder, MathCoder-VL] Family of LLMs/LMMs for mathematical reasoning.
  ☆298Updated last month
• llm-efficiency-challenge / neurips_llm_efficiency_challenge
  NeurIPS Large Language Model Efficiency Challenge: 1 LLM + 1GPU + 1Day
  ☆256Updated last year
• LLM360 / amber-train
  Pre-training code for Amber 7B LLM
  ☆166Updated last year
• liutiedong / goat
  a Fine-tuned LLaMA that is Good at Arithmetic Tasks
  ☆178Updated last year
• sangmichaelxie / cs324_p2
  Project 2 (Building Large Language Models) for Stanford CS324: Understanding and Developing Large Language Models (Winter 2022)
  ☆105Updated 2 years ago
• aju22 / LLaMA2
  This repository contains an implementation of the LLaMA 2 (Large Language Model Meta AI) model, a Generative Pretrained Transformer (GPT)…
  ☆68Updated last year
• vwxyzjn / summarize_from_feedback_details
  ☆144Updated 7 months ago
• YuchuanTian / RethinkTinyLM
  [ICML'24] The official implementation of “Rethinking Optimization and Architecture for Tiny Language Models”
  ☆121Updated 6 months ago
• catid / dora
  Implementation of DoRA
  ☆296Updated last year
• lucidrains / llama-qrlhf
  Implementation of the Llama architecture with RLHF + Q-learning
  ☆165Updated 5 months ago
• yihedeng9 / rlhf-summary-notes
  A brief and partial summary of RLHF algorithms.
  ☆131Updated 4 months ago
• Strivin0311 / long-llms-learning
  A repository sharing the literatures about long-context large language models, including the methodologies and the evaluation benchmarks
  ☆265Updated 11 months ago
• huggingface / datablations
  Scaling Data-Constrained Language Models
  ☆337Updated 2 weeks ago
• Cohere-Labs-Community / parameter-efficient-moe
  ☆263Updated last year
• lucidrains / CALM-pytorch
  Implementation of CALM from the paper "LLM Augmented LLMs: Expanding Capabilities through Composition", out of Google Deepmind
  ☆177Updated 10 months ago
• llm-random / llm-random
  ☆191Updated last week
• dwzhu-pku / PoSE
  Positional Skip-wise Training for Efficient Context Window Extension of LLMs to Extremely Length (ICLR 2024)
  ☆204Updated last year
• TencentARC / LLaMA-Pro
  [ACL 2024] Progressive LLaMA with Block Expansion.
  ☆505Updated last year
• bojone / rerope
  Rectified Rotary Position Embeddings
  ☆374Updated last year
• SumanthRH / tokenization
  A comprehensive deep dive into the world of tokens
  ☆224Updated last year
• rasbt / cvpr2023
  ☆133Updated last year
• yangjianxin1 / LongQLoRA
  LongQLoRA: Extent Context Length of LLMs Efficiently
  ☆166Updated last year
• fangyuan-ksgk / Tiny-GRPO
  minimal GRPO implementation from scratch
  ☆92Updated 4 months ago
• anchen1011 / FireAct
  FireAct: Toward Language Agent Fine-tuning
  ☆279Updated last year
• CASE-Lab-UMD / LLM-Drop
  The official implementation of the paper "What Matters in Transformers? Not All Attention is Needed".
  ☆174Updated 3 months ago