Alternatives and similar repositories for Everything-about-LLMs:

Users that are interested in Everything-about-LLMs are comparing it to the libraries listed below

• rasbt / dora-from-scratch
  LoRA and DoRA from Scratch Implementations
  ☆199Updated last year
• FranxYao / Long-Context-Data-Engineering
  Implementation of paper Data Engineering for Scaling Language Models to 128K Context
  ☆454Updated last year
• haochengxi / Train_Transformers_with_INT4
  ☆145Updated last year
• SumanthRH / tokenization
  A comprehensive deep dive into the world of tokens
  ☆221Updated 9 months ago
• llm-efficiency-challenge / neurips_llm_efficiency_challenge
  NeurIPS Large Language Model Efficiency Challenge: 1 LLM + 1GPU + 1Day
  ☆255Updated last year
• catid / dora
  Implementation of DoRA
  ☆291Updated 9 months ago
• bojone / rerope
  Rectified Rotary Position Embeddings
  ☆361Updated 10 months ago
• OpenNLPLab / TransnormerLLM
  Official implementation of TransNormerLLM: A Faster and Better LLM
  ☆243Updated last year
• rasbt / pytorch-memory-optim
  This code repository contains the code used for my "Optimizing Memory Usage for Training LLMs and Vision Transformers in PyTorch" blog po…
  ☆87Updated last year
• SkyworkAI / Skywork-MoE
  Skywork-MoE: A Deep Dive into Training Techniques for Mixture-of-Experts Language Models
  ☆130Updated 9 months ago
• IBM / ModuleFormer
  ModuleFormer is a MoE-based architecture that includes two different types of experts: stick-breaking attention heads and feedforward exp…
  ☆217Updated 11 months ago
• yihedeng9 / rlhf-summary-notes
  A brief and partial summary of RLHF algorithms.
  ☆127Updated 3 weeks ago
• huggingface / datablations
  Scaling Data-Constrained Language Models
  ☆335Updated 6 months ago
• gpu-mode / ring-attention
  ring-attention experiments
  ☆128Updated 5 months ago
• lucidrains / CALM-pytorch
  Implementation of CALM from the paper "LLM Augmented LLMs: Expanding Capabilities through Composition", out of Google Deepmind
  ☆174Updated 6 months ago
• wolfecameron / nanoMoE
  An extension of the nanoGPT repository for training small MOE models.
  ☆109Updated 3 weeks ago
• for-ai / parameter-efficient-moe
  ☆253Updated last year
• stanford-cs336 / spring2024-lectures
  ☆225Updated 3 months ago
• vwxyzjn / lm-human-preference-details
  RLHF implementation details of OAI's 2019 codebase
  ☆184Updated last year
• dwzhu-pku / PoSE
  Positional Skip-wise Training for Efficient Context Window Extension of LLMs to Extremely Length (ICLR 2024)
  ☆205Updated 10 months ago
• haoliuhl / ringattention
  Large Context Attention
  ☆696Updated 2 months ago
• lucidrains / llama-qrlhf
  Implementation of the Llama architecture with RLHF + Q-learning
  ☆163Updated 2 months ago
• vwxyzjn / summarize_from_feedback_details
  ☆136Updated 4 months ago
• IST-DASLab / qmoe
  Code for the paper "QMoE: Practical Sub-1-Bit Compression of Trillion-Parameter Models".
  ☆272Updated last year
• mlfoundations / open_lm
  A repository for research on medium sized language models.
  ☆493Updated 2 months ago
• HKUNLP / ChunkLlama
  [ICML'24] Data and code for our paper "Training-Free Long-Context Scaling of Large Language Models"
  ☆395Updated 5 months ago
• CASE-Lab-UMD / LLM-Drop
  The official implementation of the paper "What Matters in Transformers? Not All Attention is Needed".
  ☆165Updated this week
• sail-sg / lorahub
  [COLM 2024] LoraHub: Efficient Cross-Task Generalization via Dynamic LoRA Composition
  ☆622Updated 8 months ago
• FasterDecoding / BitDelta
  ☆195Updated 3 months ago
• fangyuan-ksgk / Mini-LLaVA
  A minimal implementation of LLaVA-style VLM with interleaved image & text & video processing ability.
  ☆90Updated 3 months ago