Alternatives and similar repositories for Everything-about-LLMs:

Users that are interested in Everything-about-LLMs are comparing it to the libraries listed below

• FranxYao / Long-Context-Data-Engineering
  Implementation of paper Data Engineering for Scaling Language Models to 128K Context
  ☆451Updated 11 months ago
• yuhuixu1993 / qa-lora
  Official PyTorch implementation of QA-LoRA
  ☆125Updated 11 months ago
• rasbt / dora-from-scratch
  LoRA and DoRA from Scratch Implementations
  ☆196Updated 11 months ago
• Strivin0311 / long-llms-learning
  A repository sharing the literatures about long-context large language models, including the methodologies and the evaluation benchmarks
  ☆255Updated 6 months ago
• huggingface / datablations
  Scaling Data-Constrained Language Models
  ☆333Updated 4 months ago
• for-ai / parameter-efficient-moe
  ☆251Updated last year
• FasterDecoding / BitDelta
  ☆192Updated 2 months ago
• llm-efficiency-challenge / neurips_llm_efficiency_challenge
  NeurIPS Large Language Model Efficiency Challenge: 1 LLM + 1GPU + 1Day
  ☆255Updated last year
• neelsjain / NEFTune
  Official repository of NEFTune: Noisy Embeddings Improves Instruction Finetuning
  ☆389Updated 9 months ago
• haochengxi / Train_Transformers_with_INT4
  ☆141Updated last year
• bojone / rerope
  Rectified Rotary Position Embeddings
  ☆350Updated 8 months ago
• YuchuanTian / RethinkTinyLM
  [ICML'24] The official implementation of “Rethinking Optimization and Architecture for Tiny Language Models”
  ☆120Updated last month
• dwzhu-pku / PoSE
  Positional Skip-wise Training for Efficient Context Window Extension of LLMs to Extremely Length (ICLR 2024)
  ☆204Updated 8 months ago
• dust-tt / llama-ssp
  Experiments on speculative sampling with Llama models
  ☆124Updated last year
• HKUNLP / ChunkLlama
  [ICML'24] Data and code for our paper "Training-Free Long-Context Scaling of Large Language Models"
  ☆388Updated 4 months ago
• SumanthRH / tokenization
  A comprehensive deep dive into the world of tokens
  ☆220Updated 7 months ago
• jzhang38 / EasyContext
  Memory optimization and training recipes to extrapolate language models' context length to 1 million tokens, with minimal hardware.
  ☆701Updated 4 months ago
• SkyworkAI / Skywork-MoE
  Skywork-MoE: A Deep Dive into Training Techniques for Mixture-of-Experts Language Models
  ☆128Updated 8 months ago
• facebookresearch / RAM
  A framework to study AI models in Reasoning, Alignment, and use of Memory (RAM).
  ☆188Updated last week
• princeton-nlp / LLM-Shearing
  [ICLR 2024] Sheared LLaMA: Accelerating Language Model Pre-training via Structured Pruning
  ☆584Updated 11 months ago
• LLM360 / amber-train
  Pre-training code for Amber 7B LLM
  ☆162Updated 9 months ago
• IST-DASLab / qmoe
  Code for the paper "QMoE: Practical Sub-1-Bit Compression of Trillion-Parameter Models".
  ☆265Updated last year
• rasbt / pytorch-memory-optim
  This code repository contains the code used for my "Optimizing Memory Usage for Training LLMs and Vision Transformers in PyTorch" blog po…
  ☆87Updated last year
• princeton-nlp / CEPE
  [ACL 2024] Long-Context Language Modeling with Parallel Encodings
  ☆153Updated 8 months ago
• GAIR-NLP / ProX
  Offical Repo for "Programming Every Example: Lifting Pre-training Data Quality Like Experts at Scale"
  ☆213Updated this week
• huggingface / picotron_tutorial
  ☆133Updated this week
• microsoft / TransformerCompression
  For releasing code related to compression methods for transformers, accompanying our publications
  ☆406Updated last month