Alternatives and similar repositories for neurips_llm_efficiency_challenge:

Users that are interested in neurips_llm_efficiency_challenge are comparing it to the libraries listed below

• huggingface / datablations
  Scaling Data-Constrained Language Models
  ☆330Updated 4 months ago
• huggingface / llm-swarm
  Manage scalable open LLM inference endpoints in Slurm clusters
  ☆249Updated 6 months ago
• yuhuixu1993 / qa-lora
  Official PyTorch implementation of QA-LoRA
  ☆122Updated 10 months ago
• lucidrains / speculative-decoding
  Explorations into some recent techniques surrounding speculative decoding
  ☆233Updated last month
• HazyResearch / zoology
  Understand and test language model architectures on synthetic tasks.
  ☆177Updated 2 weeks ago
• sabetAI / BLoRA
  batched loras
  ☆338Updated last year
• normster / llm_rules
  RuLES: a benchmark for evaluating rule-following in language models
  ☆214Updated last week
• p-lambda / dsir
  DSIR large-scale data selection framework for language model training
  ☆242Updated 9 months ago
• allenai / fm-cheatsheet
  Website for hosting the Open Foundation Models Cheat Sheet.
  ☆263Updated 7 months ago
• tcapelle / llm_recipes
  A set of scripts and notebooks on LLM finetunning and dataset creation
  ☆101Updated 4 months ago
• imoneoi / multipack_sampler
  Multipack distributed sampler for fast padding-free training of LLMs
  ☆184Updated 5 months ago
• huggingface / cosmopedia
  ☆489Updated 2 months ago
• lm-sys / llm-decontaminator
  Code for the paper "Rethinking Benchmark and Contamination for Language Models with Rephrased Samples"
  ☆296Updated last year
• JinjieNi / MixEval
  The official evaluation suite and dynamic data release for MixEval.
  ☆233Updated 2 months ago
• HazyResearch / m2
  Repo for "Monarch Mixer: A Simple Sub-Quadratic GEMM-Based Architecture"
  ☆545Updated last month
• for-ai / parameter-efficient-moe
  ☆250Updated last year
• microsoft / rho
  Repo for Rho-1: Token-level Data Selection & Selective Pretraining of LLMs.
  ☆387Updated 9 months ago
• yxli2123 / LoftQ
  ☆214Updated 7 months ago
• haoliuhl / ringattention
  Large Context Attention
  ☆677Updated this week
• hamelsmu / llama-inference
  experiments with inference on llama
  ☆104Updated 7 months ago
• llm-merging / LLM-Merging
  LLM-Merging: Building LLMs Efficiently through Merging
  ☆188Updated 4 months ago
• sangmichaelxie / cs324_p2
  Project 2 (Building Large Language Models) for Stanford CS324: Understanding and Developing Large Language Models (Winter 2022)
  ☆102Updated last year
• facebookresearch / LayerSkip
  Code for "LayerSkip: Enabling Early Exit Inference and Self-Speculative Decoding", ACL 2024
  ☆261Updated 2 weeks ago
• abacaj / train-with-fsdp
  ☆92Updated last year
• mlfoundations / open_lm
  A repository for research on medium sized language models.
  ☆490Updated 2 weeks ago
• FranxYao / Long-Context-Data-Engineering
  Implementation of paper Data Engineering for Scaling Language Models to 128K Context
  ☆450Updated 10 months ago
• CASE-Lab-UMD / LLM-Drop
  The official implementation of the paper "What Matters in Transformers? Not All Attention is Needed".
  ☆158Updated last month
• IBM / ModuleFormer
  ModuleFormer is a MoE-based architecture that includes two different types of experts: stick-breaking attention heads and feedforward exp…
  ☆215Updated 9 months ago
• AlignmentResearch / tuned-lens
  Tools for understanding how transformer predictions are built layer-by-layer
  ☆461Updated 7 months ago
• allenai / olmes
  Reproducible, flexible LLM evaluations
  ☆127Updated last month