Alternatives and similar repositories for cs324_p2:

Users that are interested in cs324_p2 are comparing it to the libraries listed below

• srush / GPTWorld
  A puzzle to learn about prompting
  ☆124Updated last year
• llm-efficiency-challenge / neurips_llm_efficiency_challenge
  NeurIPS Large Language Model Efficiency Challenge: 1 LLM + 1GPU + 1Day
  ☆255Updated last year
• hundredblocks / large-model-parallelism
  Functional local implementations of main model parallelism approaches
  ☆95Updated last year
• srush / raspy
  An interactive exploration of Transformer programming.
  ☆258Updated last year
• allenai / fm-cheatsheet
  Website for hosting the Open Foundation Models Cheat Sheet.
  ☆262Updated 7 months ago
• xrsrke / pipegoose
  Large scale 4D parallelism pre-training for 🤗 transformers in Mixture of Experts *(still work in progress)*
  ☆81Updated last year
• cloneofsimo / min-fsdp
  ☆75Updated 7 months ago
• google-deepmind / mishax
  ☆121Updated this week
• EleutherAI / nanoGPT-mup
  The simplest, fastest repository for training/finetuning medium-sized GPTs.
  ☆94Updated 2 months ago
• kernelmachine / cbtm
  Code repository for the c-BTM paper
  ☆105Updated last year
• SumanthRH / tokenization
  A comprehensive deep dive into the world of tokens
  ☆218Updated 7 months ago
• normster / llm_rules
  RuLES: a benchmark for evaluating rule-following in language models
  ☆217Updated this week
• huggingface / datablations
  Scaling Data-Constrained Language Models
  ☆333Updated 4 months ago
• stanford-crfm / ecosystem-graphs
  ☆261Updated 3 weeks ago
• cloneofsimo / min-max-gpt
  Minimal (400 LOC) implementation Maximum (multi-node, FSDP) GPT training
  ☆121Updated 9 months ago
• neubig / minllama-assignment
  ☆80Updated 4 months ago
• abacaj / train-with-fsdp
  ☆92Updated last year
• srush / do-we-need-attention
  ☆164Updated last year
• hamelsmu / llama-inference
  experiments with inference on llama
  ☆104Updated 8 months ago
• PiotrNawrot / nano-sparse-attention
  The simplest implementation of recent Sparse Attention patterns for efficient LLM inference.
  ☆56Updated 3 weeks ago
• irregular-rhomboid / EAI-Math-Reading-Group
  Resources from the EleutherAI Math Reading Group
  ☆52Updated last month
• sabetAI / BLoRA
  batched loras
  ☆338Updated last year
• IBM / ModuleFormer
  ModuleFormer is a MoE-based architecture that includes two different types of experts: stick-breaking attention heads and feedforward exp…
  ☆215Updated 10 months ago
• Edward-Sun / gpt-accelera
  Simple and efficient pytorch-native transformer training and inference (batched)
  ☆68Updated 10 months ago
• hydrallm / llama-moe-v1
  ☆94Updated last year
• rasbt / pytorch-memory-optim
  This code repository contains the code used for my "Optimizing Memory Usage for Training LLMs and Vision Transformers in PyTorch" blog po…
  ☆87Updated last year
• google-research / cascades
  Python library which enables complex compositions of language models such as scratchpads, chain of thought, tool use, selection-inference…
  ☆202Updated last month
• srush / Transformer-Puzzles
  Puzzles for exploring transformers
  ☆330Updated last year
• tcapelle / llm_recipes
  A set of scripts and notebooks on LLM finetunning and dataset creation
  ☆102Updated 4 months ago
• neulab / gemini-benchmark
  ☆150Updated last year