google-deepmind / recurrentgemma

Related projects ⓘ

Alternatives and complementary repositories for recurrentgemma

• BobMcDear / attorch
  A subset of PyTorch's neural network modules, written in Python using OpenAI's Triton.
  ☆479Updated 2 weeks ago
• Cerebras / gigaGPT
  a small code base for training large models
  ☆264Updated last week
• lucidrains / ring-attention-pytorch
  Implementation of 💍 Ring Attention, from Liu et al. at Berkeley AI, in Pytorch
  ☆474Updated 2 weeks ago
• srush / annotated-mamba
  Annotated version of the Mamba paper
  ☆455Updated 8 months ago
• hao-ai-lab / Consistency_LLM
  [ICML 2024] CLLMs: Consistency Large Language Models
  ☆350Updated 3 months ago
• microsoft / Samba
  Official implementation of "Samba: Simple Hybrid State Space Models for Efficient Unlimited Context Language Modeling"
  ☆801Updated 2 months ago
• apple / ml-sigma-reparam
  ☆292Updated 4 months ago
• huggingface / nanotron
  Minimalistic large language model 3D-parallelism training
  ☆1,227Updated this week
• tspeterkim / flash-attention-minimal
  Flash Attention in ~100 lines of CUDA (forward pass only)
  ☆609Updated 7 months ago
• KellerJordan / modded-nanogpt
  NanoGPT (124M) quality in 8.2 minutes
  ☆946Updated this week
• pytorch-labs / attention-gym
  Helpful tools and examples for working with flex-attention
  ☆460Updated 2 weeks ago
• google-deepmind / nanodo
  ☆197Updated 3 months ago
• LambdaLabsML / distributed-training-guide
  Best practices & guides on how to write distributed pytorch training code
  ☆278Updated this week
• HazyResearch / m2
  Repo for "Monarch Mixer: A Simple Sub-Quadratic GEMM-Based Architecture"
  ☆536Updated 5 months ago
• haoliuhl / ringattention
  Transformers with Arbitrarily Large Context
  ☆637Updated 2 months ago
• tysam-code / hlb-gpt
  Minimalistic, extremely fast, and hackable researcher's toolbench for GPT models in 307 lines of code. Reaches <3.8 validation loss on wi…
  ☆332Updated 3 months ago
• rwitten / HighPerfLLMs2024
  ☆223Updated 3 months ago
• mobiusml / hqq
  Official implementation of Half-Quadratic Quantization (HQQ)
  ☆698Updated last week
• gautierdag / bpeasy
  Fast bare-bones BPE for modern tokenizer training
  ☆142Updated 2 weeks ago
• srush / Triton-Puzzles
  Puzzles for learning Triton
  ☆1,068Updated last month
• facebookresearch / optimizers
  For optimization algorithm research and development.
  ☆408Updated this week
• Zyphra / Zamba2
  PyTorch implementation of models from the Zamba2 series.
  ☆158Updated 2 months ago
• HazyResearch / ThunderKittens
  Tile primitives for speedy kernels
  ☆1,629Updated this week
• facebookresearch / searchformer
  Official codebase for the paper "Beyond A* Better Planning with Transformers via Search Dynamics Bootstrapping".
  ☆313Updated 4 months ago
• mlfoundations / MINT-1T
  MINT-1T: A one trillion token multimodal interleaved dataset.
  ☆770Updated 3 months ago
• mistralai-sf24 / hackathon
  ☆448Updated 7 months ago
• magicproduct / hash-hop
  Long context evaluation for large language models
  ☆185Updated this week
• IST-DASLab / qmoe
  Code for the paper "QMoE: Practical Sub-1-Bit Compression of Trillion-Parameter Models".
  ☆261Updated last year