IBM / dolomite-engine

Related projects ⓘ

Alternatives and complementary repositories for dolomite-engine

• bigcode-project / bigcode-inference-benchmark
  ☆17Updated 3 months ago
• mgmalek / efficient_cross_entropy
  ☆77Updated 5 months ago
• amirzandieh / HyperAttention
  Triton Implementation of HyperAttention Algorithm
  ☆46Updated 11 months ago
• sustcsonglin / mamba-triton
  ☆45Updated 9 months ago
• hadasah / btm
  ☆71Updated 6 months ago
• EleutherAI / rnngineering
  Engineering the state of RNN language models (Mamba, RWKV, etc.)
  ☆32Updated 5 months ago
• Edward-Sun / gpt-accelera
  Simple and efficient pytorch-native transformer training and inference (batched)
  ☆61Updated 7 months ago
• Doraemonzzz / Awesome-Triton-Resources
  Awesome Triton Resources
  ☆18Updated last month
• athms / mad-lab
  A MAD laboratory to improve AI architecture designs 🧪
  ☆95Updated 6 months ago
• IBM / ensemble-instruct
  codebase release for EMNLP2023 paper publication
  ☆19Updated 8 months ago
• srush / mamba-scans
  Blog post
  ☆16Updated 9 months ago
• proger / nanokitchen
  Parallel Associative Scan for Language Models
  ☆18Updated 10 months ago
• allenai / bff
  ☆38Updated 7 months ago
• kyo-takano / chinchilla
  A toolkit for scaling law research ⚖
  ☆43Updated 8 months ago
• google-research-datasets / QAmeleon
  QAmeleon introduces synthetic multilingual QA data using PaLM, a 540B large language model. This dataset was generated by prompt tuning P…
  ☆34Updated last year
• ZurichNLP / mbr
  Minimum Bayes Risk Decoding for Hugging Face Transformers
  ☆56Updated 5 months ago
• HazyResearch / prefix-linear-attention
  ☆45Updated 4 months ago
• microsoft / mutransformers
  some common Huggingface transformers in maximal update parametrization (µP)
  ☆76Updated 2 years ago
• UKPLab / on-emergence
  Codes and files for the paper Are Emergent Abilities in Large Language Models just In-Context Learning
  ☆34Updated 8 months ago
• CLAIRE-Labo / StructuredFFN
  The official code of "Building on Efficient Foundations: Effectively Training LLMs with Structured Feedforward Layers"
  ☆14Updated 3 months ago
• EleutherAI / mdl
  Minimum Description Length probing for neural network representations
  ☆16Updated last week
• erfanzar / jax-flash-attn2
  Flash Attention Implementation with Multiple Backend Support and Sharding This module provides a flexible implementation of Flash Attenti…
  ☆18Updated this week
• sjelassi / transformers_ssm_copy
  ☆24Updated 8 months ago
• siyan-zhao / prepacking
  The source code of our work "Prepacking: A Simple Method for Fast Prefilling and Increased Throughput in Large Language Models"
  ☆56Updated last month
• renll / SeqBoat
  [NeurIPS 2023] Sparse Modular Activation for Efficient Sequence Modeling
  ☆35Updated 11 months ago
• berlino / seq_icl
  ☆50Updated 6 months ago
• PiotrNawrot / nano-sparse-attention
  The simplest implementation of recent Sparse Attention patterns for efficient LLM inference.
  ☆37Updated this week
• GSYfate / knnlm-limits
  Official code repo for paper "Great Memory, Shallow Reasoning: Limits of kNN-LMs"
  ☆18Updated 2 months ago
• lucaslingle / mu_transformer
  Transformer with Mu-Parameterization, implemented in Jax/Flax. Supports FSDP on TPU pods.
  ☆29Updated 2 weeks ago