THUDM/FasterTransformer external links

---

GitHub - View repository

GitHub.dev - Open in online code editor

Star history - Growth chart over time

deps.dev - Dependencies and security vulnerabilities

Gitingest - Export source code for LLM usage

Repomix - Export source code for LLM usage

uithub - Export source code for LLM usage

Close

THUDM/FasterTransformer

Readme badge preview -

If you own this repo, copy the snippet below and add it to your README.md

---

Copy

[![RelatedRepos](https://img.shields.io/badge/related-repos-yellow)](https://relatedrepos.com/gh/THUDM/FasterTransformer)

Close

THUDM / FasterTransformerView on GitHubMore

• External links
• Readme badge

Transformer related optimization, including BERT, GPT

☆39Feb 10, 2023Updated 3 years ago

Alternatives and similar repositories for FasterTransformer

Users that are interested in FasterTransformer are comparing it to the libraries listed below

• Rayrtfr / FasterTransformer

  View on GitHub
  Transformer related optimization, including BERT, GPT
  ☆17Jul 29, 2023Updated 2 years ago
• Oneflow-Inc / one-glm

  View on GitHub
  A more efficient GLM implementation!
  ☆54Feb 18, 2023Updated 3 years ago
• triton-inference-server / hugectr_backend

  View on GitHub
  ☆57Oct 17, 2023Updated 2 years ago
• THUDM / MRT

  View on GitHub
  MRT: Tracing the Evolution of Scientific Publications (TKDE 2021)
  ☆18Mar 23, 2023Updated 2 years ago
• THUDM / Efficient-Head-Finetuning

  View on GitHub
  Source code for EMNLP2022 long paper: Parameter-Efficient Tuning Makes a Good Classification Head
  ☆14Nov 7, 2022Updated 3 years ago
• void-main / FasterTransformer

  View on GitHub
  Transformer related optimization, including BERT, GPT
  ☆59Sep 20, 2023Updated 2 years ago
• bytedance / ByteTransformer

  View on GitHub
  optimized BERT transformer inference on NVIDIA GPU. https://arxiv.org/abs/2210.03052
  ☆477Mar 15, 2024Updated 2 years ago
• triton-inference-server / fastertransformer_backend

  View on GitHub
  ☆413Nov 11, 2023Updated 2 years ago
• THUDM / paper-source-trace

  View on GitHub
  ☆18Sep 29, 2024Updated last year
• dingyuqing05 / trt2022_wenet

  View on GitHub
  ☆70Dec 9, 2022Updated 3 years ago
• simon-mo / vLLM-Benchmark

  View on GitHub
  ☆32Apr 19, 2025Updated 11 months ago
• THUDM / BatchSampler

  View on GitHub
  The source code for BatchSampler that accepted in KDD'23
  ☆19Aug 9, 2023Updated 2 years ago
• void-main / fastertransformer_backend

  View on GitHub
  ☆22Jul 11, 2023Updated 2 years ago
• THUDM / Multilingual-GLM

  View on GitHub
  The multilingual variant of GLM, a general language model trained with autoregressive blank infilling objective
  ☆62Nov 19, 2022Updated 3 years ago
• Connum / npm-pinyin2ipa

  View on GitHub
  Converts Mandarin Chinese pinyin notation to IPA (international phonetic alphabet) notation
  ☆18Nov 28, 2023Updated 2 years ago
• THUDM / iPrompt

  View on GitHub
  Code, Data and Demo for Paper: Controllable Generation from Pre-trained Language Models via Inverse Prompting
  ☆124Dec 14, 2022Updated 3 years ago
• THUDM / Tsinghua-ML-Course

  View on GitHub
  Course Materials for ML Course at Tsinghua
  ☆27Dec 17, 2019Updated 6 years ago
• NVIDIA / FasterTransformer

  View on GitHub
  Transformer related optimization, including BERT, GPT
  ☆6,397Mar 27, 2024Updated last year
• ssbuild / llm_rlhf

  View on GitHub
  realize the reinforcement learning training for gpt2 llama bloom and so on llm model
  ☆27Sep 19, 2023Updated 2 years ago
• THUDM / FastLDM

  View on GitHub
  Inference speed-up for stable-diffusion (ldm) with TensorRT.
  ☆35Jun 19, 2023Updated 2 years ago
• wangguojim / LargeScale

  View on GitHub
  ☆19May 11, 2024Updated last year
• jinlanfu / Polyglot_Prompt

  View on GitHub
  Code and dataset for Polyglot Prompting: Multilingual Multitask Prompt Training.
  ☆18Dec 7, 2022Updated 3 years ago
• liutianlin0121 / decoding-time-realignment

  View on GitHub
  Implementation of "Decoding-time Realignment of Language Models", ICML 2024.
  ☆21Jun 17, 2024Updated last year
• neural-dialogue-metrics / EmbeddingBased

  View on GitHub
  Embedding-based evaluation metrics for dialogue generation.
  ☆15Jan 8, 2023Updated 3 years ago
• benob / openfst-utils

  View on GitHub
  Utilities for manipulating finite state transducers with the OpenFst library.
  ☆32Sep 22, 2017Updated 8 years ago
• vtsynergy / bb_segsort

  View on GitHub
  ☆21Aug 21, 2023Updated 2 years ago
• wuch15 / HiTransformer

  View on GitHub
  ACL 2021: HiTransformer
  ☆13May 29, 2021Updated 4 years ago
• LLM360 / TxT360

  View on GitHub
  ☆23Dec 18, 2024Updated last year
• blackboxnlp / 2020

  View on GitHub
  ☆11Nov 20, 2020Updated 5 years ago
• li-yanhao / masksim

  View on GitHub
  Official code of paper "MaskSim: Detection of synthetic images by masked spectrum similarity analysis", CVPRW 2024.
  ☆16Jul 16, 2025Updated 8 months ago
• multi-swe-bench / MagentLess

  View on GitHub
  ☆12Jul 31, 2025Updated 7 months ago
• THUDM / icetk

  View on GitHub
  A unified tokenization tool for Images, Chinese and English.
  ☆153Mar 23, 2023Updated 2 years ago
• NVIDIA / HMM_sample_code

  View on GitHub
  CUDA 12.2 HMM demos
  ☆20Jul 26, 2024Updated last year
• THUDM / SwissArmyTransformer

  View on GitHub
  SwissArmyTransformer is a flexible and powerful library to develop your own Transformer variants.
  ☆1,115Dec 26, 2024Updated last year
• BaofengZan / hard_decode_trt-windows

  View on GitHub
  https://github.com/shouxieai/hard_decode_trt windows编译版本
  ☆13Sep 8, 2022Updated 3 years ago
• cameronfr / FasterTransformer

  View on GitHub
  Transformer related optimization, including BERT, GPT
  ☆14Jun 27, 2023Updated 2 years ago
• alanshi / charset_mnbvc

  View on GitHub
  本项目旨在对大量文本文件进行快速编码检测和转换以辅助mnbvc语料集项目的数据清洗工作
  ☆70Oct 17, 2025Updated 5 months ago
• OpenBMB / cpm_kernels

  View on GitHub
  ☆26Oct 2, 2023Updated 2 years ago
• matthewmorrone / cmudict-ipa

  View on GitHub
  CMU dictionary in IPA instead of their subset of Arpabet
  ☆16Sep 24, 2024Updated last year