Rayrtfr/FasterTransformer external links

---

GitHub - View repository

GitHub.dev - Open in online code editor

Star history - Growth chart over time

deps.dev - Dependencies and security vulnerabilities

Gitingest - Export source code for LLM usage

Repomix - Export source code for LLM usage

uithub - Export source code for LLM usage

Close

Rayrtfr/FasterTransformer

Readme badge preview -

If you own this repo, copy the snippet below and add it to your README.md

---

Copy

[![RelatedRepos](https://img.shields.io/badge/related-repos-yellow)](https://relatedrepos.com/gh/Rayrtfr/FasterTransformer)

Close

Rayrtfr / FasterTransformerView on GitHubMore

• External links
• Readme badge

Transformer related optimization, including BERT, GPT

☆17Jul 29, 2023Updated 2 years ago

Alternatives and similar repositories for FasterTransformer

Users that are interested in FasterTransformer are comparing it to the libraries listed below. We may earn a commission when you buy through links labeled 'Ad' on this page.

• THUDM / FasterTransformer

  View on GitHub
  Transformer related optimization, including BERT, GPT
  ☆39Feb 10, 2023Updated 3 years ago
• EdVince / whisper-trtllm

  View on GitHub
  Whisper in TensorRT-LLM
  ☆17Sep 21, 2023Updated 2 years ago
• yvonwin / qwen2.cpp

  View on GitHub
  qwen2 and llama3 cpp implementation
  ☆50Jun 7, 2024Updated last year
• simon-mo / vLLM-Benchmark

  View on GitHub
  ☆32Apr 19, 2025Updated 11 months ago
• chenlian-zhou / people_relation_extract

  View on GitHub
  ☆13Mar 24, 2023Updated 3 years ago
• Proton VPN Special Offer - Get 70% off • Ad
  Special partner offer. Trusted by over 100 million users worldwide. Tested, Approved and Recommended by Experts.
• hnsywangxin / controlnet_stable_tensorrt

  View on GitHub
  stable diffusion, controlnet, tensorrt, accelerate
  ☆105Apr 28, 2023Updated 2 years ago
• Xiao-Hu-Z / pointpillars_int8

  View on GitHub
  ☆30Mar 27, 2023Updated 3 years ago
• PipeFusion / PipeFusion

  View on GitHub
  A Suite for Parallel Inference of Diffusion Transformers (DiTs) on multi-GPU Clusters
  ☆58Jul 23, 2024Updated last year
• mzbac / qlora-inference-multi-gpu

  View on GitHub
  ☆13May 25, 2023Updated 2 years ago
• 834810071 / NEU_OS

  View on GitHub
  东北大学计算机/物联网-操作系统课程设计
  ☆12Jun 27, 2019Updated 6 years ago
• dingyuqing05 / trt2022_wenet

  View on GitHub
  ☆70Dec 9, 2022Updated 3 years ago
• HydraQYH / hp_rms_norm

  View on GitHub
  High performance RMSNorm Implement by using SM Core Storage(Registers and Shared Memory)
  ☆30Jan 22, 2026Updated 2 months ago
• maxiaosong1124 / ncu-cuda-profiling-skill

  View on GitHub
  let coding agents use ncu skills analysis cuda program automatically!
  ☆82Feb 5, 2026Updated 2 months ago
• caiwanxianhust / FasterLLaMA

  View on GitHub
  使用 CUDA C++ 实现的 llama 模型推理框架
  ☆65Nov 8, 2024Updated last year
• Proton VPN Special Offer - Get 70% off • Ad
  Special partner offer. Trusted by over 100 million users worldwide. Tested, Approved and Recommended by Experts.
• bytedance / ByteTransformer

  View on GitHub
  optimized BERT transformer inference on NVIDIA GPU. https://arxiv.org/abs/2210.03052
  ☆479Mar 15, 2024Updated 2 years ago
• alibaba / rtp-llm

  View on GitHub
  RTP-LLM: Alibaba's high-performance LLM inference engine for diverse applications.
  ☆1,080Updated this week
• triton-inference-server / fastertransformer_backend

  View on GitHub
  ☆412Nov 11, 2023Updated 2 years ago
• coderonion / cuda-beginner-course-cpp-version

  View on GitHub
  bilibili视频【CUDA 12.x 并行编程入门(C++版)】配套代码
  ☆34Aug 12, 2024Updated last year
• NVlabs / RocketKV

  View on GitHub
  [ICML 2025] RocketKV: Accelerating Long-Context LLM Inference via Two-Stage KV Cache Compression
  ☆39Aug 7, 2025Updated 8 months ago
• YigePeng / AutoPET_False_Positive_Reduction

  View on GitHub
  repository for the MICCAI 2022 AutoPET challenge
  ☆14Sep 19, 2022Updated 3 years ago
• OpenPPL / ppl.llm.serving

  View on GitHub
  ☆128Dec 24, 2024Updated last year
• iamyb / mobileunet

  View on GitHub
  A lightweight UNet implementation, using Keras
  ☆14Jan 16, 2020Updated 6 years ago
• hyhuang00 / moe_inference

  View on GitHub
  Code Repository for the NeurIPS 2024 Paper "Toward Efficient Inference for Mixture of Experts".
  ☆19Oct 30, 2024Updated last year
• NordVPN Special Discount Offer • Ad
  Save on top-rated NordVPN 1 or 2-year plans with secure browsing, privacy protection, and support for for all major platforms.
• bytedance-iaas / vllm

  View on GitHub
  A high-throughput and memory-efficient inference and serving engine for LLMs
  ☆13Oct 10, 2025Updated 6 months ago
• 66RING / CritiPrefill

  View on GitHub
  Code repo for "CritiPrefill: A Segment-wise Criticality-based Approach for Prefilling Acceleration in LLMs".
  ☆16Sep 15, 2024Updated last year
• manyeyes / K2TransducerAsr

  View on GitHub
  c# library for decoding K2 transducer Models，used in speech recognition (ASR)
  ☆13Aug 20, 2025Updated 7 months ago
• HandH1998 / QQQ

  View on GitHub
  QQQ is an innovative and hardware-optimized W4A8 quantization solution for LLMs.
  ☆154Aug 21, 2025Updated 7 months ago
• cuiliang0302 / thanos-install

  View on GitHub
  多集群使用thanos sidecar+MinIO监控告警
  ☆15Feb 20, 2023Updated 3 years ago
• frk-tt / yolov9-tensorrt

  View on GitHub
  Yolov9 TensorRT Inference Python backend
  ☆35Mar 16, 2024Updated 2 years ago
• xdit-project / DistVAE

  View on GitHub
  A parallelism VAE avoids OOM for high resolution image generation
  ☆89Mar 12, 2026Updated 3 weeks ago
• NinV / CppND-Capstone-DeepSORT

  View on GitHub
  ☆12May 20, 2020Updated 5 years ago
• xjtulyc / MICCAI2022_paper_reading

  View on GitHub
  MACCIA 2022 paper reading notes: tasks and datasets
  ☆12Feb 6, 2023Updated 3 years ago
• Managed Kubernetes at scale on DigitalOcean • Ad
  DigitalOcean Kubernetes includes the control plane, bandwidth allowance, container registry, automatic updates, and more for free.
• yangyifei729 / KVSharer

  View on GitHub
  Source code of paper ''KVSharer: Efficient Inference via Layer-Wise Dissimilar KV Cache Sharing''
  ☆31Oct 24, 2024Updated last year
• hackerxiaobai / NER

  View on GitHub
  pytorch版的命名实体识别，LSTM和LSTM_CRF
  ☆25Aug 16, 2019Updated 6 years ago
• DataXujing / boston_model

  View on GitHub
  https://mp.weixin.qq.com/s/7t0e_hfyDh1b2GPVlzXIMg 或 https://yq.aliyun.com/articles/636272
  ☆11Aug 31, 2018Updated 7 years ago
• bojone / analytical-classification

  View on GitHub
  逻辑回归和单层softmax的解析解
  ☆12Jul 29, 2021Updated 4 years ago
• morsoli / llmbenchmark

  View on GitHub
  大模型API性能指标比较 - 深入分析TTFT、TPS等关键指标
  ☆20Sep 12, 2024Updated last year
• lixiuhong / implicit_gemm_convolution

  View on GitHub
  ☆14May 28, 2019Updated 6 years ago
• tts-tutorial / ijcai2021

  View on GitHub
  ☆13Apr 4, 2023Updated 3 years ago