Alternatives and similar repositories for Eddie-Wang-Hackathon2023:

Users that are interested in Eddie-Wang-Hackathon2023 are comparing it to the libraries listed below

• dingyuqing05 / trt2022_wenet
  ☆71Updated 2 years ago
• yuekaizhang / Triton-ASR-Client
  ASR client for Triton ASR Service
  ☆23Updated last month
• luchangli03 / export_llama_to_onnx
  export llama to onnx
  ☆111Updated 3 weeks ago
• bytedance / decoupleQ
  A quantization algorithm for LLM
  ☆108Updated 6 months ago
• void-main / FasterTransformer
  Transformer related optimization, including BERT, GPT
  ☆59Updated last year
• torchpipe / torchpipe
  Serving Inside Pytorch
  ☆150Updated 3 weeks ago
• huismiling / wenet_trt8
  ☆74Updated 2 years ago
• tpoisonooo / chgemm
  symmetric int8 gemm
  ☆66Updated 4 years ago
• tpoisonooo / llama.onnx
  LLaMa/RWKV onnx models, quantization and testcase
  ☆356Updated last year
• OpenPPL / ppl.nn.llm
  ☆140Updated 8 months ago
• luchangli03 / onnxsim_large_model
  simplify >2GB large onnx model
  ☆51Updated last month
• mlc-ai / tokenizers-cpp
  Universal cross-platform tokenizers binding to HF and sentencepiece
  ☆298Updated 2 months ago
• Rayrtfr / FasterTransformer
  Transformer related optimization, including BERT, GPT
  ☆17Updated last year
• OpenPPL / ppl.llm.serving
  ☆127Updated 3 weeks ago
• Bruce-Lee-LY / flash_attention_inference
  Performance of the C++ interface of flash attention and flash attention v2 in large language model (LLM) inference scenarios.
  ☆34Updated 4 months ago
• tsingmicro-toolchain / OnnxSlim
  A Toolkit to Help Optimize Large Onnx Model
  ☆152Updated 8 months ago
• Slyne / ctc_decoder
  A ctc decoder for both online and offline asr model
  ☆61Updated last year
• nvidia-riva / riva-asrlib-decoder
  Standalone implementation of the CUDA-accelerated WFST Decoder available in Riva
  ☆83Updated last month
• wangzhaode / llm-export
  llm-export can export llm model to onnx.
  ☆257Updated this week
• weishengying / tiny-flash-attention
  使用 cutlass 实现 flash-attention 精简版，具有教学意义
  ☆34Updated 5 months ago
• neuralmagic / AutoFP8
  ☆168Updated 3 months ago
• Mashiro009 / wenet-onnx
  ☆30Updated 3 years ago
• csukuangfj / kaldi-native-fbank
  Kaldi-compatible online fbank extractor without external dependencies
  ☆84Updated last month
• THUDM / FasterTransformer
  Transformer related optimization, including BERT, GPT
  ☆39Updated last year
• daquexian / faster-rwkv
  ☆124Updated last year
• TowerYsable / ASR_awesome
  语音识别 论文 前沿
  ☆43Updated 3 years ago
• YellowOldOdd / SDBI
  Simple Dynamic Batching Inference
  ☆145Updated 2 years ago
• inisis / OnnxSlim
  A Toolkit to Help Optimize Onnx Model
  ☆102Updated this week
• OpenPPL / ppl.pmx
  ☆57Updated last month
• FlagOpen / FlagAttention
  A collection of memory efficient attention operators implemented in the Triton language.
  ☆229Updated 7 months ago