Eddie-Wang1120 / Eddie-Wang-Hackathon2023

Related projects ⓘ

Alternatives and complementary repositories for Eddie-Wang-Hackathon2023

• dingyuqing05 / trt2022_wenet
  ☆70Updated last year
• luchangli03 / export_llama_to_onnx
  export llama to onnx
  ☆95Updated 5 months ago
• huismiling / wenet_trt8
  ☆74Updated 2 years ago
• bytedance / decoupleQ
  A quantization algorithm for LLM
  ☆101Updated 4 months ago
• weishengying / tiny-flash-attention
  使用 cutlass 实现 flash-attention 精简版，具有教学意义
  ☆32Updated 3 months ago
• torchpipe / torchpipe
  Serving Inside Pytorch
  ☆142Updated last week
• wangzhaode / llm-export
  llm-export can export llm model to onnx.
  ☆226Updated last week
• OpenPPL / ppl.nn.llm
  ☆140Updated 6 months ago
• csukuangfj / kaldi-native-fbank
  Kaldi-compatible online fbank extractor without external dependencies
  ☆78Updated 2 weeks ago
• tsingmicro-toolchain / OnnxSlim
  A Toolkit to Help Optimize Large Onnx Model
  ☆146Updated 5 months ago
• Mashiro009 / wenet-onnx
  ☆30Updated 3 years ago
• OpenPPL / ppl.pmx
  ☆57Updated this week
• luchangli03 / onnxsim_large_model
  simplify >2GB large onnx model
  ☆43Updated 8 months ago
• Bruce-Lee-LY / flash_attention_inference
  Performance of the C++ interface of flash attention and flash attention v2 in large language model (LLM) inference scenarios.
  ☆28Updated 2 months ago
• tpoisonooo / chgemm
  symmetric int8 gemm
  ☆66Updated 4 years ago
• void-main / FasterTransformer
  Transformer related optimization, including BERT, GPT
  ☆60Updated last year
• gesanqiu / Chinese_MobileBert_on_SNPE
  Run Chinese MobileBert model on SNPE.
  ☆13Updated last year
• EdVince / llm-cpp
  ☆28Updated 3 months ago
• lym0302 / paddlespeech_tts_cpp
  PaddleSpeech TTS cpp
  ☆35Updated last year
• OpenPPL / ppl.llm.serving
  ☆123Updated this week
• YellowOldOdd / SDBI
  Simple Dynamic Batching Inference
  ☆145Updated 2 years ago
• Slyne / ctc_decoder
  A ctc decoder for both online and offline asr model
  ☆58Updated 11 months ago
• DeepVAC / libdeepvac
  Use PyTorch model in C++ project
  ☆135Updated 3 years ago
• xiatwhu / baidu_topk
  ☆12Updated 11 months ago
• Mashiro009 / wenet-online-decoder-onnx
  ☆34Updated 3 years ago
• tpoisonooo / llama.onnx
  LLaMa/RWKV onnx models, quantization and testcase
  ☆350Updated last year
• chenyangMl / keyword-spot
  端到端语音唤醒工具箱，从模型训练到模型推理。
  ☆73Updated 2 months ago
• TRT2022 / trtllm-llama
  ☢️ TensorRT 2023复赛——基于TensorRT-LLM的Llama模型推断加速优化
  ☆44Updated last year
• DataXujing / ASR-paper
  ASR教程: https://dataxujing.github.io/ASR-paper/
  ☆23Updated 4 months ago
• Tlntin / trt2023
  ☆23Updated last year