Eddie-Wang1120 / Eddie-Wang-Hackathon2023Links
Whisper inference with TensorRT-LLM
☆22Updated last year
Alternatives and similar repositories for Eddie-Wang-Hackathon2023
Users that are interested in Eddie-Wang-Hackathon2023 are comparing it to the libraries listed below
Sorting:
- ☆72Updated 2 years ago
- export llama to onnx☆133Updated 8 months ago
- ☆141Updated last year
- Transformer related optimization, including BERT, GPT☆59Updated last year
- A quantization algorithm for LLM☆140Updated last year
- Universal cross-platform tokenizers binding to HF and sentencepiece☆380Updated 3 weeks ago
- llm-export can export llm model to onnx.☆306Updated this week
- DashInfer is a native LLM inference engine aiming to deliver industry-leading performance atop various hardware architectures, including …☆264Updated 3 weeks ago
- optimized BERT transformer inference on NVIDIA GPU. https://arxiv.org/abs/2210.03052☆476Updated last year
- ☆128Updated 8 months ago
- LLaMa/RWKV onnx models, quantization and testcase☆365Updated 2 years ago
- ☆197Updated 4 months ago
- ASR client for Triton ASR Service☆33Updated 8 months ago
- 使用 cutlass 实现 flash-attention 精简版,具有教学意义☆46Updated last year
- ☆59Updated 9 months ago
- ☆105Updated last week
- Simple Dynamic Batching Inference☆145Updated 3 years ago
- Transformer related optimization, including BERT, GPT☆17Updated 2 years ago
- simplify >2GB large onnx model☆63Updated 9 months ago
- Common source, scripts and utilities for creating Triton backends.☆345Updated last month
- A parser, editor and profiler tool for ONNX models.☆451Updated last month
- Serving Inside Pytorch☆163Updated 3 weeks ago
- symmetric int8 gemm☆67Updated 5 years ago
- The Triton TensorRT-LLM Backend☆887Updated this week
- ☆150Updated 7 months ago
- A Toolkit to Help Optimize Large Onnx Model☆158Updated last year
- ☆125Updated last year
- A powerful toolkit for compressing large models including LLM, VLM, and video generation models.☆555Updated 2 weeks ago
- ☆32Updated 11 months ago
- Transformer related optimization, including BERT, GPT☆39Updated 2 years ago