Oneflow-Inc / oneflow-lite
☆18Updated 10 months ago
Related projects ⓘ
Alternatives and complementary repositories for oneflow-lite
- OneFlow->ONNX☆42Updated last year
- OneFlow Serving☆20Updated 9 months ago
- A toolkit for developers to simplify the transformation of nn.Module instances. It's now corresponding to Pytorch.fx.☆13Updated last year
- ☆11Updated 9 months ago
- ☆23Updated last year
- ☆12Updated last year
- CVFusion is an open-source deep learning compiler to fuse the OpenCV operators.☆26Updated 2 years ago
- study of cutlass☆19Updated 2 weeks ago
- 使用 CUDA C++ 实现的 llama 模型推理框架☆24Updated 2 weeks ago
- ☆32Updated last month
- 分层解耦的深度学习推理引擎☆60Updated 3 months ago
- Tutorials of Extending and importing TVM with CMAKE Include dependency.☆11Updated last month
- An easy way to run, test, benchmark and tune OpenCL kernel files☆23Updated last year
- Standalone Flash Attention v2 kernel without libtorch dependency☆98Updated 2 months ago
- ☆19Updated this week
- 使用 cutlass 仓库在 ada 架构上实现 fp8 的 flash attention☆52Updated 3 months ago
- This is a demo how to write a high performance convolution run on apple silicon☆52Updated 2 years ago
- 将MNN拆解的简易前向推理框架(for study!)☆20Updated 3 years ago
- llm deploy project based onnx.☆26Updated last month
- ☆18Updated 2 years ago
- Decoding Attention is specially optimized for multi head attention (MHA) using CUDA core for the decoding stage of LLM inference.☆26Updated 2 weeks ago
- A standalone GEMM kernel for fp16 activation and quantized weight, extracted from FasterTransformer☆85Updated 8 months ago
- GPTQ inference TVM kernel☆36Updated 6 months ago
- Datasets, Transforms and Models specific to Computer Vision☆83Updated last year
- Yet another Polyhedra Compiler for DeepLearning☆19Updated last year
- ☆14Updated 2 years ago
- Open deep learning compiler stack for cpu, gpu and specialized accelerators☆15Updated this week
- ☆13Updated last year
- ☆24Updated last year