bigeagle / picoGPTLinks
☆44Updated 2 years ago
Alternatives and similar repositories for picoGPT
Users that are interested in picoGPT are comparing it to the libraries listed below
Sorting:
- Programming exercises for kids (no prior programming experience required)☆16Updated last year
- TVMScript kernel for deformable attention☆25Updated 3 years ago
- This is a demo how to write a high performance convolution run on apple silicon☆54Updated 3 years ago
- InsNet Runs Instance-dependent Neural Networks with Padding-free Dynamic Batching.☆66Updated 3 years ago
- Benchmark scripts for TVM☆74Updated 3 years ago
- An easy way to run, test, benchmark and tune OpenCL kernel files☆23Updated 2 years ago
- ONNX Command-Line Toolbox☆35Updated 10 months ago
- A high-throughput and memory-efficient inference and serving engine for LLMs☆17Updated last year
- torch::deploy (multipy for non-torch uses) is a system that lets you get around the GIL problem by running multiple Python interpreters i…☆180Updated this week
- ☆12Updated 2 years ago
- ☆22Updated 5 years ago
- Simple Dynamic Batching Inference☆145Updated 3 years ago
- Inference framework for MoE layers based on TensorRT with Python binding☆41Updated 4 years ago
- Yet another Polyhedra Compiler for DeepLearning☆19Updated 2 years ago
- Place for meetup slides☆140Updated 4 years ago
- TensorFlow and TVM integration☆37Updated 5 years ago
- 跨平台的容器化Linux桌面环境☆72Updated 6 months ago
- A library for syntactically rewriting Python programs, pronounced (sinner).☆69Updated 3 years ago
- Efficient inference of large language models.☆151Updated this week
- Distributed DataLoader For Pytorch Based On Ray☆24Updated 3 years ago
- DLPack for Tensorflow☆35Updated 5 years ago
- Static analysis framework for analyzing programs written in TVM's Relay IR.☆28Updated 5 years ago
- CVFusion is an open-source deep learning compiler to fuse the OpenCV operators.☆31Updated 3 years ago
- Build TVM docker image for production compilation deployments☆12Updated 3 years ago
- ☆92Updated 3 months ago
- Dynamic Tensor Rematerialization prototype (modified PyTorch) and simulator. Paper: https://arxiv.org/abs/2006.09616☆132Updated 2 years ago
- Benchmark of TVM quantized model on CUDA☆111Updated 5 years ago
- GPTQ inference TVM kernel☆40Updated last year
- A communication library for deep learning☆51Updated last year
- Sandbox for TVM and playing around!☆22Updated 2 years ago