second-state / meetupsLinks
☆70Updated 10 months ago
Alternatives and similar repositories for meetups
Users that are interested in meetups are comparing it to the libraries listed below
Sorting:
- ☆58Updated 5 years ago
- ☆130Updated last year
- Transformer related optimization, including BERT, GPT☆17Updated 2 years ago
- DashInfer is a native LLM inference engine aiming to deliver industry-leading performance atop various hardware architectures, including …☆274Updated 6 months ago
- ☆74Updated this week
- export llama to onnx☆137Updated last year
- LLM Inference benchmark☆433Updated last year
- ☆79Updated 2 years ago
- Inferflow is an efficient and highly configurable inference engine for large language models (LLMs).☆251Updated last year
- Compare different hardware platforms via the Roofline Model for LLM inference tasks.☆120Updated last year
- ☆27Updated last year
- ☆523Updated 2 weeks ago
- CPM.cu is a lightweight, high-performance CUDA implementation for LLMs, optimized for end-device inference and featuring cutting-edge tec…☆225Updated 3 weeks ago
- A high performance, high expansion, easy to use framework for AI application. 为AI应用的开发者提供一套统一的高性能、易用的编程框架，快速基于AI全栈服务、开发跨端边云的AI行业应用，支持GPU，…☆160Updated last year
- ☆183Updated last week
- ☆60Updated last year
- llm-export can export llm model to onnx.☆343Updated 3 months ago
- Pretrain, finetune and serve LLMs on Intel platforms with Ray☆131Updated 4 months ago
- DeepLearning Framework Performance Profiling Toolkit☆296Updated 3 years ago
- LLaMa/RWKV onnx models, quantization and testcase☆366Updated 2 years ago
- 配合 HAI Platform 使用的集成化用户界面☆53Updated 2 years ago
- 关于自建AI推理引擎的手册，从0开始你需要知道的所有事情☆272Updated 3 years ago
- AI Accelerator Benchmark focuses on evaluating AI Accelerators from a practical production perspective, including the ease of use and ver…☆298Updated 2 weeks ago
- ☆25Updated 2 years ago
- ☆437Updated 4 months ago
- ☆141Updated last year
- llm-inference is a platform for publishing and managing llm inference, providing a wide range of out-of-the-box features for model deploy…☆91Updated last year
- A prefill & decode disaggregated LLM serving framework with shared GPU memory and fine-grained compute isolation.☆123Updated last month
- Transformer related optimization, including BERT, GPT☆39Updated 2 years ago
- optimized BERT transformer inference on NVIDIA GPU. https://arxiv.org/abs/2210.03052☆477Updated last year