Transformer related optimization, including BERT, GPT
☆17Jul 29, 2023Updated 3 years ago
Alternatives and similar repositories for FasterTransformer
Users that are interested in FasterTransformer are comparing it to the libraries listed below. We may earn a commission when you buy through links labeled 'Ad' on this page.
Sorting:
- A high-throughput and memory-efficient inference and serving engine for LLMs☆10Jul 22, 2023Updated 3 years ago
- Transformer related optimization, including BERT, GPT☆39Feb 10, 2023Updated 3 years ago
- Whisper in TensorRT-LLM☆16Sep 21, 2023Updated 3 years ago
- Code and data for EMNLP 2023 research track paper "MarkQA: A large scale KBQA dataset with numerical reasoning"☆13Jan 2, 2024Updated 2 years ago
- using nn.Transformer() module to accomplish a machine learning demo.☆12Mar 23, 2022Updated 4 years ago
- Virtual machines for every use case on DigitalOcean • AdGet dependable uptime with 99.99% SLA, simple security tools, and predictable monthly pricing with DigitalOcean's virtual machines, called Droplets.
- qwen2 and llama3 cpp implementation☆50Jun 7, 2024Updated 2 years ago
- stable diffusion, controlnet, tensorrt, accelerate☆70Apr 28, 2023Updated 3 years ago
- ☆33Apr 19, 2025Updated last year
- ☆13May 25, 2023Updated 3 years ago
- ☆12Sep 4, 2022Updated 4 years ago
- 东北大学计算机/物联网-操作系统课程设计☆12Jun 27, 2019Updated 7 years ago
- A repo for llm on ncnn☆15Jul 5, 2026Updated 3 months ago
- TensorRT☆11Sep 22, 2020Updated 6 years ago
- 天池 NVIDIA TensorRT Hackathon 2023 —— 生成式AI模型优化赛 初赛第三名方案☆50Aug 16, 2023Updated 3 years ago
- AI Agents on DigitalOcean Gradient AI Platform • AdBuild production-ready AI agents using customizable tools or access multiple LLMs through a single endpoint. Create custom knowledge bases or connect external data.
- Revision of official yolov7-pose to support custom dataset for keypoint detection☆11Nov 12, 2023Updated 2 years ago
- A Suite for Parallel Inference of Diffusion Transformers (DiTs) on multi-GPU Clusters☆58May 3, 2026Updated 5 months ago
- optimized BERT transformer inference on NVIDIA GPU. https://arxiv.org/abs/2210.03052☆481Mar 15, 2024Updated 2 years ago
- 使用 CUDA C++ 实现的 llama 模型推理框架☆64Nov 8, 2024Updated last year
- 拳皇97、强化学习、对战游戏、AIAgent、人机交互、云端部署、PPO☆39Nov 16, 2023Updated 2 years ago
- repository for the MICCAI 2022 AutoPET challenge☆14Sep 19, 2022Updated 4 years ago
- ASR, End-to-End, end2end, Speech Recognition, 端到端语音识别☆12Oct 25, 2020Updated 6 years ago
- ☆18Updated this week
- ☆210May 5, 2025Updated last year
- Deploy to Railway using AI coding agents - Free Credits Offer • AdUse Claude Code, Codex, OpenCode, and more. Autonomous software development now has the infrastructure to match with Railway.
- Code repo for "CritiPrefill: A Segment-wise Criticality-based Approach for Prefilling Acceleration in LLMs".☆17Sep 15, 2024Updated 2 years ago
- 东北大学操作系统课设 文件管理系统☆19Jun 17, 2022Updated 4 years ago
- A UI based LLM fine-tuning. It can fine-tune latest open-sourced LLMs on cloud instances (aws) with user defined settings, merge multiple…☆10Jul 23, 2025Updated last year
- a fast and customizable CUDA int4 tensor core gemm☆16Aug 2, 2024Updated 2 years ago
- bilibili视频【CUDA 12.x 并行编程入门(C++版)】配套代码☆34Aug 12, 2024Updated 2 years ago
- ☆128Dec 24, 2024Updated last year
- ☆11Nov 7, 2025Updated 11 months ago
- 多集群使用thanos sidecar+MinIO监控告警☆14Feb 20, 2023Updated 3 years ago
- ☆14May 28, 2019Updated 7 years ago
- Wordpress hosting with auto-scaling - Free Trial Offer • AdFully Managed hosting for WordPress and WooCommerce businesses that need reliable, auto-scalable performance. Cloudways SafeUpdates now available.
- QQQ is an innovative and hardware-optimized W4A8 quantization solution for LLMs.☆162Aug 21, 2025Updated last year
- 逻辑回归和单层softmax的解 析解☆12Jul 29, 2021Updated 5 years ago
- Official implementation of SPACE☆10May 19, 2024Updated 2 years ago
- MACCIA 2022 paper reading notes: tasks and datasets☆12Feb 6, 2023Updated 3 years ago
- https://mp.weixin.qq.com/s/7t0e_hfyDh1b2GPVlzXIMg 或 https://yq.aliyun.com/articles/636272☆11Aug 31, 2018Updated 8 years ago
- Train and inference ExtremeNet in Pytorch! Support Bounding Box and Instance Segmentation train data!!☆12Jan 15, 2020Updated 6 years ago
- Compress BiSeNet with Structure Knowledge Distillation for Real-time image segmentation on wali-TX2☆11Jul 29, 2020Updated 6 years ago