Example of applying CUDA graphs to LLaMA-v2
☆11Aug 25, 2023Updated 2 years ago
Alternatives and similar repositories for llama-cuda-graph-example
Users that are interested in llama-cuda-graph-example are comparing it to the libraries listed below. We may earn a commission when you buy through links labeled 'Ad' on this page.
Sorting:
- Distributed SDDMM Kernel☆12Jul 8, 2022Updated 4 years ago
- Experiment of using Tangent to autodiff triton☆81Jan 22, 2024Updated 2 years ago
- torch.compile artifacts for common deep learning models, can be used as a learning resource for torch.compile☆19Dec 22, 2023Updated 2 years ago
- Pure Java Llama2 inference with optional multi-GPU CUDA implementation☆13Sep 2, 2023Updated 2 years ago
- GPU operators for sparse tensor operations☆37Mar 11, 2024Updated 2 years ago
- Managed hosting for WordPress and PHP on Cloudways • AdManaged hosting for WordPress, Magento, Laravel, or PHP apps, on multiple cloud providers. Deploy in minutes on Cloudways by DigitalOcean.
- Python bindings for OpenSHMEM☆27Updated this week
- Frontend for v2.opyn.co☆11May 28, 2023Updated 3 years ago
- ☆14Jul 13, 2025Updated last year
- A flexible Handlebars view engine for Express☆12Jul 6, 2016Updated 10 years ago
- Storytelling With Matplotlib (SWMat)☆13Jul 25, 2019Updated 7 years ago
- ☆26Sep 9, 2024Updated last year
- train with kittens!☆67Oct 25, 2024Updated last year
- a fast implementation of BM25☆10Sep 15, 2022Updated 3 years ago
- A fork of the PEFT library, supporting Robust Adaptation (RoSA)☆15Aug 16, 2024Updated last year
- Managed hosting for WordPress and PHP on Cloudways • AdManaged hosting for WordPress, Magento, Laravel, or PHP apps, on multiple cloud providers. Deploy in minutes on Cloudways by DigitalOcean.
- Mathematical expression evaluator with just in time code generation.☆12Apr 7, 2013Updated 13 years ago
- Agent application/benchmark/workload traces should be placed here.☆15Apr 13, 2026Updated 3 months ago
- Service for estimating gas on a series of dependent transactions☆19Jun 16, 2023Updated 3 years ago
- This repository contains the results and code for the MLPerf™ Inference v4.0 benchmark.☆11Jul 24, 2025Updated last year
- JAX Scalify: end-to-end scaled arithmetics☆18Oct 30, 2024Updated last year
- CUDA C simple application for Nvidia's GPU☆11Jun 7, 2022Updated 4 years ago
- ☆12Mar 31, 2021Updated 5 years ago
- ☆36Dec 6, 2022Updated 3 years ago
- A pytorch implementation of focal loss☆10Jan 9, 2020Updated 6 years ago
- Bare Metal GPUs on DigitalOcean Gradient AI • AdPurpose-built for serious AI teams training foundational models, running large-scale inference, and pushing the boundaries of what's possible.
- UVA command line client to upload solutions and search for statistics☆10Dec 23, 2016Updated 9 years ago
- IPFS-related scripts and utilities☆14Sep 23, 2021Updated 4 years ago
- ☆12Jun 3, 2019Updated 7 years ago
- [IEEE CAL 2025] Accelerating Page Migrations in Operating Systems with Intel DSA☆16Nov 20, 2024Updated last year
- ☆13Jan 7, 2025Updated last year
- ☆18Feb 9, 2026Updated 5 months ago
- Unleash the full potential of exascale LLMs on consumer-class GPUs, proven by extensive benchmarks, with no long-term adjustments and min…☆27Nov 11, 2024Updated last year
- A standalone GEMM kernel for fp16 activation and quantized weight, extracted from FasterTransformer☆96Jun 21, 2026Updated last month
- Accelerating GPU Data Processing using FastLanes Compression☆19May 9, 2024Updated 2 years ago
- Deploy to Railway using AI coding agents - Free Credits Offer • AdUse Claude Code, Codex, OpenCode, and more. Autonomous software development now has the infrastructure to match with Railway.
- ☆14May 25, 2023Updated 3 years ago
- Keyformer proposes KV Cache reduction through key tokens identification and without the need for fine-tuning☆57Mar 26, 2024Updated 2 years ago
- Higher order component to handle merging callbacks, prefixing classnames and props passthrough.☆21Jul 23, 2015Updated 11 years ago
- Demonstration that finetuning RoPE model on larger sequences than the pre-trained model adapts the model context limit☆62Jun 21, 2023Updated 3 years ago
- Inference Llama/Llama2/Llama3 Modes in NumPy☆21Nov 22, 2023Updated 2 years ago
- ☆26Nov 23, 2023Updated 2 years ago
- rdiv!(::AbstractMatrix, ::UpperTriangular) and ldiv!(::LowerTriangular, ::AbstractMatrix)☆11Nov 18, 2024Updated last year