syoyo / safetensors-cpp
Header-only safetensors loader and saver in C++
☆61Updated this week
Alternatives and similar repositories for safetensors-cpp
Users that are interested in safetensors-cpp are comparing it to the libraries listed below
Sorting:
- Standalone Flash Attention v2 kernel without libtorch dependency☆108Updated 8 months ago
- An extension library of WMMA API (Tensor Core API)☆96Updated 10 months ago
- We invite you to visit and follow our new repository at https://github.com/microsoft/TileFusion. TiledCUDA is a highly efficient kernel …☆181Updated 3 months ago
- MatMul Performance Benchmarks for a Single CPU Core comparing both hand engineered and codegen kernels.☆130Updated last year
- ☆21Updated 4 years ago
- ☆60Updated 4 months ago
- A standalone GEMM kernel for fp16 activation and quantized weight, extracted from FasterTransformer☆92Updated last week
- This is a demo how to write a high performance convolution run on apple silicon☆54Updated 3 years ago
- ☆140Updated 4 months ago
- ⚡️Write HGEMM from scratch using Tensor Cores with WMMA, MMA and CuTe API, Achieve Peak⚡️ Performance.☆75Updated last month
- TPP experimentation on MLIR for linear algebra☆128Updated this week
- SGEMM optimization with cuda step by step☆18Updated last year
- Assembler for NVIDIA Volta and Turing GPUs☆218Updated 3 years ago
- Directed Acyclic Graph Execution Engine (DAGEE) is a C++ library that enables programmers to express computation and data movement, as ta…☆47Updated 3 years ago
- TileFusion is an experimental C++ macro kernel template library that elevates the abstraction level in CUDA C for tile processing.☆84Updated this week
- An unofficial cuda assembler, for all generations of SASS, hopefully :)☆83Updated 2 years ago
- BGHT: High-performance static GPU hash tables.☆63Updated last month
- ☆28Updated 3 months ago
- Several optimization methods of half-precision general matrix vector multiplication (HGEMV) using CUDA core.☆61Updated 8 months ago
- A language and compiler for irregular tensor programs.☆138Updated 5 months ago
- ☆119Updated 5 months ago
- Generate simple index ranges in C++ and CUDA C++☆39Updated last year
- ☆148Updated 4 months ago
- Unified compiler/runtime for interfacing with PyTorch Dynamo.☆100Updated 2 months ago
- ☆96Updated last year
- ☆36Updated 7 months ago
- how to design cpu gemm on x86 with avx256, that can beat openblas.☆70Updated 6 years ago
- ☆104Updated last week
- An implementation of SGEMV with performance comparable to cuBLAS.☆9Updated 3 years ago
- Triton Compiler related materials.☆28Updated 4 months ago