fal-ai / flashpackLinks
High-throughput tensor loading for PyTorch
☆197Updated this week
Alternatives and similar repositories for flashpack
Users that are interested in flashpack are comparing it to the libraries listed below
Sorting:
- Making Flux go brrr on GPUs.☆154Updated 4 months ago
- faster parallel inference of mochi-1 video generation model☆125Updated 8 months ago
- Recaption large (Web)Datasets with vllm and save the artifacts.☆52Updated 11 months ago
- [WIP] Better (FP8) attention for Hopper☆32Updated 8 months ago
- Focused on fast experimentation and simplicity☆75Updated 10 months ago
- ☆77Updated 10 months ago
- ☆49Updated 8 months ago
- Comparison of different stable diffusion implementations and optimizations☆39Updated last year
- (WIP) Parallel inference for black-forest-labs' FLUX model.☆18Updated last year
- PyTorch half precision gemm lib w/ fused optional bias + optional relu/gelu☆76Updated 11 months ago
- ☆24Updated last year
- Lightweight package that tracks and summarizes code changes using LLMs (Large Language Models)☆34Updated 8 months ago
- This repository provides a minimal, single-file implementation of SingLoRA (Single Matrix Low-Rank Adaptation) as described in the paper …☆44Updated last week
- End-to-end recipes for optimizing diffusion models with torchao and diffusers (inference and FP8 training).☆383Updated 5 months ago
- Writing FLUX in Triton☆41Updated last year
- ☆27Updated last year
- https://hf.co/hexgrad/Kokoro-82M☆14Updated 8 months ago
- ☆18Updated 11 months ago
- ☆30Updated last year
- CUDA-L1: Improving CUDA Optimization via Contrastive Reinforcement Learning☆244Updated 2 weeks ago
- Text-to-video generation: CogVideoX (2024) and CogVideo (ICLR 2023)☆17Updated last year
- ☆155Updated last week
- ☆25Updated last month
- 🎬 3.7× faster video generation E2E 🖼️ 1.6× faster image generation E2E ⚡ ColumnSparseAttn 9.3× vs FlashAttn‑3 💨 ColumnSparseGEMM 2.5× …☆90Updated 2 months ago
- Model code for inferencing T5☆66Updated 8 months ago
- RAM is all you need☆223Updated last week
- A pipeline parallel training script for LLMs.☆162Updated 6 months ago
- This repository shows how to use Q8 kernels with `diffusers` to optimize inference of LTX-Video on ADA GPUs.☆24Updated 10 months ago
- realtime latent world model inference demo☆48Updated last year
- Flux diffusion model implementation using quantized fp8 matmul & remaining layers use faster half precision accumulate, which is ~2x fast…☆285Updated last year