linkedin / fmchiselLinks
fmchisel: Efficient Compression and Training Algorithms for Foundation Models
☆83Updated 3 months ago
Alternatives and similar repositories for fmchisel
Users that are interested in fmchisel are comparing it to the libraries listed below
Sorting:
- ArcticInference: vLLM plugin for high-throughput, low-latency inference☆384Updated this week
- KV cache compression for high-throughput LLM inference☆151Updated last year
- Accelerating MoE with IO and Tile-aware Optimizations☆569Updated 2 weeks ago
- An early research stage expert-parallel load balancer for MoE models based on linear programming.☆495Updated 2 months ago
- Autonomous GPU Kernel Generation via Deep Agents☆228Updated this week
- [ICLR2025] Breaking Throughput-Latency Trade-off for Long Sequences with Speculative Decoding☆141Updated last year
- Code for data-aware compression of DeepSeek models☆69Updated last month
- [ICLR2025 Spotlight] MagicPIG: LSH Sampling for Efficient LLM Generation☆248Updated last year
- Miles is an enterprise-facing reinforcement learning framework for LLM and VLM post-training, forked from and co-evolving with slime.☆830Updated this week
- Efficient LLM Inference over Long Sequences☆394Updated 7 months ago
- Cataloging released Triton kernels.☆291Updated 4 months ago
- LLM Serving Performance Evaluation Harness☆83Updated 11 months ago
- A curated collection of resources, tutorials, and best practices for learning and mastering NVIDIA CUTLASS☆249Updated 9 months ago
- ☆45Updated 10 months ago
- Distributed MoE in a Single Kernel [NeurIPS '25]☆190Updated this week
- A minimal implementation of vllm.☆66Updated last year
- Genai-bench is a powerful benchmark tool designed for comprehensive token-level performance evaluation of large language model (LLM) serv…☆263Updated this week
- JAX backend for SGL☆234Updated this week
- [OSDI'24] Serving LLM-based Applications Efficiently with Semantic Variable☆209Updated last year
- PyTorch library for cost-effective, fast and easy serving of MoE models.☆278Updated last week
- Efficient Long-context Language Model Training by Core Attention Disaggregation☆85Updated last week
- ☆132Updated 8 months ago
- torchcomms: a modern PyTorch communications API☆327Updated this week
- 🔥 LLM-powered GPU kernel synthesis: Train models to convert PyTorch ops into optimized Triton kernels via SFT+RL. Multi-turn compilation…☆116Updated 2 months ago
- [ICLR'25] Fast Inference of MoE Models with CPU-GPU Orchestration☆260Updated last year
- Systems for GenAI☆157Updated last week
- Perplexity GPU Kernels☆554Updated 3 months ago
- ByteCheckpoint: An Unified Checkpointing Library for LFMs☆268Updated last month
- Building the Virtuous Cycle for AI-driven LLM Systems☆151Updated this week
- Code for paper: [ICLR2025 Oral] FlexPrefill: A Context-Aware Sparse Attention Mechanism for Efficient Long-Sequence Inference☆160Updated 3 months ago