A CLI to estimate inference memory requirements for Hugging Face models, written in Python.
☆944Sep 7, 2026Updated last month
Alternatives and similar repositories for hf-mem
Users that are interested in hf-mem are comparing it to the libraries listed below. We may earn a commission when you buy through links labeled 'Ad' on this page.
Sorting:
- LMCache: Supercharge Your LLM with the Fastest KV Cache Layer☆12,155Updated this week
- [MLsys2026 Best Paper]: https://arxiv.org/abs/2506.08276. RAG on Everything with LEANN. Enjoy 97% storage savings while running a fast, a…☆13,072Updated this week
- An intelligent tuner for vLLM that automatically monitors GPU metrics, uses Bayesian optimization to tune parameters☆66Mar 12, 2026Updated 7 months ago
- Hundreds of models & providers. One command to find what runs on your hardware.☆38,294Updated this week
- Runs 405B LLMs on 8GB VRAM☆3,078Updated this week
- Serverless GPU API endpoints on Runpod - Get Bonus Credits • AdSkip the infrastructure headaches. Auto-scaling, pay-as-you-go, no-ops approach lets you focus on innovating your application.
- The open source research environment for AI researchers to seamlessly train, evaluate, and scale models from local hardware to GPU cluste…☆5,199Updated this week
- Local UI to run and train LLMs and diffusion models. Supports GGUF, MLX, Qwen3.8, DeepSeek-V4.1, MiniMax-H3, Gemma 4, FLUX and more.☆78,470Updated this week
- Multi-LoRA inference server that scales to 1000s of fine-tuned LLMs☆3,835May 28, 2026Updated 4 months ago
- 📑 PageIndex: Document Index for Vectorless, Reasoning-based RAG☆39,571Updated this week
- dLLM: Simple Diffusion Language Modeling☆2,714Jul 17, 2026Updated 3 months ago
- Mount Hugging Face Buckets and repos as local filesystems. No download, no copy, no waiting.☆817Updated this week
- Recipes for shrinking, optimizing, customizing cutting edge vision models. 💜☆2,001Aug 12, 2026Updated 2 months ago
- Agent Reinforcement Trainer: train multi-step agents for real-world tasks using GRPO. Give your agents on-the-job training. Reinforcement…☆10,821Updated this week
- The LLM Evaluation Framework☆19,063Updated this week
- AI Agents on DigitalOcean Gradient AI Platform • AdBuild production-ready AI agents using customizable tools or access multiple LLMs through a single endpoint. Create custom knowledge bases or connect external data.
- ☆2,794Jul 27, 2026Updated 2 months ago
- State-of-the-art LLM compression, built for production inference with vLLM☆3,908Updated this week
- A course on aligning smol models.☆6,784Oct 6, 2026Updated 2 weeks ago
- Build compute kernels and load them from the Hub.☆775Updated this week
- A high-throughput and memory-efficient inference and serving engine for LLMs☆95,230Updated this week
- 🎨 NeMo Data Designer: Generate high-quality synthetic data from scratch or from seed data.☆2,365Updated this week
- Go ahead and axolotl questions☆12,613Updated this week
- A vector index built on TurboQuant, written in Rust with Python bindings☆17,414Oct 7, 2026Updated 2 weeks ago
- Examples, end-2-end tutorials and apps built using Liquid AI Foundational Models (LFM) and the LEAP SDK☆2,635Oct 16, 2026Updated last week
- GPUs on demand by Runpod - Special Offer Available • AdRun AI, ML, and HPC workloads on powerful cloud GPUs—without limits or wasted spend. Deploy GPUs in under a minute and pay by the second.
- A Rust crate offering similar functionality to the Python transformers package using Candle.☆15Nov 19, 2024Updated last year
- The absolute trainer to light up AI agents.☆18,792Updated this week
- ☆137Sep 23, 2025Updated last year
- 🚂 Fine-tune OpenAI models for text classification, question answering, and more☆17May 1, 2023Updated 3 years ago
- AdalFlow: The library to build & auto-optimize LLM applications.☆4,223Updated this week
- A super fast Graph Database uses GraphBLAS under the hood for its sparse adjacency matrix graph representation. Our goal is to provide th…☆10,501Updated this week
- Optimizing inference proxy for LLMs☆4,330Oct 11, 2026Updated last week
- A framework for efficient model inference with omni-modality models☆7,326Updated this week
- A lightweight, local-first, and free experiment tracking library from Hugging Face 🤗☆1,733Updated this week
- GPU virtual machines on DigitalOcean Gradient AI • AdGet to production fast with high-performance AMD and NVIDIA GPUs you can spin up in seconds. The definition of operational simplicity.
- Modal-style sandbox API on top of Hugging Face Jobs☆159Jul 6, 2026Updated 3 months ago
- Highly Performant, Modular, Memory Safe and Production-ready Inference, Ingestion and Indexing built in Rust 🦀☆1,318Sep 25, 2026Updated 3 weeks ago
- A Python library for extracting structured information from unstructured text using LLMs with precise source grounding and interactive vi…☆39,014Updated this week
- Official inference framework for 1-bit LLMs☆41,228Jul 27, 2026Updated 2 months ago
- Multilingual Document Layout Parsing in a Single Vision-Language Model☆9,180Mar 24, 2026Updated 6 months ago
- DSPy: The framework for programming—not prompting—language models☆38,754Updated this week
- An interface library for RL post training with environments.☆2,758Updated this week