A CLI to estimate inference memory requirements for Hugging Face models, written in Python.
☆950Nov 13, 2026Updated this week
Alternatives and similar repositories for hf-mem
Users that are interested in hf-mem are comparing it to the libraries listed below. We may earn a commission when you buy through links labeled 'Ad' on this page.
Sorting:
- LMCache: Supercharge Your LLM with the Fastest KV Cache Layer☆12,362Updated this week
- [MLsys2026 Best Paper]: https://arxiv.org/abs/2506.08276. RAG on Everything with LEANN. Enjoy 97% storage savings while running a fast, a…☆13,797Updated this week
- An intelligent tuner for vLLM that automatically monitors GPU metrics, uses Bayesian optimization to tune parameters☆66Mar 12, 2026Updated 8 months ago
- The open source research environment for AI researchers to seamlessly train, evaluate, and scale models from local hardware to GPU cluste…☆5,198Nov 5, 2026Updated last week
- Runs 405B LLMs on 8GB VRAM☆3,103Updated this week
- Managed Database hosting by DigitalOcean • AdPostgreSQL, MySQL, MongoDB, Kafka, Valkey, and OpenSearch available. Automatically scale up storage and focus on building your apps.
- Hundreds of models & providers. One command to find what runs on your hardware.☆38,984Updated this week
- Local UI to run and train LLMs and diffusion models. Supports GGUF, MLX, Qwen3.8, DeepSeek-V4.1, MiniMax-H3, Gemma 4, FLUX and more.☆79,494Updated this week
- Mount Hugging Face Buckets and repos as local filesystems. No download, no copy, no waiting.☆825Updated this week
- Multi-LoRA inference server that scales to 1000s of fine-tuned LLMs☆3,835May 28, 2026Updated 5 months ago
- 📑 PageIndex: Document Index for Vectorless, Reasoning-based RAG☆40,423Updated this week
- dLLM: Simple Diffusion Language Modeling☆2,731Jul 17, 2026Updated 3 months ago
- Agent Reinforcement Trainer: train multi-step agents for real-world tasks using GRPO. Give your agents on-the-job training. Reinforcement…☆10,856Updated this week
- Recipes for shrinking, optimizing, customizing cutting edge vision models. 💜☆2,004Aug 12, 2026Updated 3 months ago
- ☆2,799Jul 27, 2026Updated 3 months ago
- Deploy on Railway without the complexity - Free Credits Offer • AdConnect your repo and Railway handles the rest with instant previews. Quickly provision container image services, databases, and storage volumes.
- The LLM Evaluation Framework☆19,477Updated this week
- A course on aligning smol models.☆6,792Updated this week
- Build compute kernels and load them from the Hub.☆789Updated this week
- 🎨 NeMo Data Designer: Generate high-quality synthetic data from scratch or from seed data.☆2,405Updated this week
- State-of-the-art LLM compression, built for production inference with vLLM☆3,966Updated this week
- A high-throughput and memory-efficient inference and serving engine for LLMs☆96,926Updated this week
- A python repl for MCP☆11Feb 11, 2025Updated last year
- Go ahead and axolotl questions☆12,695Updated this week
- A vector index built on TurboQuant, written in Rust with Python bindings☆17,492Oct 7, 2026Updated last month
- AI Agents on DigitalOcean Gradient AI Platform • AdBuild production-ready AI agents using customizable tools or access multiple LLMs through a single endpoint. Create custom knowledge bases or connect external data.
- Highly Performant, Modular, Memory Safe and Production-ready Inference, Ingestion and Indexing built in Rust 🦀☆1,323Oct 26, 2026Updated 2 weeks ago
- ☆137Sep 23, 2025Updated last year
- The absolute trainer to light up AI agents.☆18,953Updated this week
- Optimizing inference proxy for LLMs☆4,340Nov 2, 2026Updated last week
- Multilingual Document Layout Parsing in a Single Vision-Language Model☆9,192Mar 24, 2026Updated 7 months ago
- Examples, end-2-end tutorials and apps built using Liquid AI Foundational Models (LFM) and the LEAP SDK☆2,781Updated this week
- A Python library for extracting structured information from unstructured text using LLMs with precise source grounding and interactive vi…☆39,310Updated this week
- AdalFlow: The library to build & auto-optimize LLM applications.☆4,235Nov 1, 2026Updated 2 weeks ago
- Official inference framework for 1-bit LLMs☆41,579Jul 27, 2026Updated 3 months ago
- Deploy open-source AI quickly and easily - Special Bonus Offer • AdRunpod Hub is built for open source. One-click deployment and autoscaling endpoints without provisioning your own infrastructure.
- 🚂 Fine-tune OpenAI models for text classification, question answering, and more☆17May 1, 2023Updated 3 years ago
- Curated list of datasets and tools for post-training.☆4,837Apr 29, 2026Updated 6 months ago
- A framework for efficient model inference with omni-modality models☆7,754Updated this week
- Modal-style sandbox API on top of Hugging Face Jobs☆158Jul 6, 2026Updated 4 months ago
- DSPy: The framework for programming—not prompting—language models☆39,049Updated this week
- Open-source tools for training and evaluating Vision Language Models for OCR☆193Sep 22, 2026Updated last month
- An interface library for RL post training with environments.☆2,851Updated this week
Are these results useful?