Alternatives and similar repositories for zipnn

Users that are interested in zipnn are comparing it to the libraries listed below

• run-ai / runai-model-streamer
  ☆222Updated this week
• IBM / unitxt
  🦄 Unitxt is a Python library for enterprise-grade evaluation of AI performance, offering the world's largest catalog of tools and data …
  ☆200Updated this week
• IST-DASLab / Quartet
  ☆68Updated this week
• huggingface / inference-benchmarker
  Inference server benchmarking tool
  ☆74Updated 2 months ago
• neuralmagic / compressed-tensors
  A safetensors extension to efficiently store sparse quantized tensors on disk
  ☆129Updated this week
• huggingface / optimum-tpu
  Google TPU optimizations for transformers models
  ☆113Updated 5 months ago
• foundation-model-stack / fms-hf-tuning
  🚀 Collection of tuning recipes with HuggingFace SFTTrainer and PyTorch FSDP.
  ☆47Updated this week
• neuralmagic / guidellm
  Evaluate and Enhance Your LLM Deployments for Real-World Inference Needs
  ☆358Updated this week
• samsja / pydantic_config
  Manage ML configuration with pydantic
  ☆16Updated last month
• facebookresearch / fastgen
  Simple high-throughput inference library
  ☆119Updated last month
• tiiuae / onebitllms
  Lightweight toolkit package to train and fine-tune 1.58bit Language models
  ☆80Updated last month
• bloc97 / DeMo
  DeMo: Decoupled Momentum Optimization
  ☆188Updated 6 months ago
• snowflakedb / ArcticTraining
  ArcticTraining is a framework designed to simplify and accelerate the post-training process for large language models (LLMs)
  ☆130Updated this week
• Cornell-RelaxML / qtip
  ☆137Updated this week
• pytorch-labs / monarch
  PyTorch Single Controller
  ☆231Updated this week
• cornstarch-org / Cornstarch
  ☆93Updated last month
• chu-tianxiang / QuIP-for-all
  QuIP quantization
  ☆54Updated last year
• astramind-ai / BitMat
  An efficent implementation of the method proposed in "The Era of 1-bit LLMs"
  ☆154Updated 8 months ago
• facebookresearch / spdl
  Scalable and Performant Data Loading
  ☆278Updated this week
• inferx-net / inferx
  InferX is a Inference Function as a Service Platform
  ☆111Updated last week
• DeepAuto-AI / hip-attention
  Training-free Post-training Efficient Sub-quadratic Complexity Attention. Implemented with OpenAI Triton.
  ☆137Updated this week
• pytorch / torchft
  PyTorch per step fault tolerance (actively under development)
  ☆329Updated last week
• neuralmagic / nm-vllm
  A high-throughput and memory-efficient inference and serving engine for LLMs
  ☆264Updated 8 months ago
• Asaf-Yehudai / LLM-Agent-Evaluation-Survey
  Top papers related to LLM-based agent evaluation
  ☆70Updated 2 weeks ago
• cognitivecomputations / spectrum
  ☆124Updated 2 months ago
• avilum / yalla
  A tiny LLM Agent with minimal dependencies, focused on local inference.
  ☆53Updated 8 months ago
• pyember / ember
  ☆182Updated 2 months ago
• MekkCyber / TritonAcademy
  A repository to unravel the language of GPUs, making their kernel conversations easy to understand
  ☆185Updated 3 weeks ago
• cray-lm / cray-lm
  Cray-LM unified training and inference stack.
  ☆22Updated 4 months ago
• nyunAI / PruneGPT
  ☆53Updated last year