Alternatives and similar repositories for zipnn:

Users that are interested in zipnn are comparing it to the libraries listed below

• IBM / unitxt
  🦄 Unitxt is a Python library for enterprise-grade evaluation of AI performance, offering the world's largest catalog of tools and data …
  ☆191Updated last week
• run-ai / runai-model-streamer
  ☆207Updated this week
• Asaf-Yehudai / LLM-Agent-Evaluation-Survey
  Top papers related to LLM-based agent evaluation
  ☆52Updated this week
• ronigold / TokenSHAP
  TokenSHAP: Explain individual token importance in large language model prompts with SHAP values. Gain insights, debug models, detect bias…
  ☆42Updated last month
• slp-rl / slamkit
  SlamKit is an open source tool kit for efficient training of SpeechLMs. It was used for "Slamming: Training a Speech Language Model on On…
  ☆205Updated last month
• pytorch / torchft
  PyTorch per step fault tolerance (actively under development)
  ☆291Updated this week
• coreweave / tensorizer
  Module, Model, and Tensor Serialization/Deserialization
  ☆225Updated 2 months ago
• Zyphra / tree_attention
  Tree Attention: Topology-aware Decoding for Long-Context Attention on GPU clusters
  ☆126Updated 5 months ago
• samsja / pydantic_config
  Manage ML configuration with pydantic
  ☆16Updated 5 months ago
• mixedbread-ai / batched
  The Batched API provides a flexible and efficient way to process multiple requests in a batch, with a primary focus on dynamic batching o…
  ☆131Updated 4 months ago
• VITA-Group / Q-GaLore
  Q-GaLore: Quantized GaLore with INT4 Projection and Layer-Adaptive Low-Rank Gradients.
  ☆199Updated 9 months ago
• astramind-ai / BitMat
  An efficent implementation of the method proposed in "The Era of 1-bit LLMs"
  ☆154Updated 6 months ago
• huggingface / optimum-tpu
  Google TPU optimizations for transformers models
  ☆109Updated 3 months ago
• yandex-research / swarm
  Official code for "SWARM Parallelism: Training Large Models Can Be Surprisingly Communication-Efficient"
  ☆140Updated last year
• huggingface / inference-benchmarker
  Inference server benchmarking tool
  ☆56Updated last week
• ServiceNow / Fast-LLM
  Accelerating your LLM training to full speed! Made with ❤️ by ServiceNow Research
  ☆188Updated this week
• bloc97 / DeMo
  DeMo: Decoupled Momentum Optimization
  ☆185Updated 5 months ago
• facebookresearch / LayerSkip
  Code for "LayerSkip: Enabling Early Exit Inference and Self-Speculative Decoding", ACL 2024
  ☆292Updated this week
• neuralmagic / guidellm
  Evaluate and Enhance Your LLM Deployments for Real-World Inference Needs
  ☆284Updated this week
• ScalingIntelligence / codemonkeys
  ☆37Updated 3 months ago
• epistoteles / TensorHue
  TensorHue is a Python library that allows you to visualize tensors right in your console, making understanding and debugging tensor conte…
  ☆115Updated 2 months ago
• facebookresearch / spdl
  Scalable and Performant Data Loading
  ☆252Updated this week
• apehex / tokun
  Tokun to can tokens
  ☆17Updated this week
• determined-ai / determined-examples
  Example ML projects that use the Determined library.
  ☆32Updated 7 months ago
• cornstarch-org / Cornstarch
  ☆89Updated last week
• joaopauloschuler / less-parameters-llm
  This repository contains the source code for the Saving 77% of the Parameters in Large Language Models Technical Report
  ☆30Updated 2 months ago
• mgmalek / efficient_cross_entropy
  ☆103Updated 11 months ago
• writer / writing-in-the-margins
  ☆117Updated 8 months ago
• pytorch-labs / float8_experimental
  This repository contains the experimental PyTorch native float8 training UX
  ☆224Updated 9 months ago
• mani-kantap / llm-inference-solutions
  A collection of all available inference solutions for the LLMs
  ☆87Updated 2 months ago