Alternatives and similar repositories for zipnn:

Users that are interested in zipnn are comparing it to the libraries listed below

• IBM / unitxt
  🦄 Unitxt: a python library for getting data fired up and set for training and evaluation
  ☆177Updated this week
• AlonKellner / waloviz
  An open source interactive spectrogram audio player, primarily based on bokeh and the holoviz stack (wav+holoviz=waloviz)
  ☆66Updated 7 months ago
• run-ai / runai-model-streamer
  ☆167Updated this week
• skypilot-org / skypilot-catalog
  ☆22Updated this week
• DeepAuto-AI / hip-attention
  Training-free Post-training Efficient Sub-quadratic Complexity Attention. Implemented with OpenAI Triton.
  ☆122Updated last week
• pytorch / torchft
  PyTorch per step fault tolerance (actively under development)
  ☆260Updated this week
• mixedbread-ai / batched
  The Batched API provides a flexible and efficient way to process multiple requests in a batch, with a primary focus on dynamic batching o…
  ☆123Updated 2 months ago
• astramind-ai / BitMat
  An efficent implementation of the method proposed in "The Era of 1-bit LLMs"
  ☆154Updated 4 months ago
• foundation-model-stack / fms-hf-tuning
  🚀 Collection of tuning recipes with HuggingFace SFTTrainer and PyTorch FSDP.
  ☆36Updated this week
• Zyphra / tree_attention
  Tree Attention: Topology-aware Decoding for Long-Context Attention on GPU clusters
  ☆123Updated 3 months ago
• neuralmagic / nm-vllm
  A high-throughput and memory-efficient inference and serving engine for LLMs
  ☆260Updated 4 months ago
• ronigold / TokenSHAP
  TokenSHAP: Explain individual token importance in large language model prompts with SHAP values. Gain insights, debug models, detect bias…
  ☆38Updated last week
• huggingface / optimum-tpu
  Google TPU optimizations for transformers models
  ☆102Updated last month
• facebookresearch / spdl
  Scalable and Performant Data Loading
  ☆222Updated this week
• snowflakedb / ArcticTraining
  ArcticTraining is a framework designed to simplify and accelerate the post-training process for large language models (LLMs)
  ☆45Updated this week
• Mihaiii / backtrack_sampler
  An easy-to-understand framework for LLM samplers that rewind and revise generated tokens
  ☆133Updated 2 weeks ago
• mengxiayu / LLMSuperWeight
  Code for studying the super weight in LLM
  ☆90Updated 3 months ago
• neuralmagic / guidellm
  Evaluate and Enhance Your LLM Deployments for Real-World Inference Needs
  ☆208Updated this week
• RulinShao / retrieval-scaling
  Official repository for "Scaling Retrieval-Based Langauge Models with a Trillion-Token Datastore".
  ☆191Updated this week
• neuralmagic / compressed-tensors
  A safetensors extension to efficiently store sparse quantized tensors on disk
  ☆80Updated this week
• mobiusml / aana_sdk
  Aana SDK is a powerful framework for building AI enabled multimodal applications.
  ☆42Updated last week
• AlmogBaku / pytest-evals
  A pytest plugin for running and analyzing LLM evaluation tests.
  ☆104Updated last month
• Contextualist / lone-arena
  Self-hosted LLM chatbot arena, with yourself as the only judge
  ☆37Updated last year
• IST-DASLab / peft-rosa
  A fork of the PEFT library, supporting Robust Adaptation (RoSA)
  ☆13Updated 6 months ago
• Sharonio / roboshaul
  ☆33Updated last year
• bloc97 / DeMo
  DeMo: Decoupled Momentum Optimization
  ☆181Updated 3 months ago
• HazyResearch / lolcats
  Repo for "LoLCATs: On Low-Rank Linearizing of Large Language Models"
  ☆221Updated last month
• Cornell-RelaxML / qtip
  ☆110Updated 2 months ago