huggingface / optimum-tpu

Related projects ⓘ

Alternatives and complementary repositories for optimum-tpu

• AI-Hypercomputer / jetstream-pytorch
  PyTorch/XLA integration with JetStream (https://github.com/google/JetStream) for LLM inference"
  ☆40Updated this week
• run-ai / runai-model-streamer
  ☆106Updated this week
• AI-Hypercomputer / maxdiffusion
  ☆155Updated this week
• AI-Hypercomputer / JetStream
  JetStream is a throughput and memory optimized engine for LLM inference on XLA devices, starting with TPUs (and GPUs in future -- PRs wel…
  ☆228Updated this week
• VITA-Group / Q-GaLore
  Q-GaLore: Quantized GaLore with INT4 Projection and Layer-Adaptive Low-Rank Gradients.
  ☆171Updated 3 months ago
• huggingface / optimum-habana
  Easy and lightning fast training of 🤗 Transformers on Habana Gaudi processor (HPU)
  ☆152Updated this week
• huggingface / bloom-jax-inference
  ☆64Updated 2 years ago
• warner-benjamin / optimi
  Fast, Modern, Memory Efficient, and Low Precision PyTorch Optimizers
  ☆58Updated 3 months ago
• neuralmagic / nm-vllm
  A high-throughput and memory-efficient inference and serving engine for LLMs
  ☆250Updated 3 weeks ago
• huggingface / llm-swarm
  Manage scalable open LLM inference endpoints in Slurm clusters
  ☆237Updated 3 months ago
• hamelsmu / llama-inference
  experiments with inference on llama
  ☆105Updated 5 months ago
• cognitivecomputations / grokadamw
  ☆116Updated 2 months ago
• cognitivecomputations / spectrum
  ☆91Updated last month
• euclaise / supertrainer2000
  ☆49Updated 7 months ago
• Preemo-Inc / text-generation-inference
  ☆200Updated 9 months ago
• apple / ml-recurrent-drafter
  ☆96Updated last month
• AblateIt / finetune-study
  Comprehensive analysis of difference in performance of QLora, Lora, and Full Finetunes.
  ☆81Updated last year
• ChrisHayduk / qlora-multi-gpu
  QLoRA with Enhanced Multi GPU Support
  ☆36Updated last year
• arcee-ai / PruneMe
  Automated Identification of Redundant Layer Blocks for Pruning in Large Language Models
  ☆194Updated 6 months ago
• Pleias / Various-Finetuning
  Set of scripts to finetune LLMs
  ☆36Updated 7 months ago
• huggingface / competitions
  ☆115Updated last week
• cat-state / tinypar
  ☆20Updated last year
• neuralmagic / compressed-tensors
  A safetensors extension to efficiently store sparse quantized tensors on disk
  ☆46Updated this week
• EleutherAI / nanoGPT-mup
  The simplest, fastest repository for training/finetuning medium-sized GPTs.
  ☆83Updated last week
• premAI-io / benchmarks
  🕹️ Performance Comparison of MLOps Engines, Frameworks, and Languages on Mainstream AI Models.
  ☆132Updated 3 months ago
• astramind-ai / BitMat
  An efficent implementation of the method proposed in "The Era of 1-bit LLMs"
  ☆154Updated 3 weeks ago
• jxmorris12 / cde
  code for training & evaluating Contextual Document Embedding models
  ☆92Updated this week
• foundation-model-stack / fms-fsdp
  🚀 Efficiently (pre)training foundation models with native PyTorch features, including FSDP for training and SDPA implementation of Flash…
  ☆190Updated 2 weeks ago
• GreenBitAI / green-bit-llm
  A toolkit for fine-tuning, inferencing, and evaluating GreenBitAI's LLMs.
  ☆72Updated 3 weeks ago
• mixedbread-ai / batched
  ☆106Updated 2 weeks ago