Alternatives and similar repositories for bitbeast

Users that are interested in bitbeast are comparing it to the libraries listed below

• abetlen / ggml-python
  Python bindings for ggml
  ☆147Updated last year
• nebuly-ai / exploring-AI-optimization
  Curated list of awesome material on optimization techniques to make artificial intelligence faster and more efficient 🚀
  ☆119Updated 2 years ago
• premAI-io / benchmarks
  🕹️ Performance Comparison of MLOps Engines, Frameworks, and Languages on Mainstream AI Models.
  ☆138Updated last year
• triton-inference-server / pytorch_backend
  The Triton backend for the PyTorch TorchScript models.
  ☆173Updated this week
• triton-inference-server / onnxruntime_backend
  The Triton backend for the ONNX Runtime.
  ☆173Updated this week
• sayakpaul / keras-xla-benchmarks
  Presents comprehensive benchmarks of XLA-compatible pre-trained models in Keras.
  ☆37Updated 2 years ago
• PABannier / biogpt.cpp
  Port of Microsoft's BioGPT in C/C++ using ggml
  ☆86Updated last year
• aniketmaurya / fastserve-ai
  Machine Learning Serving focused on GenAI with simplicity as the top priority.
  ☆59Updated last month
• lessw2020 / transformer_central
  Various transformers for FSDP research
  ☆38Updated 3 years ago
• IlyasMoutawwakil / llm-perf-backend
  The backend behind the LLM-Perf Leaderboard
  ☆11Updated last year
• huggingface / optimum-tpu
  Google TPU optimizations for transformers models
  ☆134Updated 2 weeks ago
• neuralmagic / nm-vllm
  A high-throughput and memory-efficient inference and serving engine for LLMs
  ☆267Updated 2 months ago
• hamelsmu / llama-inference
  experiments with inference on llama
  ☆103Updated last year
• iamlemec / bert.cpp
  GGML implementation of BERT model with Python bindings and quantization.
  ☆58Updated last year
• clearml / clearml-fractional-gpu
  ClearML Fractional GPU - Run multiple containers on the same GPU with driver level memory limitation ✨ and compute time-slicing
  ☆88Updated 2 months ago
• Lightning-Universe / Training-Studio_app
  Lightning HPO & Training Studio App
  ☆19Updated 2 years ago
• triton-inference-server / model_navigator
  Triton Model Navigator is an inference toolkit designed for optimizing and deploying Deep Learning models with a focus on NVIDIA GPUs.
  ☆217Updated last week
• GreenBitAI / low_bit_llama
  Advanced Ultra-Low Bitrate Compression Techniques for the LLaMA Family of LLMs
  ☆110Updated 2 years ago
• staghado / vit.cpp
  Inference Vision Transformer (ViT) in plain C/C++ with ggml
  ☆306Updated last year
• runpod-workers / worker-sglang
  SGLang is fast serving framework for large language models and vision language models.
  ☆32Updated 2 months ago
• roboflow / deploy-models-with-grpc-pytorch-asyncio
  Article about deploying machine learning models using grpc, pytorch and asyncio
  ☆30Updated 3 years ago
• huggingface / optimum-benchmark
  🏋️ A unified multi-backend utility for benchmarking Transformers, Timm, PEFT, Diffusers and Sentence-Transformers with full support of O…
  ☆328Updated 4 months ago
• npuichigo / openai_trtllm
  OpenAI compatible API for TensorRT LLM triton backend
  ☆220Updated last year
• coreweave / tensorizer
  Module, Model, and Tensor Serialization/Deserialization
  ☆287Updated this week
• IlyasMoutawwakil / py-txi
  A Python wrapper around HuggingFace's TGI (text-generation-inference) and TEI (text-embedding-inference) servers.
  ☆32Updated 4 months ago
• rasbt / pytorch-memory-optim
  This code repository contains the code used for my "Optimizing Memory Usage for Training LLMs and Vision Transformers in PyTorch" blog po…
  ☆92Updated 2 years ago
• triton-inference-server / triton_cli
  Triton CLI is an open source command line interface that enables users to create, deploy, and profile models served by the Triton Inferen…
  ☆73Updated 2 weeks ago
• mlflow / mlflow-torchserve
  Plugin for deploying MLflow models to TorchServe
  ☆110Updated 2 years ago
• kroggen / mamba.c
  Inference of Mamba and Mamba2 models in pure C
  ☆196Updated 2 weeks ago
• Preemo-Inc / text-generation-inference
  ☆198Updated 2 years ago