Alternatives and similar repositories for bitbeast

Users that are interested in bitbeast are comparing it to the libraries listed below

• aniketmaurya / fastserve-ai
  Machine Learning Serving focused on GenAI with simplicity as the top priority.
  ☆59Updated last month
• nebuly-ai / exploring-AI-optimization
  Curated list of awesome material on optimization techniques to make artificial intelligence faster and more efficient 🚀
  ☆119Updated 2 years ago
• IlyasMoutawwakil / llm-perf-backend
  The backend behind the LLM-Perf Leaderboard
  ☆11Updated last year
• iamlemec / bert.cpp
  GGML implementation of BERT model with Python bindings and quantization.
  ☆58Updated last year
• abetlen / ggml-python
  Python bindings for ggml
  ☆146Updated last year
• hamelsmu / llama-inference
  experiments with inference on llama
  ☆103Updated last year
• lessw2020 / transformer_central
  Various transformers for FSDP research
  ☆38Updated 3 years ago
• mlc-ai / llm-perf-bench
  ☆120Updated last year
• clearml / clearml-serving
  ClearML - Model-Serving Orchestration and Repository Solution
  ☆158Updated 3 weeks ago
• huggingface / optimum-tpu
  Google TPU optimizations for transformers models
  ☆122Updated 10 months ago
• neuralmagic / nm-vllm
  A high-throughput and memory-efficient inference and serving engine for LLMs
  ☆267Updated last year
• Preemo-Inc / text-generation-inference
  ☆198Updated last year
• premAI-io / benchmarks
  🕹️ Performance Comparison of MLOps Engines, Frameworks, and Languages on Mainstream AI Models.
  ☆139Updated last year
• runpod-workers / worker-sglang
  SGLang is fast serving framework for large language models and vision language models.
  ☆30Updated this week
• triton-inference-server / onnxruntime_backend
  The Triton backend for the ONNX Runtime.
  ☆167Updated 2 weeks ago
• Lightning-Universe / Training-Studio_app
  Lightning HPO & Training Studio App
  ☆18Updated 2 years ago
• huggingface / optimum-benchmark
  🏋️ A unified multi-backend utility for benchmarking Transformers, Timm, PEFT, Diffusers and Sentence-Transformers with full support of O…
  ☆320Updated 2 months ago
• facebookresearch / recipes
  Recipes are a standard, well supported set of blueprints for machine learning engineers to rapidly train models using the latest research…
  ☆334Updated this week
• PABannier / biogpt.cpp
  Port of Microsoft's BioGPT in C/C++ using ggml
  ☆85Updated last year
• triton-inference-server / pytorch_backend
  The Triton backend for the PyTorch TorchScript models.
  ☆165Updated last week
• rasbt / pytorch-memory-optim
  This code repository contains the code used for my "Optimizing Memory Usage for Training LLMs and Vision Transformers in PyTorch" blog po…
  ☆92Updated 2 years ago
• gotzmann / booster
  Booster - open accelerator for LLM models. Better inference and debugging for AI hackers
  ☆163Updated last year
• Lightning-AI / utilities
  Common Python utilities and GitHub Actions in Lightning Ecosystem
  ☆62Updated this week
• chainyo / tensorshare
  🤝 Trade any tensors over the network
  ☆30Updated 2 years ago
• sayakpaul / hf-codegen
  A repository of Python scripts to scrape code contents of the public repositories of `huggingface`.
  ☆52Updated last year
• Nachimak28 / LAI-voice-search-openai-whisper-demo
  A ⚡️ Lightning.ai ⚡️ app demo for Voice based web search using OpenAI's Whisper and DuckDuckGo
  ☆27Updated 3 years ago
• muellerzr / minimal-trainer-zoo
  Minimal example scripts of the Hugging Face Trainer, focused on staying under 150 lines
  ☆196Updated last year
• go-skynet / go-ggml-transformers.cpp
  Binding to transformers in ggml
  ☆64Updated last week
• kroggen / mamba.c
  Inference of Mamba models in pure C
  ☆193Updated last year
• huggingface / optimum-habana
  Easy and lightning fast training of 🤗 Transformers on Habana Gaudi processor (HPU)
  ☆201Updated last week