Alternatives and similar repositories for genc

Users that are interested in genc are comparing it to the libraries listed below

• AI-Hypercomputer / JetStream
  JetStream is a throughput and memory optimized engine for LLM inference on XLA devices, starting with TPUs (and GPUs in future -- PRs wel…
  ☆385Updated 4 months ago
• AI-Hypercomputer / gpu-recipes
  Recipes for reproducing training and serving benchmarks for large machine learning models using GPUs on Google Cloud.
  ☆93Updated this week
• AI-Hypercomputer / xpk
  xpk (Accelerated Processing Kit, pronounced x-p-k,) is a software tool to help Cloud developers to orchestrate training jobs on accelerat…
  ☆147Updated this week
• lm-sys / lm-sys.github.io
  The source of LMSYS website and blogs
  ☆66Updated this week
• NVIDIA / nim-anywhere
  Accelerate your Gen AI with NVIDIA NIM and NVIDIA AI Workbench
  ☆182Updated 5 months ago
• GoogleCloudPlatform / ml-testing-accelerators
  Testing framework for Deep Learning models (Tensorflow and PyTorch) on Google Cloud hardware accelerators (TPU and GPU)
  ☆65Updated 4 months ago
• GoogleCloudPlatform / llm-pipeline-examples
  ☆177Updated last year
• GoogleCloudPlatform / solutions-genai-llm-workshop
  Generative AI Language (PaLM2 + Langchain) Workshop sample codes
  ☆77Updated last year
• GoogleCloudPlatform / ml-auto-solutions
  A simplified and automated orchestration workflow to perform ML end-to-end (E2E) model tests and benchmarking on Cloud VMs across differe…
  ☆53Updated this week
• EmbeddedLLM / vllm
  vLLM: A high-throughput and memory-efficient inference and serving engine for LLMs
  ☆90Updated this week
• google-deepmind / onetwo
  ☆244Updated 8 months ago
• huggingface / optimum-tpu
  Google TPU optimizations for transformers models
  ☆121Updated 9 months ago
• ray-project / llmperf-leaderboard
  ☆471Updated last year
• NVIDIA / nim-deploy
  A collection of YAML files, Helm Charts, Operator code, and guides to act as an example reference implementation for NVIDIA NIM deploymen…
  ☆196Updated this week
• huggingface / optimum-habana
  Easy and lightning fast training of 🤗 Transformers on Habana Gaudi processor (HPU)
  ☆199Updated this week
• huggingface / Google-Cloud-Containers
  Hugging Face Deep Learning Containers (DLCs) for Google Cloud
  ☆153Updated 5 months ago
• google / saxml
  ☆145Updated 2 weeks ago
• bentoml / BentoVLLM
  Self-host LLMs with vLLM and BentoML
  ☆152Updated 3 weeks ago
• run-ai / llmperf
  ☆58Updated last year
• mistralai / vllm-release
  A high-throughput and memory-efficient inference and serving engine for LLMs
  ☆52Updated last year
• ByronHsu / FlyteGPT
  🦅🔗 Building FlyteGPT on Flyte with LangChain
  ☆30Updated last year
• anyscale / llm-router
  Tutorial for building LLM router
  ☆231Updated last year
• fw-ai / cookbook
  Recipes and resources for building, deploying, and fine-tuning generative AI with Fireworks.
  ☆124Updated last week
• furiousteabag / vram-calculator
  Transformer GPU VRAM estimator
  ☆67Updated last year
• AI-Hypercomputer / jetstream-pytorch
  PyTorch/XLA integration with JetStream (https://github.com/google/JetStream) for LLM inference"
  ☆76Updated last month
• skypilot-org / skypilot-tutorial
  Tutorial to get started with SkyPilot!
  ☆57Updated last year
• coreweave / ml-containers
  ☆37Updated last week
• anyscale / e2e-llm-workflows
  Fine-tune an LLM to perform batch inference and online serving.
  ☆113Updated 4 months ago
• GoogleCloudPlatform / ai-on-gke
  AI on GKE is a collection of examples, best-practices, and prebuilt solutions to help build, deploy, and scale AI Platforms on Google Kub…
  ☆324Updated 4 months ago
• mystic-ai / pipeline
  Pipeline is an open source python SDK for building AI/ML workflows
  ☆138Updated last year