Alternatives and similar repositories for genc:

Users that are interested in genc are comparing it to the libraries listed below

• AI-Hypercomputer / JetStream
  JetStream is a throughput and memory optimized engine for LLM inference on XLA devices, starting with TPUs (and GPUs in future -- PRs wel…
  ☆274Updated this week
• AI-Hypercomputer / gpu-recipes
  Recipes for reproducing training and serving benchmarks for large machine learning models using GPUs on Google Cloud.
  ☆34Updated last week
• AI-Hypercomputer / xpk
  xpk (Accelerated Processing Kit, pronounced x-p-k,) is a software tool to help Cloud developers to orchestrate training jobs on accelerat…
  ☆103Updated this week
• google / minja
  A minimalistic C++ Jinja templating engine for LLM chat templates
  ☆120Updated last week
• pytorch / torchft
  PyTorch per step fault tolerance (actively under development)
  ☆243Updated this week
• AI-Hypercomputer / jetstream-pytorch
  PyTorch/XLA integration with JetStream (https://github.com/google/JetStream) for LLM inference"
  ☆51Updated last week
• ByronHsu / FlyteGPT
  🦅🔗 Building FlyteGPT on Flyte with LangChain
  ☆29Updated last year
• GoogleCloudPlatform / llm-pipeline-examples
  ☆133Updated last year
• huggingface / optimum-tpu
  Google TPU optimizations for transformers models
  ☆98Updated 3 weeks ago
• GoogleCloudPlatform / solutions-genai-llm-workshop
  Generative AI Language (PaLM2 + Langchain) Workshop sample codes
  ☆72Updated 9 months ago
• furiousteabag / vram-calculator
  Transformer GPU VRAM estimator
  ☆49Updated 10 months ago
• bentoml / BentoVLLM
  Self-host LLMs with vLLM and BentoML
  ☆86Updated this week
• fixie-ai / ai-benchmarks
  Benchmarking suite for popular AI APIs
  ☆80Updated last week
• AI-Hypercomputer / maxdiffusion
  ☆184Updated this week
• google / saxml
  ☆132Updated 2 weeks ago
• anyscale / e2e-llm-workflows
  End-to-End LLM Guide
  ☆101Updated 7 months ago
• apple / ml-recurrent-drafter
  ☆197Updated 3 weeks ago
• huggingface / optimum-habana
  Easy and lightning fast training of 🤗 Transformers on Habana Gaudi processor (HPU)
  ☆170Updated this week
• huggingface / Google-Cloud-Containers
  Hugging Face Deep Learning Containers (DLCs) for Google Cloud
  ☆141Updated 3 weeks ago
• google / rag-playground
  ☆30Updated last month
• fw-ai / benchmark
  Benchmark suite for LLMs from Fireworks.ai
  ☆66Updated last week
• GoogleCloudPlatform / ml-auto-solutions
  A simplified and automated orchestration workflow to perform ML end-to-end (E2E) model tests and benchmarking on Cloud VMs across differe…
  ☆35Updated this week
• run-ai / llmperf
  ☆52Updated 5 months ago
• EmbeddedLLM / vllm
  vLLM: A high-throughput and memory-efficient inference and serving engine for LLMs
  ☆88Updated this week
• AI-Hypercomputer / ml-goodput-measurement
  ☆11Updated 2 weeks ago
• GoogleCloudPlatform / google-cloud-ai-demos
  ☆84Updated this week
• gclouduniverse / reproducibility
  ☆14Updated last month
• groq / groqflow
  GroqFlow provides an automated tool flow for compiling machine learning and linear algebra workloads into Groq programs and executing tho…
  ☆106Updated 2 months ago
• NVIDIA / nim-deploy
  A collection of YAML files, Helm Charts, Operator code, and guides to act as an example reference implementation for NVIDIA NIM deploymen…
  ☆157Updated last week
• octoml / octoml-profile
  Home for OctoML PyTorch Profiler
  ☆107Updated last year