Alternatives and similar repositories for cascade

Users that are interested in cascade are comparing it to the libraries listed below

• DBOS-project / apiary
  Transactional functions-as-a-service for database-oriented applications.
  ☆156Updated 2 years ago
• tensorwavecloud / ScalarLM
  ScalarLM - a unified training and inference stack
  ☆93Updated last month
• InferenceMAX / InferenceMAX
  Open Source Continuous Inference Benchmarking - GB200 NVL72 vs MI355X vs B200 vs H200 vs MI325X & soon™ TPUv6e/v7/Trainium2/3/GB300 NVL72…
  ☆400Updated this week
• perplexityai / pplx-garden
  Perplexity open source garden for inference technology
  ☆306Updated 2 weeks ago
• xetdata / xet-core
  Rust crates for XetHub
  ☆75Updated last year
• GPUprobe / gpuprobe-daemon
  Lightweight daemon for monitoring CUDA runtime API calls with eBPF uprobes
  ☆143Updated 8 months ago
• coreweave / ml-containers
  ☆43Updated this week
• ScalingIntelligence / tokasaurus
  ☆461Updated last month
• facebookresearch / DCPerf
  DCPerf benchmark suite for hyperscale cloud applications
  ☆225Updated this week
• Derecho-Project / derecho
  The main code repository for the Derecho project.
  ☆204Updated last week
• deepreinforce-ai / CUDA-L2
  CUDA-L2: Surpassing cuBLAS Performance for Matrix Multiplication through Reinforcement Learning
  ☆225Updated last week
• perplexityai / libfabric-efa-demo
  ☆72Updated 10 months ago
• facebookincubator / dynolog
  Dynolog is a telemetry daemon for performance monitoring and tracing. It exports metrics from different components in the system like the…
  ☆356Updated this week
• ml-energy / zeus
  Measure and optimize the energy consumption of your AI applications!
  ☆325Updated last month
• meta-pytorch / torchcomms
  torchcomms: a modern PyTorch communications API
  ☆309Updated last week
• intel / llm-on-ray
  Pretrain, finetune and serve LLMs on Intel platforms with Ray
  ☆131Updated 3 months ago
• cgftinc / benchmax
  Framework-Agnostic RL Environments for LLM Fine-Tuning
  ☆39Updated 3 weeks ago
• google / minja
  A minimalistic C++ Jinja templating engine for LLM chat templates
  ☆202Updated 3 months ago
• pyember / ember
  ☆234Updated 6 months ago
• NVIDIA / cuda-checkpoint
  CUDA checkpoint and restore utility
  ☆397Updated 3 months ago
• mileszim / awesome-vector-database
  Awesome List of Vector DB resources
  ☆174Updated 2 years ago
• zipnn / zipnn
  A Lossless Compression Library for AI pipelines
  ☆289Updated 5 months ago
• intel / iaprof
  AI/GPU flame graph
  ☆232Updated 2 months ago
• run-ai / runai-model-streamer
  ☆273Updated last week
• sgl-project / sgl-project.github.io
  This is the documentation repository for SGLang. It is auto-generated from https://github.com/sgl-project/sglang/tree/main/docs.
  ☆95Updated this week
• okuvshynov / cubestat
  Horizon chart for CPU/GPU/Neural Engine utilization monitoring. Supports Apple M1-M4, Nvidia GPUs, AMD GPUs
  ☆26Updated 4 months ago
• NVIDIA-AI-Blueprints / llm-router
  Route LLM requests to the best model for the task at hand.
  ☆145Updated this week
• SzymonOzog / Penny
  Hand-Rolled GPU communications library
  ☆76Updated last month
• puppygraph / puppygraph-query
  PuppyGraph standalone web server for visualize graph queries.
  ☆45Updated 10 months ago
• jbarrow / tinyhnsw
  build your own vector database -- the littlest hnsw
  ☆67Updated 11 months ago