Alternatives and similar repositories for cascade

Users that are interested in cascade are comparing it to the libraries listed below

• DBOS-project / apiary
  Transactional functions-as-a-service for database-oriented applications.
  ☆155Updated 2 years ago
• tensorwavecloud / ScalarLM
  ScalarLM - a unified training and inference stack
  ☆96Updated 2 months ago
• coreweave / ml-containers
  ☆44Updated this week
• tensorchord / ai-infra-landscape
  This is a landscape of the infrastructure that powers the generative AI ecosystem
  ☆151Updated last year
• katsumiok / pyaskit
  AskIt: Unified programming interface for programming with LLMs (GPT-3.5, GPT-4, Gemini, Claude, Cohere, Llama 2)
  ☆80Updated last year
• perplexityai / pplx-garden
  Perplexity open source garden for inference technology
  ☆359Updated last month
• UCB-ADRS / ADRS
  AI-Driven Research Systems (ADRS)
  ☆117Updated last month
• yandex-research / swarm
  Official code for "SWARM Parallelism: Training Large Models Can Be Surprisingly Communication-Efficient"
  ☆149Updated 2 years ago
• ml-energy / zeus
  Measure and optimize the energy consumption of your AI applications!
  ☆331Updated 3 weeks ago
• xetdata / xet-core
  Rust crates for XetHub
  ☆78Updated last year
• perplexityai / libfabric-efa-demo
  ☆71Updated 11 months ago
• InferenceMAX / InferenceMAX
  Open Source Continuous Inference Benchmarking - GB200 NVL72 vs MI355X vs B200 vs GB300 NVL72 vs H100 & soon™ TPUv6e/v7/Trainium2/3- DeepS…
  ☆445Updated this week
• furiousteabag / vram-calculator
  Transformer GPU VRAM estimator
  ☆68Updated last year
• spectral-compute / scale-examples
  ☆66Updated last year
• skypilot-org / skypilot-catalog
  ☆27Updated this week
• sgl-project / sgl-project.github.io
  This is the documentation repository for SGLang. It is auto-generated from https://github.com/sgl-project/sglang
  ☆100Updated this week
• intel / llm-on-ray
  Pretrain, finetune and serve LLMs on Intel platforms with Ray
  ☆131Updated 4 months ago
• deepreinforce-ai / CUDA-L2
  CUDA-L2: Surpassing cuBLAS Performance for Matrix Multiplication through Reinforcement Learning
  ☆417Updated 3 weeks ago
• dropbox / aana_sdk
  Aana SDK is a powerful framework for building AI enabled multimodal applications.
  ☆55Updated 5 months ago
• GPUprobe / gpuprobe-daemon
  Lightweight daemon for monitoring CUDA runtime API calls with eBPF uprobes
  ☆146Updated 10 months ago
• google / minja
  A minimalistic C++ Jinja templating engine for LLM chat templates
  ☆202Updated 4 months ago
• compound-ai-systems / awesome-compound-ai-systems
  A curated list of awesome Compound AI Systems
  ☆35Updated 7 months ago
• antirez / LLM-FTC-sampling
  First token cutoff sampling inference example
  ☆30Updated 2 years ago
• eth-easl / mixtera
  A lightweight, user-friendly data-plane for LLM training.
  ☆38Updated 4 months ago
• jbarrow / tinyhnsw
  build your own vector database -- the littlest hnsw
  ☆67Updated last year
• CentML / DeepView.Profile
  🏙 Interactive performance profiling and debugging tool for PyTorch neural networks.
  ☆64Updated last year
• LambdaLabsML / llama
  Inference code for LLaMA models
  ☆41Updated 2 years ago
• IBM / analog-foundation-models
  Code for paper "Analog Foundation Models"
  ☆30Updated 4 months ago
• tyler-griggs / melange-release
  ☆48Updated last year
• ScalingIntelligence / tokasaurus
  ☆465Updated 2 months ago