Alternatives and similar repositories for onnxruntime-web-benchmark:

Users that are interested in onnxruntime-web-benchmark are comparing it to the libraries listed below

• ggerganov / bert.cpp
  GGML implementation of BERT model with Python bindings and quantization.
  ☆27Updated 11 months ago
• microsoft / webnn-developer-preview
  ☆49Updated last month
• leo-du / llama2.rs
  Inference Llama 2 in one file of zero-dependency, zero-unsafe Rust
  ☆37Updated last year
• replicate / cog-vllm
  Run LLMs on Replicate with vLLM
  ☆15Updated 3 months ago
• FL33TW00D / embd
  GPU accelerated client-side embeddings for vector search, RAG etc.
  ☆66Updated last year
• Narsil / bloomserver
  ☆36Updated 2 years ago
• AXKuhta / rwkv-onnx-dml
  Run ONNX RWKV-v4 models with GPU acceleration using DirectML [Windows], or just on CPU [Windows AND Linux]; Limited to 430M model at this…
  ☆20Updated last year
• PINTO0309 / whisper-onnx-cpu
  ONNX implementation of Whisper. PyTorch free.
  ☆88Updated last month
• mithril-security / tokenizers-wasm
  wasm bindings for huggingface tokenizers library
  ☆35Updated 2 years ago
• character-ai / MuKoe
  ☆52Updated 8 months ago
• Narsil / hf-chat
  ☆25Updated last month
• SonicCodes / subcloning
  implementation of https://arxiv.org/pdf/2312.09299
  ☆20Updated 6 months ago
• RWKV / rwkv-onnx
  A converter and basic tester for rwkv onnx
  ☆42Updated 11 months ago
• microsoft / nxs
  Neural Network Execution Service
  ☆11Updated last year
• huggingface / optimum-furiosa
  Accelerated inference of 🤗 models using FuriosaAI NPU chips.
  ☆26Updated 7 months ago
• catid / bitnet_cpu
  Experiments with BitNet inference on CPU
  ☆52Updated 9 months ago
• epicure / llama2.js
  Inference Llama 2 in one file of pure JavaScript(HTML)
  ☆30Updated 6 months ago
• tairov / lamatune
  LLama implementations benchmarking framework
  ☆12Updated last year
• bipul1010 / agents_tutorial
  ☆19Updated 5 months ago
• mzbac / qlora-inference-multi-gpu
  ☆12Updated last year
• webmachinelearning / awesome-webnn
  ⚡Delightful WebNN resources, curated list of awesome things around WebNN ecosystem.😎
  ☆51Updated 2 months ago
• rahuldshetty / starcoder.js
  Web browser version of StarCoder.cpp
  ☆43Updated last year
• jquesnelle / ctranslate2-rs
  Rust bindings for CTranslate2
  ☆14Updated last year
• yuxdux / kinda-llama
  An open-source replication and extension of the Meta AI's LLAMA dataset
  ☆24Updated last year
• Mobile-Artificial-Intelligence / babylon.cpp
  Babylon.cpp is a C and C++ library for grapheme to phoneme conversion and text to speech synthesis. For phonemization a ONNX runtime port…
  ☆15Updated 4 months ago
• sdpython / onnxcustom
  Tutorial on how to convert machine learned models into ONNX
  ☆16Updated last year
• lukasVierling / FaceRWKV
  Course Project for COMP4471 on RWKV
  ☆16Updated 11 months ago
• iamlemec / bert.cpp
  GGML implementation of BERT model with Python bindings and quantization.
  ☆52Updated 10 months ago
• NolanoOrg / sparse_quant_llms
  SparseGPT + GPTQ Compression of LLMs like LLaMa, OPT, Pythia
  ☆41Updated last year
• microsoft / onnxruntime-tvm
  Open deep learning compiler stack for cpu, gpu and specialized accelerators
  ☆34Updated 2 years ago