Alternatives and similar repositories for ggml-js:

Users that are interested in ggml-js are comparing it to the libraries listed below

• ahoylabs / gguf.js
  A Javascript library (with Typescript types) to parse metadata of GGML based GGUF files.
  ☆47Updated 7 months ago
• kayvr / token-hawk
  WebGPU LLM inference tuned by hand
  ☆149Updated last year
• FL33TW00D / laserbeak
  Add local LLMs to your Web or Electron apps! Powered by Rust + WebGPU
  ☆102Updated last year
• IntrinsicLabsAI / gbnfgen
  TypeScript generator for llama.cpp Grammar directly from TypeScript interfaces
  ☆136Updated 8 months ago
• lachlansneff / sparsellama
  ☆40Updated last year
• FL33TW00D / embd
  GPU accelerated client-side embeddings for vector search, RAG etc.
  ☆66Updated last year
• RWKV / RWKV-cpp-node
  Node.js implementation binding for the RWKV.cpp module
  ☆20Updated last year
• epicure / llama2.js
  Inference Llama 2 in one file of pure JavaScript(HTML)
  ☆31Updated 8 months ago
• Maximilian-Winter / llama_cpp_function_calling
  ☆31Updated last year
• wozeparrot / tinyrwkv
  tinygrad port of the RWKV large language model.
  ☆44Updated this week
• josephrocca / rwkv-v4-web
  BlinkDL's RWKV-v4 running in the browser
  ☆47Updated 2 years ago
• VatsaDev / NanoPhi-alpha
  GPT-2 small trained on phi-like data
  ☆65Updated last year
• spirobel / bunny-llama
  iterate quickly with llama.cpp hot reloading. use the llama.cpp bindings with bun.sh
  ☆48Updated last year
• hora-search / hora-wasm
  webassembly binding for Hora Approximate Nearest Neighbor Search Library
  ☆55Updated 3 years ago
• euclaise / SlimTrainer
  Full finetuning of large language models without large memory requirements
  ☆93Updated last year
• pranavjad / tinyllama-bitnet
  Train your own small bitnet model
  ☆65Updated 4 months ago
• gsuuon / ad-llama
  Structured inference with Llama 2 in your browser
  ☆52Updated 4 months ago
• 3outeille / GPTQ-for-RWKV
  ☆13Updated last year
• ggerganov / vit.cpp
  Inference Vision Transformer (ViT) in plain C/C++ with ggml
  ☆30Updated last year
• frost-beta / llama3.js
  A JavaScript implementation of Llama 3 using node-mlx.
  ☆72Updated 7 months ago
• bwasti / brr.js
  trying to make WebGPU a bit easier to use
  ☆16Updated last year
• ggml-org / p1
  LLM-based code completion engine
  ☆181Updated last month
• kir-gadjello / zipslicer
  A library for incremental loading of large PyTorch checkpoints
  ☆56Updated 2 years ago
• frost-beta / node-mlx
  Machine learning framework for Node.js.
  ☆191Updated 3 weeks ago
• RWKV / rwkv-onnx
  A converter and basic tester for rwkv onnx
  ☆42Updated last year
• Birch-san / falcon-play
  Command-line script for inferencing from models such as falcon-7b-instruct
  ☆76Updated last year
• cryscan / web-rwkv
  Implementation of the RWKV language model in pure WebGPU/Rust.
  ☆294Updated this week
• rahuldshetty / llm.js
  Run Large-Language Models (LLMs) 🚀 directly in your browser!
  ☆186Updated 6 months ago
• abetlen / ggml-python
  Python bindings for ggml
  ☆140Updated 6 months ago
• Prunoideae / web-rwkv-axum
  A highly customizable, full scale web backend for web-rwkv, built on axum with websocket protocol.
  ☆26Updated 10 months ago