FL33TW00D / wattkitLinks
☆14Updated 10 months ago
Alternatives and similar repositories for wattkit
Users that are interested in wattkit are comparing it to the libraries listed below
Sorting:
- Find out why your CoreML model isn't running on the Neural Engine!☆26Updated last year
- ModernBERT model optimized for Apple Neural Engine.☆27Updated 9 months ago
- iterate quickly with llama.cpp hot reloading. use the llama.cpp bindings with bun.sh☆50Updated last year
- Profile your CoreML models directly from Python 🐍☆28Updated last month
- ☆138Updated last year
- TensorRT-LLM server with Structured Outputs (JSON) built with Rust☆59Updated 5 months ago
- Experimental wasm32-unknown-wasi runtime for Python code execution☆37Updated 10 months ago
- ☆19Updated last year
- Thin wrapper around GGML to make life easier☆40Updated 3 months ago
- C API for MLX☆137Updated 2 weeks ago
- Semantic search webassembly module☆18Updated 11 months ago
- ☆25Updated 9 months ago
- Experimental compiler for deep learning models☆67Updated 3 weeks ago
- Add local LLMs to your Web or Electron apps! Powered by Rust + WebGPU☆104Updated 2 years ago
- Proof of concept for a generative AI application framework powered by WebAssembly and Extism☆14Updated 2 years ago
- Implementing the BitNet model in Rust☆39Updated last year
- Unofficial Rust bindings to Apple's mlx framework☆195Updated last week
- Turing machines, Rule 110, and A::B reversal using Claude 3 Opus.☆58Updated last year
- An educational Rust project for exporting and running inference on Qwen3 LLM family☆29Updated 2 months ago
- asynchronous/distributed speculative evaluation for llama3☆38Updated last year
- ☆15Updated 5 months ago
- A SQLite extension for generating text embeddings from remote APIs (OpenAI, Nomic, Ollama, llamafile...)☆136Updated 11 months ago
- GPU accelerated client-side embeddings for vector search, RAG etc.☆65Updated last year
- Because it's there.☆16Updated last year
- This repository has code for fine-tuning LLMs with GRPO specifically for Rust Programming using cargo as feedback☆107Updated 7 months ago
- Official Rust Implementation of Model2Vec☆138Updated last week
- jsgrad is a dependency-free ML library in Typescript for model inference and training with support to WebGPU and other runtimes.☆56Updated 5 months ago
- Build tools for LLMs in Rust using Model Context Protocol☆38Updated 7 months ago
- Fast serverless LLM inference, in Rust.☆94Updated 7 months ago
- ☆120Updated 3 months ago