HyperMink / inferenceable
Scalable AI Inference Server for CPU and GPU with Node.js | Utilizes llama.cpp and parts of llamafile C/C++ core under the hood.
☆14Updated 10 months ago
Alternatives and similar repositories for inferenceable:
Users that are interested in inferenceable are comparing it to the libraries listed below
- Run Structured LLM Inference with Easy Parallelism☆16Updated 2 months ago
- Streamable multi-format serialization with schema☆22Updated 3 months ago
- convert natural language into technical diagrams☆12Updated 3 months ago
- Create embeddings for LLM using the Nomic API☆23Updated 4 months ago
- ☆10Updated 10 months ago
- Search a JSON path and get the value fast☆21Updated last month
- ☆12Updated 3 weeks ago
- A tiny distributable Node server for serving web pages written in Markdown☆11Updated last year
- A JSX-native peer-to-peer browser that runs on Node.☆11Updated 11 months ago
- 🤖 manage virtual machines 🖥️ in multi cloud ☁️☆46Updated this week
- IceDB S3 Proxy to trick S3 clients into only seeing alive files☆12Updated last year
- A lightweight Python utility that aggregates and exports comprehensive system information to JSON, specifically designed for feeding syst…☆12Updated last month
- A Python library for real-time PostgreSQL event-driven cache invalidation.☆21Updated 2 months ago
- Smart File Templates for VSCode is an extension that helps you work faster by letting you create your own file templates. You decide the …☆19Updated 2 months ago
- 🔥 Helper program for setting up a Firecracker microVM on a fresh metal☆21Updated last year
- Messaging System backed by PostgreSQL☆11Updated 5 months ago
- Gateway and load balancer to your LLM inference endpoints☆21Updated 5 months ago
- Vector Embedding Server in under 100 lines of code☆22Updated last year
- Query databases and tables with AI assistance☆16Updated 11 months ago
- tsellm: LLMs in SQLite and DuckDB☆22Updated 7 months ago
- Automatically pass your funcions defined in Python to ChatGPT have it call them back seemlessly.☆13Updated last year
- ☆24Updated last year
- pip installable duckdb extensions published to pypi☆18Updated 3 weeks ago
- Self-hostable headless QR code generator☆16Updated 6 months ago
- Platform for apps.☆35Updated 9 months ago
- 360M model running in the browser on WebGPU☆21Updated 7 months ago
- A collection of tools that can be used for LLM function calling☆33Updated last year
- A simple github actions script to build a llamafile and uploads to huggingface☆14Updated last year
- ☆12Updated 7 months ago
- HandyDash is a cross-platform HTTP, TCP, and IP monitoring tool, intended for desktop use. It is agent free, requires no installation, an…☆16Updated 7 months ago