HyperMink / inferenceable
Scalable AI Inference Server for CPU and GPU with Node.js | Utilizes llama.cpp and parts of llamafile C/C++ core under the hood.
☆14Updated 10 months ago
Alternatives and similar repositories for inferenceable:
Users that are interested in inferenceable are comparing it to the libraries listed below
- Run Structured LLM Inference with Easy Parallelism☆16Updated 3 months ago
- Streamable multi-format serialization with schema☆22Updated 4 months ago
- ☆12Updated last month
- convert natural language into technical diagrams☆14Updated 4 months ago
- Optimum graph creation and distribution for underground networks.☆33Updated 10 months ago
- Search a JSON path and get the value fast☆22Updated 2 months ago
- 🔥 Helper program for setting up a Firecracker microVM on a fresh metal☆22Updated last year
- A simple github actions script to build a llamafile and uploads to huggingface☆14Updated last year
- Full-Stack Configuration Management for Developers and Sysadmins☆32Updated 2 weeks ago
- Dillusion is the dillo of the future☆9Updated 9 months ago
- Messaging System backed by PostgreSQL☆11Updated 5 months ago
- A GUI-based AI development tool with integrated Metaphor support☆37Updated this week
- A tiny distributable Node server for serving web pages written in Markdown☆11Updated last year
- Load generator for TCP servers.☆20Updated last year
- Example usages of the Scaffoldly toolchain.☆16Updated 4 months ago
- Browser VisitVault is a powerful Chrome extension designed to enhance your browsing experience by providing comprehensive tracking and or…☆10Updated 3 months ago
- Platform for apps.☆35Updated 10 months ago
- recipes for BASH, Docker and more☆13Updated 2 months ago
- Create embeddings for LLM using the Nomic API☆23Updated 5 months ago
- LLM plugin for asking questions of LLM's own documentation, and related packages☆14Updated 2 weeks ago
- 360M model running in the browser on WebGPU☆21Updated 8 months ago
- A lightweight Python utility that aggregates and exports comprehensive system information to JSON, specifically designed for feeding syst…☆12Updated 2 weeks ago
- Vector Embedding Server in under 100 lines of code☆22Updated last year
- Unofficial No Such Thing As A Fish episode transcripts.☆19Updated this week
- Automatically pass your funcions defined in Python to ChatGPT have it call them back seemlessly.☆13Updated last year
- ☆10Updated 11 months ago
- Ready to go EKS setup☆10Updated 7 months ago
- Git scrapers for scraping the fediverse☆16Updated this week
- A versatile Go tool for effortlessly generating mock HTTP APIs for all your needs.☆16Updated 6 months ago
- An Agentic platform that allows you to define extensions☆27Updated 2 weeks ago