HyperMink / inferenceableLinks
Scalable AI Inference Server for CPU and GPU with Node.js | Utilizes llama.cpp and parts of llamafile C/C++ core under the hood.
☆14Updated last year
Alternatives and similar repositories for inferenceable
Users that are interested in inferenceable are comparing it to the libraries listed below
Sorting:
- Run Structured LLM Inference with Easy Parallelism☆16Updated 5 months ago
- convert natural language into technical diagrams☆14Updated 7 months ago
- Streamable multi-format serialization with schema☆22Updated 7 months ago
- dpq is an open-source python library that makes prompt-based data transformations and feature engineering easy☆24Updated last year
- ☆10Updated last year
- A Python library for real-time PostgreSQL event-driven cache invalidation.☆22Updated 2 months ago
- A JSX-native peer-to-peer browser that runs on Node, with a custom renderer based on SDL (no DOM).☆11Updated last year
- Files and processes management in Python☆54Updated this week
- Pollux payload core files and examples☆3Updated 2 months ago
- Define and implement any functions on the fly with LLMs☆11Updated last year
- A lightweight tool that converts directory contents into structured output optimized for LLM interpretation, featuring Git-aware file ord…☆16Updated last week
- Asynchronous tasks on the cloud☆21Updated last year
- Gateway and load balancer to your LLM inference endpoints☆23Updated 8 months ago
- Secure, locally-run Retrieval-Augmented Generation system for document-based question-answering, utilizing Llama 3, Mistral, and Gemini m…☆24Updated 9 months ago
- Environment Variables Encryption Tool☆11Updated 10 months ago
- Easy-to-use Github Actions with AI Capabilities for Powerful Automations☆28Updated 10 months ago
- A tiny distributable Node server for serving web pages written in Markdown☆11Updated last year
- A versatile Go tool for effortlessly generating mock HTTP APIs for all your needs.☆15Updated 8 months ago
- like gron, but generalised on indentation☆16Updated last year
- An open-source alternative for ridesharing and hitchhiking☆13Updated 4 months ago
- LLM plugin for asking questions of LLM's own documentation, and related packages☆20Updated 2 months ago
- Data Neuron is a powerful framework that enables you to build text-to-SQL applications with an easily maintainable semantic layer. Whethe…☆42Updated 10 months ago
- Warrant Edge agent☆22Updated 3 months ago
- MCP that combats tools overload☆20Updated last week
- ☆12Updated 11 months ago
- Dockerized FastAPI wrapper around the recognize-anything image recognition models☆25Updated last year
- A library for generating structured JSON using GPT-4o.☆13Updated 11 months ago
- Ready-to-use small set of development tools☆21Updated last year
- A Python micro framework for creating LLM-driven agents☆23Updated last month
- A modular, RedisTimeSeries-native observability agent. Designed for developers, tinkerers, and infrastructure teams who want full contro…☆24Updated last month