HyperMink / inferenceableLinks
Scalable AI Inference Server for CPU and GPU with Node.js | Utilizes llama.cpp and parts of llamafile C/C++ core under the hood.
☆14Updated last year
Alternatives and similar repositories for inferenceable
Users that are interested in inferenceable are comparing it to the libraries listed below
Sorting:
- Run Structured LLM Inference with Easy Parallelism☆16Updated 4 months ago
- convert natural language into technical diagrams☆14Updated 5 months ago
- Streamable multi-format serialization with schema☆22Updated 5 months ago
- This repository is designed for deploying and managing server processes that handle embeddings using the Infinity Embedding model or Larg…☆22Updated 3 months ago
- ☆10Updated last year
- Create embeddings for LLM using the Nomic API☆23Updated 6 months ago
- A text-to-SQL prototype on the northwind sqlite dataset☆12Updated 8 months ago
- 🔥 Helper program for setting up a Firecracker microVM on a fresh metal☆23Updated last year
- Ready to go EKS setup☆10Updated 9 months ago
- Dockerized FastAPI wrapper around the recognize-anything image recognition models☆25Updated last year
- Gateway and load balancer to your LLM inference endpoints☆22Updated 7 months ago
- An Agentic platform that allows you to define extensions☆27Updated last month
- An Infr app that automates data collection from your PC, macOS or Linux client.☆11Updated last year
- Secure, locally-run Retrieval-Augmented Generation system for document-based question-answering, utilizing Llama 3, Mistral, and Gemini m…☆24Updated 7 months ago
- ☆12Updated 2 months ago
- Example usages of the Scaffoldly toolchain.☆16Updated 5 months ago
- Search a JSON path and get the value fast☆22Updated 3 months ago
- ☆24Updated last year
- A Python library for real-time PostgreSQL event-driven cache invalidation.☆22Updated last month
- ☆12Updated 10 months ago
- LLM plugin for asking questions of LLM's own documentation, and related packages☆16Updated last month
- ⧉ Deploy containers over SSH.☆13Updated 4 months ago
- pglineage is a tool to create data flow diagrams for PostgreSQL by analyzing SQL☆16Updated last year
- Git scrapers for scraping the fediverse☆17Updated this week
- Python package for extractive NLP using the OpenAI API☆17Updated 9 months ago
- Pollux payload core files and examples☆3Updated 3 weeks ago
- 360M model running in the browser on WebGPU☆22Updated 9 months ago
- Load generator for TCP servers.☆20Updated last year
- LLM code editor for backend services☆14Updated 7 months ago
- Automatically pass your funcions defined in Python to ChatGPT have it call them back seemlessly.☆13Updated last year