HyperMink / inferenceable
Scalable AI Inference Server for CPU and GPU with Node.js | Utilizes llama.cpp and parts of llamafile C/C++ core under the hood.
☆14Updated 8 months ago
Alternatives and similar repositories for inferenceable:
Users that are interested in inferenceable are comparing it to the libraries listed below
- Run Structured LLM Inference with Easy Parallelism☆15Updated this week
- convert natural language into technical diagrams☆12Updated last month
- ☆10Updated 8 months ago
- ☆12Updated 5 months ago
- Streamable multi-format serialization with schema☆22Updated last month
- Automatically pass your funcions defined in Python to ChatGPT have it call them back seemlessly.☆13Updated last year
- 360M model running in the browser on WebGPU☆20Updated 5 months ago
- Define and implement any functions on the fly with LLMs☆11Updated 8 months ago
- Pragmatic framework to build LLM Copilots☆17Updated 3 weeks ago
- A JSX-native peer-to-peer browser that runs on Node.☆11Updated 9 months ago
- Web Interface for Vision Language Models Including InternVLM2☆17Updated 6 months ago
- Gateway and load balancer to your LLM inference endpoints☆19Updated 2 months ago
- A simple github actions script to build a llamafile and uploads to huggingface☆12Updated last year
- Create embeddings for LLM using the Nomic API☆21Updated 2 months ago
- A Python library for real-time PostgreSQL event-driven cache invalidation.☆21Updated last week
- Use GPTparser with your OpenAI API to scrape & parse files into structured JSON files.☆13Updated 9 months ago
- Secure, locally-run Retrieval-Augmented Generation system for document-based question-answering, utilizing Llama 3, Mistral, and Gemini m…☆23Updated 3 months ago
- A library for generating structured JSON using GPT-4o.☆13Updated 5 months ago
- 🔥 Helper program for setting up a Firecracker microVM on a fresh metal☆21Updated last year
- A tiny distributable Node server for serving web pages written in Markdown☆11Updated last year
- LLM code editor for backend services☆14Updated 3 months ago
- Ready to go EKS setup☆10Updated 4 months ago
- pip installable duckdb extensions published to pypi☆16Updated last month
- Platform for apps.☆35Updated 7 months ago
- An open-source alternative for ridesharing and hitchhiking☆13Updated 2 months ago
- ☆24Updated this week
- ☆12Updated 5 months ago
- An interface for llama.cpp, ChatGPT, and Gemini☆24Updated this week
- Dillusion is the dillo of the future☆9Updated 6 months ago
- Data Neuron is a powerful framework that enables you to build text-to-SQL applications with an easily maintainable semantic layer. Whethe…☆44Updated 5 months ago