⚡️ A fast and flexible PyTorch inference server that runs locally, on any cloud or AI HW.
☆147Jun 8, 2024Updated 2 years ago
Alternatives and similar repositories for nos
Users that are interested in nos are comparing it to the libraries listed below. We may earn a commission when you buy through links labeled 'Ad' on this page.
Sorting:
- ☆14Aug 25, 2024Updated last year
- ojjson is a library designed to facilitate JSON interactions with Ollama, a large language api (LLM). It leverages the power of Zod for s…☆12Nov 7, 2024Updated last year
- ☆19Feb 5, 2026Updated 5 months ago
- The (open-source part of) code to reproduce "BPPSA: Scaling Back-propagation by Parallel Scan Algorithm".☆13Jun 7, 2021Updated 5 years ago
- Simple LLM inference server☆20Jun 13, 2024Updated 2 years ago
- Proton VPN Special Offer - Get 70% off • AdSpecial partner offer. Trusted by over 100 million users worldwide. Tested, Approved and Recommended by Experts.
- Simple orchestration for EC2 spot containers☆19Sep 27, 2024Updated last year
- HTML in Python☆14Jul 19, 2024Updated 2 years ago
- Official implementation of the ANLS* metric☆25Jul 13, 2026Updated last week
- ☆60Jan 21, 2024Updated 2 years ago
- A sleek, customizable interface for managing LLMs with responsive design and easy agent personalization.☆18Aug 30, 2024Updated last year
- A guide to testing different runpod (and other linux VMs) configurations. Specifically the speed of LLM outputs☆18Jan 12, 2024Updated 2 years ago
- [NeurIPS 2024] The official implementation of "Image Copy Detection for Diffusion Models"☆18Oct 1, 2024Updated last year
- AI_Powered_Dev_Search_Engine☆12Mar 10, 2024Updated 2 years ago
- ☆13Feb 22, 2024Updated 2 years ago
- Wordpress hosting with auto-scaling - Free Trial Offer • AdFully Managed hosting for WordPress and WooCommerce businesses that need reliable, auto-scalable performance. Cloudways SafeUpdates now available.
- ☆17May 22, 2025Updated last year
- Universal connector to LLMs for Node.js & Bun☆30Updated this week
- Automated LLM novelist☆46Apr 11, 2024Updated 2 years ago
- A frontend for creative writing with LLMs☆168Jul 15, 2024Updated 2 years ago
- ☆15Dec 21, 2025Updated 7 months ago
- SGLang is fast serving framework for large language models and vision language models.☆36Nov 24, 2025Updated 7 months ago
- ☆15Sep 9, 2023Updated 2 years ago
- ☆36May 9, 2024Updated 2 years ago
- Public benchmark results from Kernel Arena, a leaderboard for LLM-generated AI accelerator kernels.☆20Mar 11, 2026Updated 4 months ago
- Deploy on Railway without the complexity - Free Credits Offer • AdConnect your repo and Railway handles the rest with instant previews. Quickly provision container image services, databases, and storage volumes.
- ☆20Sep 28, 2024Updated last year
- WIP: Ofen is a toolkit aimed at making transformer models production-ready. API included☆17Oct 2, 2024Updated last year
- Official implementation of Half-Quadratic Quantization (HQQ)☆949Feb 26, 2026Updated 4 months ago
- Multi-LoRA inference server that scales to 1000s of fine-tuned LLMs☆3,817May 28, 2026Updated last month
- 🔥 LitLytics - an affordable, simple analytics platform that leverages LLMs to automate data analysis☆103Nov 25, 2024Updated last year
- Ultrafast serverless GPU inference, sandboxes, and background jobs☆1,709Updated this week
- Easily create LLM automation/agent workflows☆60Feb 13, 2024Updated 2 years ago
- Ultra-low-latency, high-throughput multiprocess transport over SHM and mmap. LMAX-Disruptor-style cross-process ring substrate.☆17Updated this week
- Distribute and run AI workloads on Kubernetes magically in Python, like PyTorch for ML infra.☆1,224May 29, 2026Updated last month
- Managed hosting for WordPress and PHP on Cloudways • AdManaged hosting for WordPress, Magento, Laravel, or PHP apps, on multiple cloud providers. Deploy in minutes on Cloudways by DigitalOcean.
- Local Time Machine for OrbitDB☆11Feb 13, 2026Updated 5 months ago
- This repository is designed for deploying and managing server processes that handle embeddings using the Infinity Embedding model or Larg…☆25Mar 6, 2025Updated last year
- Testing pipeline for Exemplar-SVM in C++☆15Oct 15, 2013Updated 12 years ago
- Github repo of the CHARLIE AI interaction project☆14Aug 2, 2023Updated 2 years ago
- ☆10Aug 11, 2025Updated 11 months ago
- OpenAlpaca: A Fully Open-Source Instruction-Following Model Based On OpenLLaMA☆303Jun 13, 2023Updated 3 years ago
- The simplest way to serve AI/ML models in production☆1,177Updated this week