⚡️ A fast and flexible PyTorch inference server that runs locally, on any cloud or AI HW.
☆147Jun 8, 2024Updated last year
Alternatives and similar repositories for nos
Users that are interested in nos are comparing it to the libraries listed below. We may earn a commission when you buy through links labeled 'Ad' on this page.
Sorting:
- Substrate TypeScript SDK☆10Sep 20, 2024Updated last year
- Simple orchestration for EC2 spot containers☆19Sep 27, 2024Updated last year
- ☆14Aug 25, 2024Updated last year
- ojjson is a library designed to facilitate JSON interactions with Ollama, a large language api (LLM). It leverages the power of Zod for s…☆12Nov 7, 2024Updated last year
- The (open-source part of) code to reproduce "BPPSA: Scaling Back-propagation by Parallel Scan Algorithm".☆13Jun 7, 2021Updated 4 years ago
- Virtual machines for every use case on DigitalOcean • AdGet dependable uptime with 99.99% SLA, simple security tools, and predictable monthly pricing with DigitalOcean's virtual machines, called Droplets.
- Simple LLM inference server☆20Jun 13, 2024Updated last year
- ☆36Updated this week
- Paper-reading notes for Berkeley OS prelim exam.☆14Aug 28, 2024Updated last year
- Example of a Streamlit data app powered by Vaex☆11Jul 7, 2022Updated 3 years ago
- Repo for training MLMs, CLMs, or T5-type models on the OLM pretraining data, but it should work with any hugging face text dataset.☆97Feb 9, 2023Updated 3 years ago
- A guide to testing different runpod (and other linux VMs) configurations. Specifically the speed of LLM outputs☆17Jan 12, 2024Updated 2 years ago
- A sleek, customizable interface for managing LLMs with responsive design and easy agent personalization.☆17Aug 30, 2024Updated last year
- Fast and easy Jupyter notebooks☆13Mar 7, 2023Updated 3 years ago
- ☆13Feb 22, 2024Updated 2 years ago
- Managed Database hosting by DigitalOcean • AdPostgreSQL, MySQL, MongoDB, Kafka, Valkey, and OpenSearch available. Automatically scale up storage and focus on building your apps.
- A stable, fast and easy-to-use inference library with a focus on a sync-to-async API☆48Sep 26, 2024Updated last year
- ☆17May 22, 2025Updated 11 months ago
- SGLang is fast serving framework for large language models and vision language models.☆34Nov 24, 2025Updated 5 months ago
- [ICLR 2026] Adapting Self-Supervised Representations as a Latent Space for Efficient Generation☆53Apr 24, 2026Updated 3 weeks ago
- A web-app to explore topics using LLM (less typing and more clicks)☆67Mar 15, 2026Updated 2 months ago
- ☆68May 23, 2025Updated 11 months ago
- Universal connector to LLMs for Node.js & Bun☆30Updated this week
- A frontend for creative writing with LLMs☆159Jul 15, 2024Updated last year
- A really tiny autograd engine☆100May 26, 2025Updated 11 months ago
- 1-Click AI Models by DigitalOcean Gradient • AdDeploy popular AI models on DigitalOcean Gradient GPU virtual machines with just a single click. Zero configuration with optimized deployments.
- ☆24Dec 27, 2024Updated last year
- Automated LLM novelist☆47Apr 11, 2024Updated 2 years ago
- ☆14Dec 21, 2025Updated 4 months ago
- Official implementation of Half-Quadratic Quantization (HQQ)☆939Feb 26, 2026Updated 2 months ago
- Multi-LoRA inference server that scales to 1000s of fine-tuned LLMs☆3,781May 21, 2025Updated 11 months ago
- Releasing the spot availability traces used in "Can't Be Late" paper.☆26Mar 31, 2024Updated 2 years ago
- Interface for interacting with Gradient AI in Python☆15Jun 28, 2024Updated last year
- WIP: Ofen is a toolkit aimed at making transformer models production-ready. API included☆17Oct 2, 2024Updated last year
- Easily create LLM automation/agent workflows☆60Feb 13, 2024Updated 2 years ago
- AI Agents on DigitalOcean Gradient AI Platform • AdBuild production-ready AI agents using customizable tools or access multiple LLMs through a single endpoint. Create custom knowledge bases or connect external data.
- Privacy-Preserving Bandits (MLSys'20)☆22Dec 8, 2022Updated 3 years ago
- ☆35May 9, 2024Updated 2 years ago
- Distribute and run AI workloads on Kubernetes magically in Python, like PyTorch for ML infra.☆1,205Apr 13, 2026Updated last month
- Agentic Keyframe Search for Video Question Answering☆18Apr 7, 2025Updated last year
- ☆20Sep 28, 2024Updated last year
- Finetune llama2-70b and codellama on MacBook Air without quantization☆450Mar 28, 2024Updated 2 years ago
- 🔥 LitLytics - an affordable, simple analytics platform that leverages LLMs to automate data analysis☆104Nov 25, 2024Updated last year