Serve LLMs on NCSA hardware. Support the best FOSS models, and the long tail on HuggingFace Hub.
☆14May 8, 2024Updated last year
Alternatives and similar repositories for llm-serving
Users that are interested in llm-serving are comparing it to the libraries listed below. We may earn a commission when you buy through links labeled 'Ad' on this page.
Sorting:
- ☆11Feb 19, 2024Updated 2 years ago
- Clowder v2 (in development)☆15Mar 18, 2026Updated last month
- Chat with your documents. Upload anything, get answers.☆34Updated this week
- API backend for UIUC AI Teaching Assistant.☆27Updated this week
- Multi-agent Reinforcement Learning, 14th in 701 teams - NeurIPS 2024 Competition☆14Mar 13, 2025Updated last year
- Managed Kubernetes at scale on DigitalOcean • AdDigitalOcean Kubernetes includes the control plane, bandwidth allowance, container registry, automatic updates, and more for free.
- Official codebase for our paper "Do Language Models Use Their Depth Efficiently?"☆29Jun 25, 2025Updated 10 months ago
- ☆31Jan 9, 2025Updated last year
- The UX & driver code for the multi-model TA_Chatbot☆33Apr 16, 2023Updated 3 years ago
- Weekly data science workshops for SIG AIDA at UIUC.☆12Jun 22, 2022Updated 3 years ago
- https://footprints.baulab.info☆18Oct 4, 2024Updated last year
- A Python (Flask-based) web application implementing the Modern Research Data Portal pattern using the Globus platform.☆36Oct 25, 2024Updated last year
- Example Cloud Datalab iPython Notebooks for genomics use cases.☆25Sep 5, 2017Updated 8 years ago
- Library to assist in the development of extractors for clowder.☆12Mar 18, 2025Updated last year
- DAG-based workflow engine for Android and low-resource environments, built for mobile-first automation..☆33Mar 17, 2026Updated last month
- Managed Database hosting by DigitalOcean • AdPostgreSQL, MySQL, MongoDB, Kafka, Valkey, and OpenSearch available. Automatically scale up storage and focus on building your apps.
- Source code of Julian Valentin's PhD thesis (arXiv version): “B-Splines for Sparse Grids: Algorithms and Application to Higher-Dimensiona…☆12Nov 28, 2020Updated 5 years ago
- A Jupyter Extension for Adding Pug Photos to Your Notebook☆11Mar 2, 2016Updated 10 years ago
- High-performance embedded graph database for analytics and real-time transactions☆86Apr 29, 2026Updated last week
- A generative foundation model for digital histopathology images☆28Apr 7, 2026Updated 3 weeks ago
- Next generation of SuRVoS☆10Oct 11, 2023Updated 2 years ago
- Fastapi boilerplate for API with user management and authentication using Keycloak☆10Jun 25, 2021Updated 4 years ago
- A Structural Average of Labeled Merge Trees for Uncertainty Visualization☆10Apr 22, 2024Updated 2 years ago
- VTK-m Tutorial code samples☆10Dec 6, 2021Updated 4 years ago
- This web app can be used to compute and visualize featurized PH barcodes.☆12Jul 29, 2024Updated last year
- Deploy to Railway using AI coding agents - Free Credits Offer • AdUse Claude Code, Codex, OpenCode, and more. Autonomous software development now has the infrastructure to match with Railway.
- 🦅🔗 Building FlyteGPT on Flyte with LangChain☆30Jan 23, 2024Updated 2 years ago
- Rust library for parsing regular languages☆16Feb 12, 2016Updated 10 years ago
- Python package template☆19Updated this week
- A modular platform for managing, processing, and visualizing UAS data. Built on a FastAPI backend with a documented API, a React + TypeSc…☆22Updated this week
- Proxy and universal translation server to Argo API, OpenAI (Chat+Responses), Anthropic (Messages), Google (GenAI) format compatible☆21Apr 26, 2026Updated last week
- ☆26Aug 10, 2021Updated 4 years ago
- Image Recognition System for a Smart Fridge. Written at T-Mobile's 2017 IOT Hackathon.☆14Apr 25, 2018Updated 8 years ago
- Code for the paper "Speculative Progressive Raycasting for Memory Constrained Isosurface Visualization of Massive Volumes"☆19Jan 25, 2024Updated 2 years ago
- ☆12Mar 14, 2015Updated 11 years ago
- Deploy on Railway without the complexity - Free Credits Offer • AdConnect your repo and Railway handles the rest with instant previews. Quickly provision container image services, databases, and storage volumes.
- ☆18Dec 9, 2025Updated 4 months ago
- ☆24Apr 23, 2025Updated last year
- A tool to support interactive machine learning for cryoET data☆12Aug 30, 2024Updated last year
- XCDF: eXplicitly Compacted Data Format. See documentation at Read the Docs:☆15Dec 18, 2023Updated 2 years ago
- Official Implementation of "CheckEmbed: Effective Verification of LLM Solutions to Open-Ended Tasks"☆23Jun 17, 2025Updated 10 months ago
- Topology Guided Volume Exploration☆19Dec 15, 2018Updated 7 years ago
- [Cell Patterns] Codes for paper: scELMo: Embeddings from Language Models are Good Learners for Single-cell Data Analysis☆23Jan 31, 2026Updated 3 months ago