This repository is designed for deploying and managing server processes that handle embeddings using the Infinity Embedding model or Large Language Models with an OpenAI compatible vLLM server.
☆25Mar 6, 2025Updated last year
Alternatives and similar repositories for llm-hosting
Users that are interested in llm-hosting are comparing it to the libraries listed below. We may earn a commission when you buy through links labeled 'Ad' on this page.
Sorting:
- Tracking the history of the FARA data from https://www.justice.gov/nsd-fara☆16Aug 3, 2023Updated 3 years ago
- Apache Arrow-compatible space-efficient "tape" class in pure Rust to be used with StringZilla for GPU, NUMA, and disk transfers of variab…☆33Jul 31, 2026Updated last week
- 🚀 A simple, modern, full-stack toolkit for Python 🐍☆39Oct 18, 2024Updated last year
- Flexible, efficient, and context-aware generation from large unstructured knowledge sources.☆17May 7, 2024Updated 2 years ago
- Agent based market simulation☆15Aug 10, 2024Updated 2 years ago
- Deploy on Railway without the complexity - Free Credits Offer • AdConnect your repo and Railway handles the rest with instant previews. Quickly provision container image services, databases, and storage volumes.
- Simple Pygame application for Particle Effect showcasing (Tutorial)☆11Nov 11, 2023Updated 2 years ago
- Manage ML configuration with pydantic☆16Mar 18, 2026Updated 4 months ago
- ☆15Dec 21, 2025Updated 7 months ago
- Know what your AI agents cost. API gateway with budget enforcement, session tracking, and MCP tools.☆16Updated this week
- A Framework For Intelligence Farming☆16Apr 3, 2025Updated last year
- Pin files for contextual, codebase-level AI assistance.☆16Jul 11, 2024Updated 2 years ago
- WIP: Ofen is a toolkit aimed at making transformer models production-ready. API included☆17Oct 2, 2024Updated last year
- Plug-and-play document AI with zero-shot models.☆126May 11, 2026Updated 3 months ago
- Tui Utility to test REST APIs☆13Nov 20, 2023Updated 2 years ago
- Deploy open-source AI quickly and easily - Special Bonus Offer • AdRunpod Hub is built for open source. One-click deployment and autoscaling endpoints without provisioning your own infrastructure.
- Wrap-up around RinteRface templates☆11Apr 10, 2019Updated 7 years ago
- Compile docker images into a single self-contained binary☆20Apr 30, 2026Updated 3 months ago
- Crypto Savvy PT Assist☆18Mar 1, 2018Updated 8 years ago
- Tools to collect detailed usage analytics of Idyll articles.☆15Nov 18, 2024Updated last year
- Semantic emoji finder. Python/dash UI. Uses sentence transformer embeddings and duckdb☆20Sep 15, 2025Updated 10 months ago
- Code for building self-expanding knowledge graphs with Outlines, vLLM, neo4j, and Modal.☆38May 14, 2025Updated last year
- Tool for fixing trivial problems with your code.☆63Sep 30, 2023Updated 2 years ago
- This repository includes the code to download the curated HuggingFace papers into a single markdown formatted file☆16Jul 26, 2024Updated 2 years ago
- Hugging Face RoBERTa with Flash Attention 2☆23Sep 14, 2025Updated 11 months ago
- Managed hosting for WordPress and PHP on Cloudways • AdManaged hosting for WordPress, Magento, Laravel, or PHP apps, on multiple cloud providers. Deploy in minutes on Cloudways by DigitalOcean.
- The RunBugRun dataset of executable bugs☆25Sep 24, 2025Updated 10 months ago
- 🐧🐦 Generate HTML pages for Twitter statuses.☆14Jul 22, 2018Updated 8 years ago
- [ACL 2022] CLUES: A Benchmark for Learning Classifiers using Natural Language Explanations☆10Jun 5, 2022Updated 4 years ago
- Code to create bugged python scripts for OpenAssistant Training, maintained by https://twitter.com/Cyndesama☆24Jul 23, 2023Updated 3 years ago
- This is an opensource project allowing you to compare two LLM's head to head with a given prompt, this section will be regarding the back…☆22Jan 13, 2026Updated 7 months ago
- Intentional is an open-source framework to build reliable LLM chatbots that actually talk and behave as you expect.☆12Dec 31, 2024Updated last year
- An LLM Client for the PS Vita☆14Jun 23, 2025Updated last year
- This technical demo is an open-source project that allows users to customize the appearance and design of the map in game with stable dif…☆28Aug 4, 2026Updated last week
- Embed Pyodide-powered, entirely serverless Gradio apps into Quarto documents.☆17Mar 3, 2025Updated last year
- Managed hosting for WordPress and PHP on Cloudways • AdManaged hosting for WordPress, Magento, Laravel, or PHP apps, on multiple cloud providers. Deploy in minutes on Cloudways by DigitalOcean.
- marimo + pixi starter template☆18Jan 31, 2025Updated last year
- A command-line tool for creating and managing external HITs on Amazon's Mechanical Turk☆15Jan 11, 2021Updated 5 years ago
- Repository for ACL paper: "Statements: Universal Information Extraction from Tables with Large Language Models for ESG KPIs"☆17Jul 1, 2024Updated 2 years ago
- Visual tools to help machine learning model selection☆15Jun 11, 2021Updated 5 years ago
- Machinery data, made easy. Easily download and prepare common industrial datasets.☆23Feb 13, 2024Updated 2 years ago
- ☆11Jun 9, 2022Updated 4 years ago
- ☆15Dec 2, 2019Updated 6 years ago