This repository is designed for deploying and managing server processes that handle embeddings using the Infinity Embedding model or Large Language Models with an OpenAI compatible vLLM server.
☆26Mar 6, 2025Updated last year
Alternatives and similar repositories for llm-hosting
Users that are interested in llm-hosting are comparing it to the libraries listed below. We may earn a commission when you buy through links labeled 'Ad' on this page.
Sorting:
- A public repo that contains integrations for Argilla and LlamaIndex.☆17Oct 10, 2024Updated last year
- A curated list of amazingly awesome Modal applications, demos, and shiny things. Inspired by awesome-php.☆177Dec 29, 2025Updated 2 months ago
- Plug-and-play document AI with zero-shot models.☆125Feb 16, 2026Updated last month
- Agent based market simulation☆15Aug 10, 2024Updated last year
- Git scrapers for scraping the fediverse☆20Updated this week
- ☆12Feb 22, 2024Updated 2 years ago
- Simple Pygame application for Particle Effect showcasing (Tutorial)☆10Nov 11, 2023Updated 2 years ago
- Manage ML configuration with pydantic☆16Mar 18, 2026Updated last week
- A Datasette plugin for making data visualizations with Observable Plot☆26Oct 21, 2025Updated 5 months ago
- Embed Pyodide-powered, entirely serverless Gradio apps into Quarto documents.☆17Mar 3, 2025Updated last year
- A Framework For Intelligence Farming☆16Apr 3, 2025Updated 11 months ago
- PostgreSQL Lance Table Extension☆20Dec 27, 2025Updated 2 months ago
- Pin files for contextual, codebase-level AI assistance.☆16Jul 11, 2024Updated last year
- A utility for async batch jobs in marimo☆13Mar 12, 2025Updated last year
- Tui Utility to test REST APIs☆13Nov 20, 2023Updated 2 years ago
- ☆14Oct 19, 2024Updated last year
- Modal LLM LLama.cpp based model deployment as part of series of Model as a Service (MaaS)☆17Feb 27, 2026Updated 3 weeks ago
- Repositorio general para Bootcamps de Data Science en Coding Dojo☆11Nov 13, 2025Updated 4 months ago
- Obsidian plugin that allows to display contents of Arc sidebar right besides your notes☆15Jan 26, 2024Updated 2 years ago
- Code for building self-expanding knowledge graphs with Outlines, vLLM, neo4j, and Modal.☆36May 14, 2025Updated 10 months ago
- This repository includes the code to download the curated HuggingFace papers into a single markdown formatted file☆16Jul 26, 2024Updated last year
- Tool for fixing trivial problems with your code.☆65Sep 30, 2023Updated 2 years ago
- ☆32Updated this week
- Bajo los adoquines, la PLAYA 🏖️☆16Feb 17, 2026Updated last month
- ☆80Jun 5, 2024Updated last year
- The RunBugRun dataset of executable bugs☆24Sep 24, 2025Updated 6 months ago
- 🐧🐦 Generate HTML pages for Twitter statuses.☆14Jul 22, 2018Updated 7 years ago
- Using RAG to generate data for model fine-tuning.☆13Apr 16, 2025Updated 11 months ago
- [ACL 2022] CLUES: A Benchmark for Learning Classifiers using Natural Language Explanations☆10Jun 5, 2022Updated 3 years ago
- Anthropic Computer Use with Modal Sandboxes☆45Oct 23, 2024Updated last year
- A Collection of Pydantic Models to Abstract IRL☆39Dec 10, 2025Updated 3 months ago
- Intentional is an open-source framework to build reliable LLM chatbots that actually talk and behave as you expect.☆13Dec 31, 2024Updated last year
- 🦾💻🌐 distributed training & serverless inference at scale on RunPod☆19May 26, 2024Updated last year
- A OCR labeling tool - made for docTR☆18Mar 5, 2026Updated 2 weeks ago
- R package that allows for visualization of the KNN of an embedding compared to the KNN of the original high-dimensional data.☆21May 21, 2025Updated 10 months ago
- ☆15Dec 2, 2019Updated 6 years ago
- Repository for ACL paper: "Statements: Universal Information Extraction from Tables with Large Language Models for ESG KPIs"☆17Jul 1, 2024Updated last year
- REST API for Large Language Models using FastAPI, Redis and LiteLLM☆14Nov 30, 2023Updated 2 years ago
- A rolling version of the Latent Dirichlet Allocation.☆13Nov 27, 2023Updated 2 years ago