Production inference for encoder models - ColBERT, GLiNER, ColPali, embeddings etc. - as vLLM plugins for online and in-process deployment
☆87Jul 6, 2026Updated 4 months ago
Alternatives and similar repositories for vllm-factory
Users that are interested in vllm-factory are comparing it to the libraries listed below. We may earn a commission when you buy through links labeled 'Ad' on this page.
Sorting:
- High-performance late-interaction retrieval engine for on-prem AI. ColBERT/ColPali multi-vector search with Rust fused MaxSim, Triton GPU…☆17Jul 6, 2026Updated 4 months ago
- ☆32Jun 22, 2026Updated 4 months ago
- Efficient and modular GraphRAG system☆51Jul 7, 2026Updated 4 months ago
- Efficient Multi-Task Safety Classification for Toxicity, Jailbreaks, Hate Speech, and Harmful Content☆25May 29, 2026Updated 5 months ago
- GLiNER2 Rust support☆21Aug 29, 2026Updated 2 months ago
- Deploy to Railway using AI coding agents - Free Credits Offer • AdUse Claude Code, Codex, OpenCode, and more. Autonomous software development now has the infrastructure to match with Railway.
- Unified Schema-Based Information Extraction☆2,480Updated this week
- Trully flash implementation of DeBERTa disentangled attention mechanism.☆95Oct 31, 2026Updated 2 weeks ago
- Inference engine for GLiNER models, in Rust☆173Aug 5, 2026Updated 3 months ago
- Generalist Multitask Transformer Encoders☆137Nov 2, 2026Updated 2 weeks ago
- Generalist and Lightweight Model for Relation Extraction (Extract any relationship types from text)☆297Mar 30, 2026Updated 7 months ago
- A package for generating synthetic data and fine-tuning a gliner model.☆14Jun 5, 2024Updated 2 years ago
- Efficient and scalable zero-shot entity linking☆161Jul 20, 2026Updated 3 months ago
- Versatile framework designed to streamline the integration of your models, as well as those sourced from Hugging Face, into complex progr…☆35Aug 21, 2025Updated last year
- Rank-Biased Precision, Overlap, Recall, and Alignment☆15Jun 15, 2026Updated 5 months ago
- Managed Kubernetes at scale on DigitalOcean • AdDigitalOcean Kubernetes includes the control plane, bandwidth allowance, container registry, automatic updates, and more for free.
- zero shot NER fine tuning☆14Aug 28, 2026Updated 2 months ago
- The Python bindings moved to ArcadeData/arcadedb-python (uv add arcadedb). This repo holds the benchmarks until they move to humemai/dbbe…☆14Updated this week
- ☆14Oct 26, 2026Updated 3 weeks ago
- Generalist and Lightweight Model for Text Classification☆582Oct 31, 2026Updated 2 weeks ago
- Evals that meet you where you are. For AI that's grounded.☆72Nov 5, 2026Updated last week
- Rust + Python implementation of the jzip spherical compression format for embeddings☆11Feb 21, 2026Updated 8 months ago
- agentic_graph_rag☆20Nov 20, 2025Updated 11 months ago
- ☆34May 6, 2026Updated 6 months ago
- Learning High-Quality and General-Purpose Phrase Representations. Findings of EACL 2024☆17Feb 29, 2024Updated 2 years ago
- Deploy to Railway using AI coding agents - Free Credits Offer • AdUse Claude Code, Codex, OpenCode, and more. Autonomous software development now has the infrastructure to match with Railway.
- Plug-and-play document AI with zero-shot models.☆127May 11, 2026Updated 6 months ago
- An example repo demonstrating how to integrate pioneer for agent personalization☆15Nov 18, 2025Updated last year
- [NeurIPS 2025 Spotlight] Enhancing Training Data Attribution with Representational Optimization☆13Jan 26, 2026Updated 9 months ago
- GLiNER model in a FastAPI microservice.☆48Dec 11, 2024Updated last year
- ☆24Jan 30, 2025Updated last year
- Generalist and Lightweight Model for Named Entity Recognition (Extract any entity types from texts)☆4,271Nov 11, 2026Updated last week
- Provenance-first extractive RAG: return verbatim source spans with citations using local ModernBERT or optional LLM-assisted extraction.☆210Nov 10, 2026Updated last week
- Nearly Inference Free Embeddings: make your RAG queries 500x faster☆91Apr 27, 2026Updated 6 months ago
- Datamodels for hugging face tokenizers☆112Oct 3, 2026Updated last month
- Managed hosting for WordPress and PHP on Cloudways • AdManaged hosting for WordPress, Magento, Laravel, or PHP apps, on multiple cloud providers. Deploy in minutes on Cloudways by DigitalOcean.
- Semi-supervised learning tutorial in pytorch (pseudio label, Pi model, mean teacher, FixMatch, UDA)☆15Sep 12, 2021Updated 5 years ago
- AutoRDF2GML is a novel framework that semi-automatically transforms RDF data into heterogeneous graph datasets suitable for graph-based m…☆31Nov 26, 2024Updated last year
- A handy and elastic encoder for DeepSeek OCR vision tasks☆14Oct 23, 2025Updated last year
- ✂️ OpenProvence: Open-Source, Efficient, and Robust Context Pruning for Retrieval-Augmented Generation☆70Nov 22, 2025Updated 11 months ago
- Agents that talk through model internals — activations & J-space — instead of text. No words pass between them. The lab on top of brainsc…☆29Oct 1, 2026Updated last month
- Semantic Regex☆21Sep 11, 2026Updated 2 months ago
- The SEMMweb Ontology Editor is a Windows desktop application that allows users to create, view, edit, import, and publish ontologies acco…☆10May 19, 2026Updated 5 months ago
Are these results useful?