Production inference for encoder models - ColBERT, GLiNER, ColPali, embeddings etc. - as vLLM plugins for online and in-process deployment
☆77Jul 6, 2026Updated last month
Alternatives and similar repositories for vllm-factory
Users that are interested in vllm-factory are comparing it to the libraries listed below. We may earn a commission when you buy through links labeled 'Ad' on this page.
Sorting:
- High-performance late-interaction retrieval engine for on-prem AI. ColBERT/ColPali multi-vector search with Rust fused MaxSim, Triton GPU…☆17Jul 6, 2026Updated last month
- Efficient and modular GraphRAG system☆50Jul 7, 2026Updated last month
- GLiNER2 Rust support☆20Updated this week
- C++ inference engine for running GLiNER (Generalist and Lightweight Named Entity Recognition) models☆50Jul 10, 2026Updated last month
- Inference engine for GLiNER models, in Rust☆161Aug 5, 2026Updated 3 weeks ago
- End-to-end encrypted email - Proton Mail • AdSpecial offer: 40% Off Yearly / 80% Off First Month. All Proton services are open source and independently audited for security.
- Trully flash implementation of DeBERTa disentangled attention mechanism.☆91Feb 10, 2026Updated 6 months ago
- Efficient and scalable zero-shot entity linking☆148Jul 20, 2026Updated last month
- Generalist and Lightweight Model for Text Classification☆244Jul 21, 2026Updated last month
- Versatile framework designed to streamline the integration of your models, as well as those sourced from Hugging Face, into complex progr…☆35Aug 21, 2025Updated last year
- Generalist and Lightweight Model for Relation Extraction (Extract any relationship types from text)☆290Mar 30, 2026Updated 4 months ago
- Zero and Few-shot document level relation extraction / ⚠️ Development moved to: https://github.com/cea-list-lasti/glidre☆19Mar 13, 2026Updated 5 months ago
- zero shot NER fine tuning☆14Updated this week
- Evals that meet you where you are. For AI that's grounded.☆69Mar 21, 2026Updated 5 months ago
- Learning High-Quality and General-Purpose Phrase Representations. Findings of EACL 2024☆16Feb 29, 2024Updated 2 years ago
- Managed hosting for WordPress and PHP on Cloudways • AdManaged hosting for WordPress, Magento, Laravel, or PHP apps, on multiple cloud providers. Deploy in minutes on Cloudways by DigitalOcean.
- GLiNER inference in JavaScript☆28Mar 2, 2025Updated last year
- Plug-and-play document AI with zero-shot models.☆126May 11, 2026Updated 3 months ago
- GLiNER model in a FastAPI microservice.☆47Dec 11, 2024Updated last year
- Architecture pattern for combining a fast LLM voice loop with a slower SLM that tracks hard facts.☆15Apr 27, 2026Updated 4 months ago
- ☆24Jan 30, 2025Updated last year
- Datamodels for hugging face tokenizers☆111Updated this week
- Set-Encoder: Permutation-Invariant Inter-Passage Attention for Listwise Passage Re-Ranking with Cross-Encoders☆19May 23, 2025Updated last year
- Compression for unit-norm embedding vectors using spherical coordinates☆82Jan 23, 2026Updated 7 months ago
- Generalist and Lightweight Model for Named Entity Recognition (Extract any entity types from texts)☆3,589Aug 10, 2026Updated 2 weeks ago
- Managed Database hosting by DigitalOcean • AdPostgreSQL, MySQL, MongoDB, Kafka, Valkey, and OpenSearch available. Automatically scale up storage and focus on building your apps.
- Hardware-agnostic Framework for Large-scale Knowledge Graph Embeddings☆68Updated this week
- A Structured Output Benchmark whose 'ground-truth' is actually right☆26Jul 24, 2026Updated last month
- 📚 Build knowledge bases for RAG☆32Apr 20, 2026Updated 4 months ago
- Scripts to extract and parse TED (Tenders Electronic Daily: http://ted.europa.eu/TED/main/HomePage.do) documents.☆22Dec 1, 2017Updated 8 years ago
- German dataset for DPR model training☆19Jul 21, 2024Updated 2 years ago
- SoTA open-source TTS☆23Jun 17, 2025Updated last year
- TextGraphs + LLMs + graph ML for entity extraction, linking, ranking, and constructing a lemma graph☆25Feb 24, 2024Updated 2 years ago
- Late Interaction Models Training & Retrieval☆885Jul 23, 2026Updated last month
- ☆104Jul 4, 2025Updated last year
- Serverless GPU API endpoints on Runpod - Get Bonus Credits • AdSkip the infrastructure headaches. Auto-scaling, pay-as-you-go, no-ops approach lets you focus on innovating your application.
- Official repository Flash Local Linear Attention☆39May 28, 2026Updated 3 months ago
- A Python Interface to Reproducibility Measures of System-Oriented IR Experiments☆11Dec 2, 2025Updated 8 months ago
- Robust and fast topic models with sentence-transformers.☆119Updated this week
- NeMo Safe Synthesizer: Create private, safe versions of sensitive tabular datasets.☆34Updated this week
- High performance implementation of the WARP (SIGIR'25) retrieval engine.☆36May 21, 2026Updated 3 months ago
- ☆10Jul 15, 2024Updated 2 years ago
- Strwythura: construct an entity-resolved knowledge graph from structured data sources and unstructured content sources, implementing an o…☆231Apr 15, 2026Updated 4 months ago