Production inference for encoder models - ColBERT, GLiNER, ColPali, embeddings etc. - as vLLM plugins for online and in-process deployment
☆78Jul 6, 2026Updated 2 months ago
Alternatives and similar repositories for vllm-factory
Users that are interested in vllm-factory are comparing it to the libraries listed below. We may earn a commission when you buy through links labeled 'Ad' on this page.
Sorting:
- High-performance late-interaction retrieval engine for on-prem AI. ColBERT/ColPali multi-vector search with Rust fused MaxSim, Triton GPU…☆17Jul 6, 2026Updated 2 months ago
- Efficient and modular GraphRAG system☆50Jul 7, 2026Updated 2 months ago
- Unified Schema-Based Information Extraction☆1,937Updated this week
- C++ inference engine for running GLiNER (Generalist and Lightweight Named Entity Recognition) models☆52Jul 10, 2026Updated 2 months ago
- Inference engine for GLiNER models, in Rust☆164Aug 5, 2026Updated last month
- End-to-end encrypted email - Proton Mail • AdSpecial offer: 40% Off Yearly / 80% Off First Month. All Proton services are open source and independently audited for security.
- Trully flash implementation of DeBERTa disentangled attention mechanism.☆93Feb 10, 2026Updated 7 months ago
- Efficient and scalable zero-shot entity linking☆153Jul 20, 2026Updated last month
- Versatile framework designed to streamline the integration of your models, as well as those sourced from Hugging Face, into complex progr…☆35Aug 21, 2025Updated last year
- Generalist and Lightweight Model for Relation Extraction (Extract any relationship types from text)☆290Mar 30, 2026Updated 5 months ago
- Generalist and Lightweight Model for Text Classification☆436Jul 21, 2026Updated last month
- Zero and Few-shot document level relation extraction / ⚠️ Development moved to: https://github.com/cea-list-lasti/glidre☆19Mar 13, 2026Updated 6 months ago
- Generalist Multitask Transformer Encoders☆86Updated this week
- zero shot NER fine tuning☆14Aug 28, 2026Updated 3 weeks ago
- Evals that meet you where you are. For AI that's grounded.☆69Mar 21, 2026Updated 5 months ago
- Managed hosting for WordPress and PHP on Cloudways • AdManaged hosting for WordPress, Magento, Laravel, or PHP apps, on multiple cloud providers. Deploy in minutes on Cloudways by DigitalOcean.
- A package for generating synthetic data and fine-tuning a gliner model.☆14Jun 5, 2024Updated 2 years ago
- C inference engine for running GLiClass (Generalist and Lightweight Classification) models☆17May 21, 2025Updated last year
- Learning High-Quality and General-Purpose Phrase Representations. Findings of EACL 2024☆16Feb 29, 2024Updated 2 years ago
- GLiNER inference in JavaScript☆27Mar 2, 2025Updated last year
- ☆34May 6, 2026Updated 4 months ago
- agentic_graph_rag☆20Nov 20, 2025Updated 9 months ago
- Semi-supervised learning tutorial in pytorch (pseudio label, Pi model, mean teacher, FixMatch, UDA)☆15Sep 12, 2021Updated 5 years ago
- Plug-and-play document AI with zero-shot models.☆126May 11, 2026Updated 4 months ago
- GLiNER model in a FastAPI microservice.☆47Dec 11, 2024Updated last year
- Virtual machines for every use case on DigitalOcean • AdGet dependable uptime with 99.99% SLA, simple security tools, and predictable monthly pricing with DigitalOcean's virtual machines, called Droplets.
- Architecture pattern for combining a fast LLM voice loop with a slower SLM that tracks hard facts.☆15Apr 27, 2026Updated 4 months ago
- Datamodels for hugging face tokenizers☆111Sep 2, 2026Updated 2 weeks ago
- Pre-train Static Word Embeddings☆111Jun 9, 2026Updated 3 months ago
- Set-Encoder: Permutation-Invariant Inter-Passage Attention for Listwise Passage Re-Ranking with Cross-Encoders☆19May 23, 2025Updated last year
- Generalist and Lightweight Model for Named Entity Recognition (Extract any entity types from texts)☆3,799Sep 8, 2026Updated last week
- The page with all info about SOTA text detoxification models and datasets.☆14Apr 2, 2025Updated last year
- A Structured Output Benchmark whose 'ground-truth' is actually right☆26Jul 24, 2026Updated last month
- German dataset for DPR model training☆19Jul 21, 2024Updated 2 years ago
- FastFit ⚡ When LLMs are Unfit Use FastFit ⚡ Fast and Effective Text Classification with Many Classes☆220Sep 18, 2025Updated last year
- AI Agents on DigitalOcean Gradient AI Platform • AdBuild production-ready AI agents using customizable tools or access multiple LLMs through a single endpoint. Create custom knowledge bases or connect external data.
- SoTA open-source TTS☆23Jun 17, 2025Updated last year
- TextGraphs + LLMs + graph ML for entity extraction, linking, ranking, and constructing a lemma graph☆25Feb 24, 2024Updated 2 years ago
- Late Interaction Models Training & Retrieval☆894Jul 23, 2026Updated last month
- ☆104Jul 4, 2025Updated last year
- A Python Interface to Reproducibility Measures of System-Oriented IR Experiments☆11Dec 2, 2025Updated 9 months ago
- Robust and fast topic models with sentence-transformers.☆123Aug 28, 2026Updated 3 weeks ago
- High performance implementation of the WARP (SIGIR'25) retrieval engine.☆36Sep 8, 2026Updated last week