Production inference for encoder models - ColBERT, GLiNER, ColPali, embeddings etc. - as vLLM plugins for online and in-process deployment
☆83Jul 6, 2026Updated 3 months ago
Alternatives and similar repositories for vllm-factory
Users that are interested in vllm-factory are comparing it to the libraries listed below. We may earn a commission when you buy through links labeled 'Ad' on this page.
Sorting:
- ☆32Jun 22, 2026Updated 3 months ago
- High-performance late-interaction retrieval engine for on-prem AI. ColBERT/ColPali multi-vector search with Rust fused MaxSim, Triton GPU…☆17Jul 6, 2026Updated 3 months ago
- Efficient and modular GraphRAG system☆51Jul 7, 2026Updated 3 months ago
- C++ inference engine for running GLiNER (Generalist and Lightweight Named Entity Recognition) models☆54Jul 10, 2026Updated 2 months ago
- Unified Schema-Based Information Extraction☆2,342Sep 24, 2026Updated 2 weeks ago
- Managed hosting for WordPress and PHP on Cloudways • AdManaged hosting for WordPress, Magento, Laravel, or PHP apps, on multiple cloud providers. Deploy in minutes on Cloudways by DigitalOcean.
- Inference engine for GLiNER models, in Rust☆168Aug 5, 2026Updated 2 months ago
- Trully flash implementation of DeBERTa disentangled attention mechanism.☆95Updated this week
- Efficient and scalable zero-shot entity linking☆158Jul 20, 2026Updated 2 months ago
- Versatile framework designed to streamline the integration of your models, as well as those sourced from Hugging Face, into complex progr…☆35Aug 21, 2025Updated last year
- Generalist and Lightweight Model for Text Classification☆555Updated this week
- Zero and Few-shot document level relation extraction / ⚠️ Development moved to: https://github.com/cea-list-lasti/glidre☆19Mar 13, 2026Updated 6 months ago
- zero shot NER fine tuning☆14Aug 28, 2026Updated last month
- A package for generating synthetic data and fine-tuning a gliner model.☆14Jun 5, 2024Updated 2 years ago
- C inference engine for running GLiClass (Generalist and Lightweight Classification) models☆18May 21, 2025Updated last year
- Deploy open-source AI quickly and easily - Special Bonus Offer • AdRunpod Hub is built for open source. One-click deployment and autoscaling endpoints without provisioning your own infrastructure.
- Plug-and-play document AI with zero-shot models.☆126May 11, 2026Updated 4 months ago
- GLiNER model in a FastAPI microservice.☆48Dec 11, 2024Updated last year
- ☆24Jan 30, 2025Updated last year
- Datamodels for hugging face tokenizers☆112Updated this week
- Semantic Regex☆21Sep 11, 2026Updated 3 weeks ago
- Pre-train Static Word Embeddings☆111Sep 30, 2026Updated last week
- Set-Encoder: Permutation-Invariant Inter-Passage Attention for Listwise Passage Re-Ranking with Cross-Encoders☆19May 23, 2025Updated last year
- Compression for unit-norm embedding vectors using spherical coordinates☆84Jan 23, 2026Updated 8 months ago
- Generalist and Lightweight Model for Named Entity Recognition (Extract any entity types from texts)☆4,064Updated this week
- Deploy open-source AI quickly and easily - Special Bonus Offer • AdRunpod Hub is built for open source. One-click deployment and autoscaling endpoints without provisioning your own infrastructure.
- The page with all info about SOTA text detoxification models and datasets.☆14Apr 2, 2025Updated last year
- A Structured Output Benchmark whose 'ground-truth' is actually right☆26Jul 24, 2026Updated 2 months ago
- 📚 Build knowledge bases for RAG☆31Apr 20, 2026Updated 5 months ago
- Working files for the Bibframe2Schema.org Working Group☆11Oct 25, 2023Updated 2 years ago
- FastFit ⚡ When LLMs are Unfit Use FastFit ⚡ Fast and Effective Text Classification with Many Classes☆222Updated this week
- Provenance-first extractive RAG: return verbatim source spans with citations using local ModernBERT or optional LLM-assisted extraction.☆206Sep 28, 2026Updated last week
- TextGraphs + LLMs + graph ML for entity extraction, linking, ranking, and constructing a lemma graph☆25Feb 24, 2024Updated 2 years ago
- SoTA open-source TTS☆23Jun 17, 2025Updated last year
- Late Interaction Models Training & Retrieval☆897Jul 23, 2026Updated 2 months ago
- 1-Click AI Models by DigitalOcean Gradient • AdDeploy popular AI models on DigitalOcean Gradient GPU virtual machines with just a single click. Zero configuration with optimized deployments.
- ☆104Jul 4, 2025Updated last year
- Official repository Flash Local Linear Attention☆40May 28, 2026Updated 4 months ago
- A Python Interface to Reproducibility Measures of System-Oriented IR Experiments☆11Dec 2, 2025Updated 10 months ago
- High performance implementation of the WARP (SIGIR'25) retrieval engine.☆36Sep 8, 2026Updated last month
- A Python library for generating and loading synthetic and real-world datasets tailored for graph-based applications.☆39Updated this week
- ☆10Jul 15, 2024Updated 2 years ago
- NeMo Safe Synthesizer: Create private, safe versions of sensitive tabular datasets.☆39Updated this week