Production inference for encoder models - ColBERT, GLiNER, ColPali, embeddings etc. - as vLLM plugins for online and in-process deployment
☆87Jul 6, 2026Updated 3 months ago
Alternatives and similar repositories for vllm-factory
Users that are interested in vllm-factory are comparing it to the libraries listed below. We may earn a commission when you buy through links labeled 'Ad' on this page.
Sorting:
- ☆32Jun 22, 2026Updated 4 months ago
- High-performance late-interaction retrieval engine for on-prem AI. ColBERT/ColPali multi-vector search with Rust fused MaxSim, Triton GPU…☆17Jul 6, 2026Updated 3 months ago
- Efficient and modular GraphRAG system☆51Jul 7, 2026Updated 3 months ago
- GLiNER2 Rust support☆21Aug 29, 2026Updated 2 months ago
- Generalist Multitask Transformer Encoders☆135Oct 20, 2026Updated last week
- Virtual machines for every use case on DigitalOcean • AdGet dependable uptime with 99.99% SLA, simple security tools, and predictable monthly pricing with DigitalOcean's virtual machines, called Droplets.
- Project for training, quantizing, and serving a static emebdding models.☆39Aug 7, 2026Updated 2 months ago
- Trully flash implementation of DeBERTa disentangled attention mechanism.☆95Updated this week
- Inference engine for GLiNER models, in Rust☆170Aug 5, 2026Updated 2 months ago
- C++ inference engine for running GLiNER (Generalist and Lightweight Named Entity Recognition) models☆57Jul 10, 2026Updated 3 months ago
- A package for generating synthetic data and fine-tuning a gliner model.☆14Jun 5, 2024Updated 2 years ago
- Zero and Few-shot document level relation extraction / ⚠️ Development moved to: https://github.com/cea-list-lasti/glidre☆19Mar 13, 2026Updated 7 months ago
- zero shot NER fine tuning☆14Aug 28, 2026Updated 2 months ago
- Rank-Biased Precision, Overlap, Recall, and Alignment☆15Jun 15, 2026Updated 4 months ago
- Evals that meet you where you are. For AI that's grounded.☆71Oct 16, 2026Updated last week
- Deploy open-source AI quickly and easily - Special Bonus Offer • AdRunpod Hub is built for open source. One-click deployment and autoscaling endpoints without provisioning your own infrastructure.
- C inference engine for running GLiClass (Generalist and Lightweight Classification) models☆18May 21, 2025Updated last year
- Rust + Python implementation of the jzip spherical compression format for embeddings☆11Feb 21, 2026Updated 8 months ago
- ☆33May 6, 2026Updated 5 months ago
- GLiNER inference in JavaScript☆28Mar 2, 2025Updated last year
- Learning High-Quality and General-Purpose Phrase Representations. Findings of EACL 2024☆17Feb 29, 2024Updated 2 years ago
- Semi-supervised learning tutorial in pytorch (pseudio label, Pi model, mean teacher, FixMatch, UDA)☆15Sep 12, 2021Updated 5 years ago
- An example repo demonstrating how to integrate pioneer for agent personalization☆15Nov 18, 2025Updated 11 months ago
- GLiNER model in a FastAPI microservice.☆48Dec 11, 2024Updated last year
- Provenance-first extractive RAG: return verbatim source spans with citations using local ModernBERT or optional LLM-assisted extraction.☆207Oct 9, 2026Updated 2 weeks ago
- Bare Metal GPUs on DigitalOcean Gradient AI • AdPurpose-built for serious AI teams training foundational models, running large-scale inference, and pushing the boundaries of what's possible.
- A handy and elastic encoder for DeepSeek OCR vision tasks☆14Oct 23, 2025Updated last year
- ☆24Jan 30, 2025Updated last year
- Nearly Inference Free Embeddings: make your RAG queries 500x faster☆90Apr 27, 2026Updated 6 months ago
- privacy-first context graph engine for AI agents and human teams.☆37Jun 23, 2026Updated 4 months ago
- Agents that talk through model internals — activations & J-space — instead of text. No words pass between them. The lab on top of brainsc…☆28Oct 1, 2026Updated 3 weeks ago
- Datamodels for hugging face tokenizers☆112Oct 3, 2026Updated 3 weeks ago
- Fully chunked KL-Loss kernel, that massively reduces VRAM usage☆20Aug 10, 2026Updated 2 months ago
- Pre-train Static Word Embeddings☆111Sep 30, 2026Updated 3 weeks ago
- Hardware-agnostic Framework for Large-scale Knowledge Graph Embeddings☆71Oct 22, 2026Updated last week
- 1-Click AI Models by DigitalOcean Gradient • AdDeploy popular AI models on DigitalOcean Gradient GPU virtual machines with just a single click. Zero configuration with optimized deployments.
- Official repository for the paper "DR-DCI: Scaling Direct Corpus Interaction via Dynamic Workspace Expansion"☆22Aug 2, 2026Updated 2 months ago
- Semantic Regex☆21Sep 11, 2026Updated last month
- SearchJev: a fast and calibrated System-1 model for search agents (training code)☆34Oct 4, 2026Updated 3 weeks ago
- Blazing fast, self-hosted structured decisions for open models with a TypeSafe AI compatible API, written in Rust.☆57Oct 10, 2026Updated 2 weeks ago
- Official Repository for "Hypencoder: Hypernetworks for Information Retrieval"☆41Sep 20, 2025Updated last year
- An integration of KùzuDB and RDFlib.☆18Nov 15, 2024Updated last year
- Compression for unit-norm embedding vectors using spherical coordinates☆85Jan 23, 2026Updated 9 months ago