Triton backend for https://github.com/OpenNMT/CTranslate2
☆35Jul 7, 2023Updated 3 years ago
Alternatives and similar repositories for ctranslate2_triton_backend
Users that are interested in ctranslate2_triton_backend are comparing it to the libraries listed below. We may earn a commission when you buy through links labeled 'Ad' on this page.
Sorting:
- WIP: Ofen is a toolkit aimed at making transformer models production-ready. API included☆17Oct 2, 2024Updated 2 years ago
- Triton backend for https://github.com/OpenNMT/CTranslate2☆11Aug 20, 2024Updated 2 years ago
- Connecting Transformers on HuggingFace Hub with CTranslate2☆39Aug 27, 2024Updated 2 years ago
- Integrating SSE with NVIDIA Triton Inference Server using a Python backend and Zephyr model. There is very less documentation how to use …☆10May 29, 2024Updated 2 years ago
- Magface Triton Inferece Server Using Tensorrt☆19Feb 12, 2022Updated 4 years ago
- AI Agents on DigitalOcean Gradient AI Platform • AdBuild production-ready AI agents using customizable tools or access multiple LLMs through a single endpoint. Create custom knowledge bases or connect external data.
- Create embeddings with infinity as serverless endpoint☆48Nov 21, 2025Updated 11 months ago
- An offline CPU-first low-resource chat application to perform RAG on your corpus of data. Powered by OpenChat and CTranslate2.☆15Sep 28, 2026Updated last month
- Documentation retrieval system to help LLMs navigate less-popular (yet often more powerful) Python libraries☆14May 13, 2024Updated 2 years ago
- ☆13Feb 22, 2024Updated 2 years ago
- ONNX and TensorRT implementation of Whisper☆68May 27, 2023Updated 3 years ago
- Some improvements on ArcFace model☆17Sep 10, 2022Updated 4 years ago
- ☆49Apr 28, 2023Updated 3 years ago
- No Language Left Unlocked: scalable backtranslation of NLLB models☆13Aug 4, 2025Updated last year
- tinygrad port of U^2 Net model☆13Oct 21, 2025Updated last year
- Managed hosting for WordPress and PHP on Cloudways • AdManaged hosting for WordPress, Magento, Laravel, or PHP apps, on multiple cloud providers. Deploy in minutes on Cloudways by DigitalOcean.
- Crispy reranking models by Mixedbread☆55Sep 17, 2025Updated last year
- Interface for interacting with Gradient AI in Python☆15Jun 28, 2024Updated 2 years ago
- Code for the book "High Performance Python" by Micha Gorelick and Ian Ozsvald with OReilly☆10Jul 19, 2016Updated 10 years ago
- Keyword extraction using Scake, KeyBERT, Fine-tuning Transformer BERT-like models and ChatGPT.☆12May 22, 2023Updated 3 years ago
- One command to start a streaming ASR server.☆12Oct 2, 2024Updated 2 years ago
- Final training script from HuggingFace Whisper Fine tuning event - to get best results on finetuned model.☆12Dec 24, 2022Updated 3 years ago
- ☆11Feb 23, 2023Updated 3 years ago
- Workshop on Detection and Classification of Acoustic Scenes and Events☆11Nov 11, 2024Updated last year
- PyTriton is a Flask/FastAPI-like interface that simplifies Triton's deployment in Python environments.☆849Aug 13, 2025Updated last year
- End-to-end encrypted cloud storage - Proton Drive • AdSpecial offer: 40% Off Yearly / 80% Off First Month. Protect your most important files, photos, and documents from prying eyes.
- HTSP client for python☆10Jan 28, 2022Updated 4 years ago
- This project aims to build a small language model for few-shot classification tasks. This includes all of the infrastracture needed to tr…☆12Aug 31, 2024Updated 2 years ago
- CDCN++ face anti spoofing model experimented on and added to during tübitak internship☆10Oct 28, 2021Updated 5 years ago
- This repository is designed for deploying and managing server processes that handle embeddings using the Infinity Embedding model or Larg…☆25Mar 6, 2025Updated last year
- ☆15Jun 25, 2024Updated 2 years ago
- Ultra-low-latency, high-throughput multiprocess transport over SHM and mmap. LMAX-Disruptor-style cross-process ring substrate.☆22Aug 6, 2026Updated 2 months ago
- Web scraping and descriptive and predictive modelling of Bogor house pricing☆11Mar 29, 2025Updated last year
- Codebase, data and models for the Headline Grouping paper at NAACL2021☆12Oct 2, 2022Updated 4 years ago
- Auto Model Factorization☆12Sep 14, 2021Updated 5 years ago
- Deploy to Railway using AI coding agents - Free Credits Offer • AdUse Claude Code, Codex, OpenCode, and more. Autonomous software development now has the infrastructure to match with Railway.
- ☆16Feb 11, 2022Updated 4 years ago
- Reading comprehension based question-answering model for news articles.☆11Jun 22, 2022Updated 4 years ago
- end-to-end information extraction pipeline built by LayoutLMV2, pretrained model from HuggingFace☆11Aug 15, 2023Updated 3 years ago
- Offline Speaker Diarization with SenseVoice by Sherpa ONNX.☆15Dec 23, 2024Updated last year
- Showcase how mxbai-embed-large-v1 can be used to produce binary embedding. Binary embeddings enabled 32x storage savings and 40x faster r…☆21Mar 23, 2024Updated 2 years ago
- Source code for the Vocabulate desktop application☆14Mar 29, 2022Updated 4 years ago
- Using Siamese LSTM to classify repeated quora questions. Attempted pretrained bert embeddings, Word2Vec and training own embeddings toget…☆10Aug 28, 2020Updated 6 years ago