Cortex.Tensorrt-LLM is a C++ inference library that can be loaded by any server at runtime. It submodules NVIDIA’s TensorRT-LLM for GPU accelerated inference on NVIDIA's GPUs.
☆41Sep 26, 2024Updated 2 years ago
Alternatives and similar repositories for cortex.tensorrt-llm
Users that are interested in cortex.tensorrt-llm are comparing it to the libraries listed below. We may earn a commission when you buy through links labeled 'Ad' on this page.
Sorting:
- cortex.llamacpp is a high-efficiency C++ inference engine for edge computing. It is a dynamic library that can be loaded by any server a…☆44Jul 4, 2025Updated last year
- Efficient Finetuning for OpenAI GPT-OSS☆24Oct 2, 2025Updated last year
- Lightweight piece tokenization library☆12Aug 24, 2026Updated 2 months ago
- A small utility library for parsing GGUF file info☆31Jan 27, 2025Updated last year
- IntelliDisk is an alternative Windows version to the famous Microsoft OneDrive!☆15Nov 9, 2026Updated last week
- Deploy open-source AI quickly and easily - Special Bonus Offer • AdRunpod Hub is built for open source. One-click deployment and autoscaling endpoints without provisioning your own infrastructure.
- WordPress plugin that adds a WP-CLI command that functionally piggybacks the WooCommerce Memberships CSV importer☆10Jan 24, 2018Updated 8 years ago
- Code for the paper "GPTQ: Accurate Post-training Quantization of Generative Pretrained Transformers" with GPT-J implementation.☆15Mar 22, 2023Updated 3 years ago
- ☆12Nov 8, 2023Updated 3 years ago
- Cog wrapper for qresearch/llama-3-vision-alpha☆11Oct 31, 2026Updated 3 weeks ago
- Source code for SuperAGI's Zapier Integration☆13Aug 20, 2023Updated 3 years ago
- 🕹️ Performance Comparison of MLOps Engines, Frameworks, and Languages on Mainstream AI Models.☆143Jul 25, 2024Updated 2 years ago
- c++实现的clip推理,模型有一点点改动,但是不大,改动和导出模型的代码可以在readme里找到,模型文件都在Releases里,包括AX650的模型。新增支持ChineseCLIP☆31Jun 19, 2025Updated last year
- A CrewAI project for researching and reporting on the latest AI developments☆14Oct 22, 2026Updated last month
- Cog wrapper for moondream2☆14Oct 31, 2026Updated 3 weeks ago
- Deploy on Railway without the complexity - Free Credits Offer • AdConnect your repo and Railway handles the rest with instant previews. Quickly provision container image services, databases, and storage volumes.
- Run AuraFlow on Replicate☆14Jul 12, 2024Updated 2 years ago
- Attempt at cog wrapper for segmind/SSD-1B☆10Dec 11, 2023Updated 2 years ago
- A handwritten note-taking app built for students, combining the natural feel of pen and paper with the power of digital documents.☆20Updated this week
- Examples using MLX Swift☆13Apr 9, 2025Updated last year
- An open-source framework designed to extend and maintain the ESCO taxonomy☆19Mar 12, 2026Updated 8 months ago
- Attempt at cog wrapper for a SDXL CLIP Interrogator☆10Oct 31, 2026Updated 3 weeks ago
- Cog wrapper for bosonai/higgs-audio-v2-generation-3B-base☆11Jul 31, 2025Updated last year
- Enhanced multi-needle retrieval testing framework for evaluating LLM long-context understanding capabilities☆12Oct 8, 2025Updated last year
- C++ inference engine for running GLiNER (Generalist and Lightweight Named Entity Recognition) models☆57Jul 10, 2026Updated 4 months ago
- GPUs on demand by Runpod - Special Offer Available • AdRun AI, ML, and HPC workloads on powerful cloud GPUs—without limits or wasted spend. Deploy GPUs in under a minute and pay by the second.
- Attempt at cog wrapper for IP_Adapter-face for SDXL☆15Nov 25, 2024Updated last year
- Desktop app for Muse Code, Meta's coding agent — with opt-in computer use: let it see your screen and drive your Windows apps.☆17Oct 18, 2026Updated last month
- Generative AI powered Note taking mobile app converts your voice recording or other audio file into short notes and customized questions …☆18Dec 8, 2023Updated 2 years ago
- Qualitative data analysis for text, images, audio, video. Cross platform. Python 3.8 or newer and PyQt6.☆14Nov 11, 2026Updated last week
- SeeSR: Towards Semantics-Aware Real-World Image Super-Resolution☆14Jan 12, 2024Updated 2 years ago
- A Deeplearn Model to rec table in photo with ncnn. 一个深度学习模型用于检测图片中的表格 画像内のテーブルを検出するためのディープラーニング モデル☆20Mar 2, 2025Updated last year
- fast-embeddings-api☆16Nov 23, 2023Updated 2 years ago
- Web accessible Inkscape inside an Alpine Container☆19Updated this week
- ☆13Sep 10, 2026Updated 2 months ago
- Wordpress hosting with auto-scaling - Free Trial Offer • AdFully Managed hosting for WordPress and WooCommerce businesses that need reliable, auto-scalable performance. Cloudways SafeUpdates now available.
- RWKV is a RNN with transformer-level LLM performance. It can be directly trained like a GPT (parallelizable). So it's combining the best …☆10Nov 3, 2023Updated 3 years ago
- Interact with your instance of AnythingLLM from the terminal.☆33Mar 5, 2026Updated 8 months ago
- ☆27Feb 1, 2025Updated last year
- Real-world Conversational AI personas.☆23Oct 23, 2023Updated 3 years ago
- Safely push a Cog model version by making sure it works and is backwards-compatible with previous versions.☆17Nov 5, 2026Updated 2 weeks ago
- ☆28May 27, 2026Updated 5 months ago
- Easy and Efficient Quantization for Transformers☆205Mar 25, 2026Updated 7 months ago
Are these results useful?