Cortex.Tensorrt-LLM is a C++ inference library that can be loaded by any server at runtime. It submodules NVIDIA’s TensorRT-LLM for GPU accelerated inference on NVIDIA's GPUs.
☆41Sep 26, 2024Updated last year
Alternatives and similar repositories for cortex.tensorrt-llm
Users that are interested in cortex.tensorrt-llm are comparing it to the libraries listed below. We may earn a commission when you buy through links labeled 'Ad' on this page.
Sorting:
- cortex.llamacpp is a high-efficiency C++ inference engine for edge computing. It is a dynamic library that can be loaded by any server a…☆44Jul 4, 2025Updated last year
- Efficient Finetuning for OpenAI GPT-OSS☆24Oct 2, 2025Updated 10 months ago
- A small utility library for parsing GGUF file info☆31Jan 27, 2025Updated last year
- IntelliDisk is an alternative Windows version to the famous Microsoft OneDrive!☆15Updated this week
- Local AI API Platform☆2,753Jul 4, 2025Updated last year
- Managed hosting for WordPress and PHP on Cloudways • AdManaged hosting for WordPress, Magento, Laravel, or PHP apps, on multiple cloud providers. Deploy in minutes on Cloudways by DigitalOcean.
- Attempt at cog wrapper for nightmareai/real-esrgan for larger images☆16Sep 28, 2023Updated 2 years ago
- ☆12Nov 8, 2023Updated 2 years ago
- A Deeplearn Model to rec table in photo with ncnn. 一个深度学习模型用于检测图片中的表格 画像内のテーブルを検出するためのディープラーニング モデル☆20Mar 2, 2025Updated last year
- 🌐 OpenCrawl: An ethical, high-performance web crawler built for scale A powerful web crawling library that respects robots.txt and rate…☆27Apr 3, 2025Updated last year
- ☆140Apr 23, 2024Updated 2 years ago
- Readarr (develop) with bash scripts to automate and extend functionality.☆11Jul 16, 2023Updated 3 years ago
- Run AuraFlow on Replicate☆14Jul 12, 2024Updated 2 years ago
- An open-source framework designed to extend and maintain the ESCO taxonomy☆18Mar 12, 2026Updated 5 months ago
- Attempt at cog wrapper for a SDXL CLIP Interrogator☆10May 16, 2024Updated 2 years ago
- Managed hosting for WordPress and PHP on Cloudways • AdManaged hosting for WordPress, Magento, Laravel, or PHP apps, on multiple cloud providers. Deploy in minutes on Cloudways by DigitalOcean.
- A Framework of Pre-trained Models for Efficient and Accurate Network Traffic Classification☆16Apr 24, 2026Updated 4 months ago
- Cog wrapper for microsoft/OmniParser-v2☆12Feb 25, 2025Updated last year
- SeeSR: Towards Semantics-Aware Real-World Image Super-Resolution☆14Jan 12, 2024Updated 2 years ago
- ☆29May 27, 2026Updated 3 months ago
- ☆17Jun 22, 2024Updated 2 years ago
- Cog wrapper for playgroundai/playground-v2.5-1024px-aesthetic☆17Nov 25, 2024Updated last year
- Moved to here: https://github.com/lyogavin/airllm☆37Aug 1, 2024Updated 2 years ago
- Safely push a Cog model version by making sure it works and is backwards-compatible with previous versions.☆17Dec 4, 2025Updated 8 months ago
- RWKV is a RNN with transformer-level LLM performance. It can be directly trained like a GPT (parallelizable). So it's combining the best …☆10Nov 3, 2023Updated 2 years ago
- AI Agents on DigitalOcean Gradient AI Platform • AdBuild production-ready AI agents using customizable tools or access multiple LLMs through a single endpoint. Create custom knowledge bases or connect external data.
- Retrieval Augmented Generation: General Assistant model☆17Mar 6, 2024Updated 2 years ago
- SYN flood implementation using Boost.Asio☆12Nov 20, 2014Updated 11 years ago
- a WIP architecture designed to allow transformers to think in a manner without tokens☆19Apr 12, 2024Updated 2 years ago
- Companion Application to FindKeys, to recover lost option licensing keys☆22Oct 9, 2020Updated 5 years ago
- Cog wrapper for FalconsAi / nsfw_image_detection☆19Aug 6, 2025Updated last year
- Code for paper: "QuIP: 2-Bit Quantization of Large Language Models With Guarantees" adapted for Llama models☆40Aug 4, 2023Updated 3 years ago
- ☆14May 25, 2023Updated 3 years ago
- Improve Devcontainer Creation☆16May 17, 2026Updated 3 months ago
- Cog wrapper for collabora/WhisperSpeech☆25Mar 5, 2024Updated 2 years ago
- Deploy on Railway without the complexity - Free Credits Offer • AdConnect your repo and Railway handles the rest with instant previews. Quickly provision container image services, databases, and storage volumes.
- ☆18Dec 6, 2024Updated last year
- ☆10Aug 18, 2025Updated last year
- Load and run Llama from safetensors files in C☆16Oct 24, 2024Updated last year
- awesome templates for textgenertor obsidian plugin☆10Nov 28, 2023Updated 2 years ago
- FlexAttention w/ FlashAttention3 Support☆27Oct 5, 2024Updated last year
- An interactive one-pager browser game, primarily built with React.js. It makes use of the state-of-the-art Jurassic-2 language models to …☆16Sep 13, 2023Updated 2 years ago
- ☆15Jan 19, 2018Updated 8 years ago