Source code repo for book: Hands-On LLM Serving and Optimization: Hosting LLMs at Scale
☆43Jun 3, 2026Updated last month
Alternatives and similar repositories for llm-model-inference
Users that are interested in llm-model-inference are comparing it to the libraries listed below. We may earn a commission when you buy through links labeled 'Ad' on this page.
Sorting:
- InfinyOn Labs projects☆14Dec 9, 2024Updated last year
- ☆18Nov 13, 2024Updated last year
- RabbitMQ producer and consumer example with fastapi☆12Jan 25, 2023Updated 3 years ago
- Cluster doctor skills☆14May 23, 2026Updated last month
- SwinTransformer for Tensorflow2☆11Jul 7, 2022Updated 4 years ago
- 1-Click AI Models by DigitalOcean Gradient • AdDeploy popular AI models on DigitalOcean Gradient GPU virtual machines with just a single click. Zero configuration with optimized deployments.
- FTL Rust Demangler is a command-line tool for demangling symbol names that are mangled with the Rust convention. It takes a mangled symbo…☆45May 19, 2023Updated 3 years ago
- ☆79Jan 14, 2024Updated 2 years ago
- The Fluvio Python Client!☆20Feb 3, 2026Updated 5 months ago
- Get information about stripped rust executables☆46May 16, 2025Updated last year
- Scala non-blocking Aerospike client (archived as unmaintained)☆20Jan 25, 2019Updated 7 years ago
- A package of Wide Residual Networks for image recognition in Keras.☆15Jan 22, 2022Updated 4 years ago
- ☆24Jul 22, 2017Updated 8 years ago
- preparation guide for aws big data / data analytics – specialty exam☆18Nov 23, 2020Updated 5 years ago
- implement mxnet face and insightface with mapr streams for near real time face detection and recognition in video streams with residual n…☆16Apr 15, 2018Updated 8 years ago
- Wordpress hosting with auto-scaling - Free Trial Offer • AdFully Managed hosting for WordPress and WooCommerce businesses that need reliable, auto-scalable performance. Cloudways SafeUpdates now available.
- reStructuredText in C☆13May 20, 2023Updated 3 years ago
- Belief Revision based Caption Re-ranker with Visual Semantic Information. COLING 2022☆11Apr 13, 2025Updated last year
- SOM clustering on IRIS dataset☆16Jul 28, 2018Updated 7 years ago
- [FG 2024] Official implementation of Hyp-OC: Hyperbolic One Class Classification for Face Anti-Spoofing☆23Jul 20, 2025Updated last year
- The **Facial Emotion Recognition System** is a robust computer vision pipeline that detects and classifies human emotions (e.g., happy, s…☆23Updated this week
- An implementation of Compositional Attention: Disentangling Search and Retrieval by MILA☆14Jun 1, 2022Updated 4 years ago
- Vector search with Pinecone and Openai to search through contract law textbook. If downloaded, remeber to install all dependencies. Refer…☆11Mar 30, 2023Updated 3 years ago
- Utility for dumping all the information Capstone has on given instructions.☆21Oct 1, 2021Updated 4 years ago
- Colab notebook to finetune GLIDE.☆12Mar 22, 2022Updated 4 years ago
- Deploy on Railway without the complexity - Free Credits Offer • AdConnect your repo and Railway handles the rest with instant previews. Quickly provision container image services, databases, and storage volumes.
- A flexible image server written in go, using chained image filters☆14Mar 21, 2015Updated 11 years ago
- "A Practical Recipe for Hardware Implants" presentation materials.☆13Nov 10, 2020Updated 5 years ago
- MouHidInputHook enables users to filter, modify, and inject mouse input data packets into the input data stream of HID USB mouse devices …☆11Jul 11, 2019Updated 7 years ago
- high performance KV database based on bitcask☆12May 12, 2023Updated 3 years ago
- A Datasette plugin providing an MLOps platform to train, eval and predict machine learning models☆17Updated this week
- MIRROR: http://luajit.org/git/luajit-2.0.git☆15Mar 14, 2014Updated 12 years ago
- We archive data because we are interested in the diffs. All data is from https://video-api.cartoonnetwork.com. We run the check every min…☆10Updated this week
- mPLM-Sim: Better Cross-Lingual Similarity and Transfer in Multilingual Pretrained Language Models☆11Jan 19, 2024Updated 2 years ago
- deep learning for scholars in architecture and urban studies☆12Sep 20, 2017Updated 8 years ago
- Simple, predictable pricing with DigitalOcean hosting • AdAlways know what you'll pay with monthly caps and flat pricing. Enterprise-grade infrastructure trusted by 600k+ customers.
- std::RefCell with more useful error messages.☆16May 18, 2025Updated last year
- MaXM is a suite of test-only benchmarks for multilingual visual question answering in 7 languages: English (en), French (fr), Hindi (hi),…☆13Jan 16, 2024Updated 2 years ago
- Non-local Modeling for Image Quality Assessment☆13Dec 20, 2023Updated 2 years ago
- This is a dehazed method for remote sensing image, which based on CycleGAN.☆12May 10, 2022Updated 4 years ago
- Comparison of Variational Autoencoders with Bayesian Neural Networks. Accuracy, Latent space, Reconstruction and White Noise filtering.☆28Feb 16, 2018Updated 8 years ago
- ☆14Aug 30, 2022Updated 3 years ago
- PaDiM based EfficientNet and improve the inference time☆24Oct 7, 2021Updated 4 years ago