Source code repo for book: Hands-On LLM Serving and Optimization: Hosting LLMs at Scale
☆73Aug 16, 2026Updated 2 weeks ago
Alternatives and similar repositories for llm-model-inference
Users that are interested in llm-model-inference are comparing it to the libraries listed below. We may earn a commission when you buy through links labeled 'Ad' on this page.
Sorting:
- ☆18Nov 13, 2024Updated last year
- ☆16Jul 27, 2021Updated 5 years ago
- Cluster doctor skills☆14May 23, 2026Updated 3 months ago
- FTL Rust Demangler is a command-line tool for demangling symbol names that are mangled with the Rust convention. It takes a mangled symbo…☆45May 19, 2023Updated 3 years ago
- ☆78Jan 14, 2024Updated 2 years ago
- Deploy to Railway using AI coding agents - Free Credits Offer • AdUse Claude Code, Codex, OpenCode, and more. Autonomous software development now has the infrastructure to match with Railway.
- Implementation of UNET3+ in TensorFlow & PyTorch☆15Jul 16, 2025Updated last year
- The SBT Plugin for Artifactory resolve and pulish☆12Jul 22, 2023Updated 3 years ago
- Deep Learning courses, tutorials and examples with TensorFlow and PyTorch☆15Feb 1, 2021Updated 5 years ago
- A path planner for autonomous driving on highways☆16Sep 26, 2017Updated 8 years ago
- Scala non-blocking Aerospike client (archived as unmaintained)☆20Jan 25, 2019Updated 7 years ago
- Get information about stripped rust executables☆46May 16, 2025Updated last year
- sbt plugin to run Pamflet (and Pamflet plugin to run sbt)☆11Jan 15, 2017Updated 9 years ago
- A package of Wide Residual Networks for image recognition in Keras.☆15Jan 22, 2022Updated 4 years ago
- Porting caffe to android platform☆10Jul 16, 2016Updated 10 years ago
- Managed hosting for WordPress and PHP on Cloudways • AdManaged hosting for WordPress, Magento, Laravel, or PHP apps, on multiple cloud providers. Deploy in minutes on Cloudways by DigitalOcean.
- Vecna is a Python chatbot which recommends songs and movies depending upon your feelings☆12Jun 28, 2022Updated 4 years ago
- ☆20Jun 11, 2024Updated 2 years ago
- Using Azure SignalR Service and other Azure services to build real-time web applications.☆11Jul 18, 2023Updated 3 years ago
- Common format for transferring and applying function information across binary analysis tools☆68Nov 5, 2025Updated 9 months ago
- Belief Revision based Caption Re-ranker with Visual Semantic Information. COLING 2022☆11Apr 13, 2025Updated last year
- 🦖 Reconstruct Types from Binary Code☆56Nov 21, 2025Updated 9 months ago
- Converts OpenAPI 2.0 (f.k.a. Swagger) definitions into a representation used by AutoRest (https://github.com/Azure/autorest) code generat…☆12Jun 4, 2025Updated last year
- A simple GPT-3 interface to automate core legal writing tasks☆13Mar 8, 2023Updated 3 years ago
- Hands-On High Performance with Go, published by Packt☆14Jan 30, 2023Updated 3 years ago
- 1-Click AI Models by DigitalOcean Gradient • AdDeploy popular AI models on DigitalOcean Gradient GPU virtual machines with just a single click. Zero configuration with optimized deployments.
- The fun programming language☆17Oct 30, 2024Updated last year
- An implementation of Compositional Attention: Disentangling Search and Retrieval by MILA☆14Jun 1, 2022Updated 4 years ago
- Scala SBT (Giter8) Template (Multi-Module with App)☆10Dec 23, 2016Updated 9 years ago
- Vector search with Pinecone and Openai to search through contract law textbook. If downloaded, remeber to install all dependencies. Refer…☆11Mar 30, 2023Updated 3 years ago
- Database connection management plugin for Litestar and asyncpg☆14Aug 24, 2026Updated last week
- A short ScalaCheck tutorial for the Programming Principles course☆14Oct 4, 2021Updated 4 years ago
- Utility for dumping all the information Capstone has on given instructions.☆21Oct 1, 2021Updated 4 years ago
- Colab notebook to finetune GLIDE.☆12Mar 22, 2022Updated 4 years ago
- "A Practical Recipe for Hardware Implants" presentation materials.☆13Nov 10, 2020Updated 5 years ago
- Managed Database hosting by DigitalOcean • AdPostgreSQL, MySQL, MongoDB, Kafka, Valkey, and OpenSearch available. Automatically scale up storage and focus on building your apps.
- MouHidInputHook enables users to filter, modify, and inject mouse input data packets into the input data stream of HID USB mouse devices …☆11Jul 11, 2019Updated 7 years ago
- A Datasette plugin providing an MLOps platform to train, eval and predict machine learning models☆18Aug 3, 2026Updated 3 weeks ago
- We archive data because we are interested in the diffs. All data is from https://video-api.cartoonnetwork.com. We run the check every min…☆10Updated this week
- mPLM-Sim: Better Cross-Lingual Similarity and Transfer in Multilingual Pretrained Language Models☆11Jan 19, 2024Updated 2 years ago
- ☆11Sep 7, 2020Updated 5 years ago
- Non-local Modeling for Image Quality Assessment☆13Dec 20, 2023Updated 2 years ago
- This is a dehazed method for remote sensing image, which based on CycleGAN.☆12May 10, 2022Updated 4 years ago