Source code repo for book: Hands-On LLM Serving and Optimization: Hosting LLMs at Scale
☆102Aug 16, 2026Updated last month
Alternatives and similar repositories for llm-model-inference
Users that are interested in llm-model-inference are comparing it to the libraries listed below. We may earn a commission when you buy through links labeled 'Ad' on this page.
Sorting:
- ☆18Aug 5, 2023Updated 3 years ago
- ☆18Nov 13, 2024Updated last year
- Wireshark dissector for Socket.IO traffic☆15Jul 26, 2016Updated 10 years ago
- Cluster doctor skills☆14May 23, 2026Updated 3 months ago
- ☆10Sep 2, 2017Updated 9 years ago
- Virtual machines for every use case on DigitalOcean • AdGet dependable uptime with 99.99% SLA, simple security tools, and predictable monthly pricing with DigitalOcean's virtual machines, called Droplets.
- SwinTransformer for Tensorflow2☆11Jul 7, 2022Updated 4 years ago
- I have built a model which will predict the sentiment of movie reviews. I used Naive-Bayes, SVM, and RNN+LSTM based model to obtain reall…☆10Jan 4, 2018Updated 8 years ago
- FTL Rust Demangler is a command-line tool for demangling symbol names that are mangled with the Rust convention. It takes a mangled symbo…☆45May 19, 2023Updated 3 years ago
- A Tensorflow2.x implementation of EfficientDet☆13Mar 4, 2021Updated 5 years ago
- DJIA index prices of 10 years and NYtimes news articles headline has been used to predict the DJIA index prices☆18Feb 21, 2018Updated 8 years ago
- Predicting a song's owner from its audio features, using the Spotify Web API and machine learning☆17Jan 10, 2018Updated 8 years ago
- Deep Learning courses, tutorials and examples with TensorFlow and PyTorch☆15Feb 1, 2021Updated 5 years ago
- A path planner for autonomous driving on highways☆16Sep 26, 2017Updated 8 years ago
- Get information about stripped rust executables☆46May 16, 2025Updated last year
- Deploy to Railway using AI coding agents - Free Credits Offer • AdUse Claude Code, Codex, OpenCode, and more. Autonomous software development now has the infrastructure to match with Railway.
- ☆24Jul 22, 2017Updated 9 years ago
- Porting caffe to android platform☆10Jul 16, 2016Updated 10 years ago
- Vecna is a Python chatbot which recommends songs and movies depending upon your feelings☆12Jun 28, 2022Updated 4 years ago
- preparation guide for aws big data / data analytics – specialty exam☆18Nov 23, 2020Updated 5 years ago
- Performance benchmarks of Python, Numpy, etc. vs. other languages such as Matlab, Julia, Fortran.☆29Mar 17, 2026Updated 6 months ago
- Go implementation of bcrypt_pbkdf(3) from OpenBSD☆15Jun 27, 2026Updated 2 months ago
- ☆20Jun 11, 2024Updated 2 years ago
- ☆34Dec 12, 2024Updated last year
- implement mxnet face and insightface with mapr streams for near real time face detection and recognition in video streams with residual n…☆16Apr 15, 2018Updated 8 years ago
- Managed hosting for WordPress and PHP on Cloudways • AdManaged hosting for WordPress, Magento, Laravel, or PHP apps, on multiple cloud providers. Deploy in minutes on Cloudways by DigitalOcean.
- AES-GEM (AES Galois Extended Mode) implementation.☆14May 19, 2026Updated 4 months ago
- Belief Revision based Caption Re-ranker with Visual Semantic Information. COLING 2022☆11Apr 13, 2025Updated last year
- 🦖 Reconstruct Types from Binary Code☆58Nov 21, 2025Updated 9 months ago
- Attentional guide metoduyla deep convolutional neural networks kullanılarak hazırlanan text to speech modelinin türkçeye derlenmiş halidi…☆16Sep 25, 2019Updated 6 years ago
- A simple GPT-3 interface to automate core legal writing tasks☆13Mar 8, 2023Updated 3 years ago
- Hands-On High Performance with Go, published by Packt☆14Jan 30, 2023Updated 3 years ago
- PyTorch/FastAPI facial-expression classification research scaffold with reproducible evaluation contracts, CI/security automation, versio…☆25Sep 12, 2026Updated last week
- Kpad is a simple multiplatform terminal editor born to edit kubernetes declarative manifest yaml files.☆44Oct 10, 2023Updated 2 years ago
- The fun programming language☆17Oct 30, 2024Updated last year
- Wordpress hosting with auto-scaling - Free Trial Offer • AdFully Managed hosting for WordPress and WooCommerce businesses that need reliable, auto-scalable performance. Cloudways SafeUpdates now available.
- QEMU based emulation library for micro-architectural simulation (ARM64 and x86)☆44Jun 30, 2019Updated 7 years ago
- An implementation of Compositional Attention: Disentangling Search and Retrieval by MILA☆14Jun 1, 2022Updated 4 years ago
- Video face recognition and content creator collaboration detection framework.☆15Mar 24, 2023Updated 3 years ago
- Scala SBT (Giter8) Template (Multi-Module with App)☆10Dec 23, 2016Updated 9 years ago
- 🐍 Python script produces .pdf file from .ipynb (which may contain Cyrillic characters)☆19Nov 21, 2018Updated 7 years ago
- Vector search with Pinecone and Openai to search through contract law textbook. If downloaded, remeber to install all dependencies. Refer…☆11Mar 30, 2023Updated 3 years ago
- An Alfred workflow that helps searching Microsoft Edge Bookmark☆12Mar 13, 2020Updated 6 years ago