Source code repo for book: Hands-On LLM Serving and Optimization: Hosting LLMs at Scale
☆60Jun 3, 2026Updated 2 months ago
Alternatives and similar repositories for llm-model-inference
Users that are interested in llm-model-inference are comparing it to the libraries listed below. We may earn a commission when you buy through links labeled 'Ad' on this page.
Sorting:
- Cluster doctor skills☆14May 23, 2026Updated 2 months ago
- SwinTransformer for Tensorflow2☆11Jul 7, 2022Updated 4 years ago
- I have built a model which will predict the sentiment of movie reviews. I used Naive-Bayes, SVM, and RNN+LSTM based model to obtain reall…☆10Jan 4, 2018Updated 8 years ago
- ☆80Jan 14, 2024Updated 2 years ago
- The Fluvio Python Client!☆20Feb 3, 2026Updated 6 months ago
- Deploy to Railway using AI coding agents - Free Credits Offer • AdUse Claude Code, Codex, OpenCode, and more. Autonomous software development now has the infrastructure to match with Railway.
- A Tensorflow2.x implementation of EfficientDet☆12Mar 4, 2021Updated 5 years ago
- BCCD Dataset is a small-scale dataset for blood cells detection.☆12Apr 19, 2018Updated 8 years ago
- This repository provides an overview of Segformer, architecture encoder in particular. Some details of Segformer can be misleaded, thus m…☆19Apr 27, 2023Updated 3 years ago
- Deep Learning courses, tutorials and examples with TensorFlow and PyTorch☆15Feb 1, 2021Updated 5 years ago
- A package of Wide Residual Networks for image recognition in Keras.☆15Jan 22, 2022Updated 4 years ago
- ☆24Jul 22, 2017Updated 9 years ago
- Vecna is a Python chatbot which recommends songs and movies depending upon your feelings☆12Jun 28, 2022Updated 4 years ago
- Performance benchmarks of Python, Numpy, etc. vs. other languages such as Matlab, Julia, Fortran.☆29Mar 17, 2026Updated 4 months ago
- Udemy'de hazırladığım "Kubernetes'e Başlarken" kursunda kullanılan örnek dosyalar☆17Mar 26, 2021Updated 5 years ago
- Managed Kubernetes at scale on DigitalOcean • AdDigitalOcean Kubernetes includes the control plane, bandwidth allowance, container registry, automatic updates, and more for free.
- Attentional guide metoduyla deep convolutional neural networks kullanılarak hazırlanan text to speech modelinin türkçeye derlenmiş halidi…☆15Sep 25, 2019Updated 6 years ago
- Common format for transferring and applying function information across binary analysis tools☆68Nov 5, 2025Updated 9 months ago
- Belief Revision based Caption Re-ranker with Visual Semantic Information. COLING 2022☆11Apr 13, 2025Updated last year
- ☆32Dec 15, 2023Updated 2 years ago
- SOM clustering on IRIS dataset☆16Jul 28, 2018Updated 8 years ago
- A simple GPT-3 interface to automate core legal writing tasks☆13Mar 8, 2023Updated 3 years ago
- Exploring possible methods for Audio Anomaly Detection - on machine sounds (MIMII dataset)☆19Sep 12, 2025Updated 10 months ago
- An implementation of Compositional Attention: Disentangling Search and Retrieval by MILA☆14Jun 1, 2022Updated 4 years ago
- 🐍 Python script produces .pdf file from .ipynb (which may contain Cyrillic characters)☆19Nov 21, 2018Updated 7 years ago
- Managed Database hosting by DigitalOcean • AdPostgreSQL, MySQL, MongoDB, Kafka, Valkey, and OpenSearch available. Automatically scale up storage and focus on building your apps.
- Vector search with Pinecone and Openai to search through contract law textbook. If downloaded, remeber to install all dependencies. Refer…☆11Mar 30, 2023Updated 3 years ago
- Database connection management plugin for Litestar and asyncpg☆14Updated this week
- MouHidInputHook enables users to filter, modify, and inject mouse input data packets into the input data stream of HID USB mouse devices …☆11Jul 11, 2019Updated 7 years ago
- We archive data because we are interested in the diffs. All data is from https://video-api.cartoonnetwork.com. We run the check every min…☆10Updated this week
- Dogs vs. Cats Redux on floydhub☆24Jun 19, 2017Updated 9 years ago
- A pathway and collection of resources to learning Jax from beginning to advance.☆11Jan 2, 2021Updated 5 years ago
- mPLM-Sim: Better Cross-Lingual Similarity and Transfer in Multilingual Pretrained Language Models☆11Jan 19, 2024Updated 2 years ago
- phonetic similarity algorithms☆13Jun 19, 2018Updated 8 years ago
- MaXM is a suite of test-only benchmarks for multilingual visual question answering in 7 languages: English (en), French (fr), Hindi (hi),…☆13Jan 16, 2024Updated 2 years ago
- Wordpress hosting with auto-scaling - Free Trial Offer • AdFully Managed hosting for WordPress and WooCommerce businesses that need reliable, auto-scalable performance. Cloudways SafeUpdates now available.
- This is a dehazed method for remote sensing image, which based on CycleGAN.☆12May 10, 2022Updated 4 years ago
- A Rust library along with a Win32 GUI application to determine the driver load order of a Windows system (cf. https://colinfinck.de/posts…☆13Jan 26, 2025Updated last year
- Official repository of Tapir Lab.'s Lip-Sync Method☆10Oct 3, 2023Updated 2 years ago
- A Benchmark Corpus for Low-Resource Cantonese Punctuation Restoration from Speech Transcripts☆15Dec 3, 2024Updated last year
- Scraping LegiFrance naturalisation decrees for fun and OSINT profit☆12May 27, 2023Updated 3 years ago
- AFL++(2.63c/2.65c) + aflsmart(5ad7ea3)☆11Oct 20, 2020Updated 5 years ago
- LLM Oracle is a GPT-4 powered tool for predicting future events. It's like a Magic 8 Ball that is able to perform basic research, calcula…☆17May 27, 2023Updated 3 years ago