Source code repo for book: Hands-On LLM Serving and Optimization: Hosting LLMs at Scale
☆122Aug 16, 2026Updated last month
Alternatives and similar repositories for llm-model-inference
Users that are interested in llm-model-inference are comparing it to the libraries listed below. We may earn a commission when you buy through links labeled 'Ad' on this page.
Sorting:
- ☆18Nov 13, 2024Updated last year
- FTL Rust Demangler is a command-line tool for demangling symbol names that are mangled with the Rust convention. It takes a mangled symbo…☆45May 19, 2023Updated 3 years ago
- ☆78Jan 14, 2024Updated 2 years ago
- Get information about stripped rust executables☆46May 16, 2025Updated last year
- Go implementation of bcrypt_pbkdf(3) from OpenBSD☆15Jun 27, 2026Updated 3 months ago
- Wordpress hosting with auto-scaling - Free Trial Offer • AdFully Managed hosting for WordPress and WooCommerce businesses that need reliable, auto-scalable performance. Cloudways SafeUpdates now available.
- Common format for transferring and applying function information across binary analysis tools☆67Nov 5, 2025Updated 11 months ago
- 🦖 Reconstruct Types from Binary Code☆60Nov 21, 2025Updated 10 months ago
- A simple GPT-3 interface to automate core legal writing tasks☆13Mar 8, 2023Updated 3 years ago
- An implementation of Compositional Attention: Disentangling Search and Retrieval by MILA☆14Jun 1, 2022Updated 4 years ago
- Vector search with Pinecone and Openai to search through contract law textbook. If downloaded, remeber to install all dependencies. Refer…☆11Mar 30, 2023Updated 3 years ago
- reStructuredText in C☆14May 20, 2023Updated 3 years ago
- Utility for dumping all the information Capstone has on given instructions.☆21Oct 1, 2021Updated 5 years ago
- Colab notebook to finetune GLIDE.☆12Mar 22, 2022Updated 4 years ago
- A flexible image server written in go, using chained image filters☆14Mar 21, 2015Updated 11 years ago
- Wordpress hosting with auto-scaling - Free Trial Offer • AdFully Managed hosting for WordPress and WooCommerce businesses that need reliable, auto-scalable performance. Cloudways SafeUpdates now available.
- execute shell scripts among multiple ssh servers☆13Aug 23, 2024Updated 2 years ago
- high performance KV database based on bitcask☆12May 12, 2023Updated 3 years ago
- A Datasette plugin providing an MLOps platform to train, eval and predict machine learning models☆18Oct 5, 2026Updated last week
- We archive data because we are interested in the diffs. All data is from https://video-api.cartoonnetwork.com. We run the check every min…☆11Updated this week
- MIRROR: http://luajit.org/git/luajit-2.0.git☆15Mar 14, 2014Updated 12 years ago
- aggregate prefix to shorter list☆17Mar 22, 2024Updated 2 years ago
- Testing and helper tool for grpc server, using cuelang and grpcurl.☆16Oct 25, 2021Updated 4 years ago
- ☆14May 19, 2016Updated 10 years ago
- A pathway and collection of resources to learning Jax from beginning to advance.☆11Jan 2, 2021Updated 5 years ago
- Deploy on Railway without the complexity - Free Credits Offer • AdConnect your repo and Railway handles the rest with instant previews. Quickly provision container image services, databases, and storage volumes.
- mPLM-Sim: Better Cross-Lingual Similarity and Transfer in Multilingual Pretrained Language Models☆11Jan 19, 2024Updated 2 years ago
- std::RefCell with more useful error messages.☆16May 18, 2025Updated last year
- ☆11Apr 5, 2025Updated last year
- ☆11Sep 7, 2020Updated 6 years ago
- MaXM is a suite of test-only benchmarks for multilingual visual question answering in 7 languages: English (en), French (fr), Hindi (hi),…☆13Jan 16, 2024Updated 2 years ago
- Non-local Modeling for Image Quality Assessment☆13Dec 20, 2023Updated 2 years ago
- This is a dehazed method for remote sensing image, which based on CycleGAN.☆13May 10, 2022Updated 4 years ago
- An eBPF kernel Observable Agent To Spy Performance Issue On OS.☆13Oct 31, 2025Updated 11 months ago
- Code for the paper "Code-Mixing on Sesame Street: Dawn of the Adversarial Polyglots" (NAACL-HLT 2021)☆10May 1, 2025Updated last year
- 1-Click AI Models by DigitalOcean Gradient • AdDeploy popular AI models on DigitalOcean Gradient GPU virtual machines with just a single click. Zero configuration with optimized deployments.
- A flexible byte pool.☆19Apr 15, 2023Updated 3 years ago
- ☆14Aug 30, 2022Updated 4 years ago
- A Benchmark Corpus for Low-Resource Cantonese Punctuation Restoration from Speech Transcripts☆15Dec 3, 2024Updated last year
- Scraping LegiFrance naturalisation decrees for fun and OSINT profit☆12May 27, 2023Updated 3 years ago
- LLM Oracle is a GPT-4 powered tool for predicting future events. It's like a Magic 8 Ball that is able to perform basic research, calcula…☆18May 27, 2023Updated 3 years ago
- ☆15May 21, 2022Updated 4 years ago
- Extract information from XBRL files in the ESEF format☆13Jan 3, 2026Updated 9 months ago