Inference engine for large language models on consumer GPUs, with deep optimization for older hardware
☆55Oct 16, 2026Updated this week
Alternatives and similar repositories for PocketLLM
Users that are interested in PocketLLM are comparing it to the libraries listed below. We may earn a commission when you buy through links labeled 'Ad' on this page.
Sorting:
- 重庆大学国创创业组优秀项目-笑递☆10Feb 15, 2023Updated 3 years ago
- ☆22Oct 1, 2024Updated 2 years ago
- ICSE 2025: Fuzzing MLIR compilers with Custom Mutation Synthesis☆15Jul 22, 2025Updated last year
- JAX implementation of GPTQ quantization algorithm☆10Jul 19, 2023Updated 3 years ago
- Python package for phage-host interaction prediction☆26Aug 31, 2026Updated last month
- Wordpress hosting with auto-scaling - Free Trial Offer • AdFully Managed hosting for WordPress and WooCommerce businesses that need reliable, auto-scalable performance. Cloudways SafeUpdates now available.
- ☆20May 18, 2025Updated last year
- 快来生成你的浏览记录年度总结!☆18Dec 12, 2024Updated last year
- Revision of official yolov7-pose to support custom dataset for keypoint detection☆11Nov 12, 2023Updated 2 years ago
- A program to make your character alive in 3D. 给她完整的一生 :）☆32Mar 31, 2023Updated 3 years ago
- ☆21Jun 2, 2026Updated 4 months ago
- Variational Auto Encoders for learning binding signatures of transcription factors☆15Mar 14, 2024Updated 2 years ago
- AiCC Comments Reply with GPT(OpenAi) is a plugin that uses OpenAI's GPT to automatically reply to comments on your WordPress website. The…☆22Mar 13, 2026Updated 7 months ago
- U-Net architecture inspired by "Machine Learning for Precipitation Nowcasting from Radar Images", implemented in Keras (Tensorflow).☆12Feb 17, 2021Updated 5 years ago
- A replication of the paper "Adaptive Mixtures of Local Experts" applied to the CIFAR-10 image classification dataset.☆12Mar 19, 2021Updated 5 years ago
- 1-Click AI Models by DigitalOcean Gradient • AdDeploy popular AI models on DigitalOcean Gradient GPU virtual machines with just a single click. Zero configuration with optimized deployments.
- A simple and efficient Python SDK for Multi OCR API☆17Feb 26, 2026Updated 7 months ago
- forked from vllm-project/flash-attention☆69May 9, 2026Updated 5 months ago
- eBPF endpoint observer for Linux: exec, file & network events as JSONL for your SIEM☆19Mar 9, 2026Updated 7 months ago
- The definitive vLLM runtime for dual RTX 2080 Ti 22GB + NVLink, delivering Qwen 27B local inference with maximum 200+ tok/s single-reques…☆1,153Oct 1, 2026Updated 2 weeks ago
- Welcome to the Bitcoin Lottery Miner, a unique simulation and mining tool for both fun and educational purposes! This project offers a fr…☆20Oct 7, 2025Updated last year
- Advanced use of WPScan (WordPress Security Scanner) with other tools like nmap, nikto, owasp-zap, ids for ethnical Hackers☆24Aug 13, 2025Updated last year
- ☆11Nov 12, 2018Updated 7 years ago
- Map query sequences to the assemblies of all pre-June 2023 bacteria (https://ftp.ebi.ac.uk/pub/databases/AllTheBacteria/Releases/0.2/) on…☆12May 22, 2024Updated 2 years ago
- Taxonomy classification of viral sequences / contigs☆13Jul 15, 2025Updated last year
- Managed Kubernetes at scale on DigitalOcean • AdDigitalOcean Kubernetes includes the control plane, bandwidth allowance, container registry, automatic updates, and more for free.
- ZJU B/S体系软件设计课程大作业☆13Jul 22, 2021Updated 5 years ago
- A full Mod_Security guide to use local software like clam-av, chkrootkit, fail2ban, rkhunter for Nginx & Apache☆24Apr 4, 2026Updated 6 months ago
- 基于PyQt5开发的CocoPyRPA的GUI版本☆11Apr 18, 2025Updated last year
- In this repo you can find my Modification Anno 2205 New Frontiers☆26Dec 7, 2024Updated last year
- ☆15Dec 3, 2024Updated last year
- Professional Use Only - Handle With Extreme Care! This tool is designed for experienced security professionals and red teams. It provides…☆16Aug 9, 2026Updated 2 months ago
- Tmux sidebar for vibe coding. Manage sessions and monitor agents at a glance☆15Sep 13, 2026Updated last month
- ☆15Apr 13, 2026Updated 6 months ago
- pangenome from maximal blocks in an MSA☆11Sep 17, 2024Updated 2 years ago
- Managed Database hosting by DigitalOcean • AdPostgreSQL, MySQL, MongoDB, Kafka, Valkey, and OpenSearch available. Automatically scale up storage and focus on building your apps.
- Pytorch implementation of models described in "Grounded compositional outputs for adaptive language modeling", EMNLP 2020.☆18Sep 10, 2021Updated 5 years ago
- Code for the paper *Attention Drift: What Speculative Decoding Models Learn*.☆33May 12, 2026Updated 5 months ago
- HyLight is a strain aware de novo assembly method based on the overlap-layout-consensus (OLC) paradigm that leverages the strengths of NG…☆12Sep 18, 2024Updated 2 years ago
- [ACM MM'25] The official implementation of paper "Towards Blind Bitstream-corrupted Video Recovery: A Visual Foundation Model-driven Fram…☆17Feb 4, 2026Updated 8 months ago
- Making code edting up to 7.7x faster using multi-layer speculation☆23Feb 20, 2025Updated last year
- ViBE: a hierarchical BERT model to identify viruses using metagenome sequencing data☆11Sep 6, 2022Updated 4 years ago
- ☆12Jun 7, 2024Updated 2 years ago