Inference engine for large language models on consumer GPUs, with deep optimization for older hardware
☆53Sep 26, 2026Updated this week
Alternatives and similar repositories for PocketLLM
Users that are interested in PocketLLM are comparing it to the libraries listed below. We may earn a commission when you buy through links labeled 'Ad' on this page.
Sorting:
- ☆37Sep 17, 2026Updated last week
- ☆12Mar 21, 2024Updated 2 years ago
- ☆22Jun 1, 2025Updated last year
- ☆22Oct 1, 2024Updated last year
- ☆15Apr 3, 2026Updated 5 months ago
- Managed hosting for WordPress and PHP on Cloudways • AdManaged hosting for WordPress, Magento, Laravel, or PHP apps, on multiple cloud providers. Deploy in minutes on Cloudways by DigitalOcean.
- ☆13Jun 23, 2024Updated 2 years ago
- ICSE 2025: Fuzzing MLIR compilers with Custom Mutation Synthesis☆15Jul 22, 2025Updated last year
- JAX implementation of GPTQ quantization algorithm☆10Jul 19, 2023Updated 3 years ago
- watchOS app to control a Tesla vehicle over BLE☆15Nov 20, 2023Updated 2 years ago
- Pipeline for analyzing rare mutations in metagenome-assembled genomes☆10Apr 4, 2025Updated last year
- 快来生成你的浏览记录年度总结!☆18Dec 12, 2024Updated last year
- Unity 游戏素材命令行提取工具 —— CG、音频、立绘、背景，按需导出。基于 AssetRipper。 CLI tool for extracting Unity game assets — CG, audio, characters, backgroun…☆29Apr 7, 2026Updated 5 months ago
- Revision of official yolov7-pose to support custom dataset for keypoint detection☆11Nov 12, 2023Updated 2 years ago
- github release proxy☆15Jun 2, 2020Updated 6 years ago
- Virtual machines for every use case on DigitalOcean • AdGet dependable uptime with 99.99% SLA, simple security tools, and predictable monthly pricing with DigitalOcean's virtual machines, called Droplets.
- 时语 Shiyu Subtitle - 基于 Tauri + Vue 3 + SenseVoice-Small 的极速、轻量级 100% 离线本地 AI 字幕助手。支持高精度断句与 -150ms 智能时值对齐。Ultra-fast, lightweight & 100% o…☆17May 21, 2026Updated 4 months ago
- Code for "Fine-Tuning by Curriculum Learning for Non-Autoregressive Neural Machine Translation"☆13Jul 10, 2020Updated 6 years ago
- Highly experimental port of edk2 for rk3399☆33Dec 27, 2020Updated 5 years ago
- Variational Auto Encoders for learning binding signatures of transcription factors☆15Mar 14, 2024Updated 2 years ago
- Star Manager is a local-first web app for organizing GitHub starred repositories with Star Lists and optional LLM-assisted classification…☆15Mar 26, 2026Updated 6 months ago
- SoC for CQU Dual Issue Machine☆12Sep 20, 2022Updated 4 years ago
- ☆13Feb 28, 2024Updated 2 years ago
- The definitive vLLM runtime for dual RTX 2080 Ti 22GB + NVLink, delivering Qwen 27B local inference with maximum 200+ tok/s single-reques…☆977Updated this week
- forked from vllm-project/flash-attention☆66May 9, 2026Updated 4 months ago
- Managed Database hosting by DigitalOcean • AdPostgreSQL, MySQL, MongoDB, Kafka, Valkey, and OpenSearch available. Automatically scale up storage and focus on building your apps.
- ☆10Oct 27, 2023Updated 2 years ago
- 第三个压制教程版本，适用于不想看原理，马上要把参数复制粘贴来用的情况（っ╹◡╹)ﾉ☆13Jun 9, 2026Updated 3 months ago
- A lightweight desktop app that connects WeChat OpenClaw/iLink messages to a simple AI assistant.☆16May 28, 2026Updated 3 months ago
- The forgotten garbage that transcends all causes and effects.☆11May 23, 2024Updated 2 years ago
- Map query sequences to the assemblies of all pre-June 2023 bacteria (https://ftp.ebi.ac.uk/pub/databases/AllTheBacteria/Releases/0.2/) on…☆12May 22, 2024Updated 2 years ago
- OpenAI-compatible Web Chat API proxy with GPT, Grok, Gemini account management and Docker self-hosting☆386Jun 7, 2026Updated 3 months ago
- a precise pangenome browser combining linear and graph-based pan-genome☆13Jul 16, 2024Updated 2 years ago
- Taxonomy classification of viral sequences / contigs☆13Jul 15, 2025Updated last year
- ZJU B/S体系软件设计课程大作业☆13Jul 22, 2021Updated 5 years ago
- 1-Click AI Models by DigitalOcean Gradient • AdDeploy popular AI models on DigitalOcean Gradient GPU virtual machines with just a single click. Zero configuration with optimized deployments.
- 小神通LIC-2001/3001 中文字库生成程序☆23Jan 18, 2023Updated 3 years ago
- Optimal distance lower bound k-mer sampling.☆12Jun 19, 2024Updated 2 years ago
- Code & utilities for the manuscript "Lineage Recording Reveals the Phylodynamics, Plasticity and Paths of Tumor Evolution"☆14May 27, 2023Updated 3 years ago
- Use yolov5 to realize the road occupation operation and vehicle parking violation detection in urban streets, and can independently delin…☆13Jan 2, 2023Updated 3 years ago
- ☆10Jun 9, 2025Updated last year
- API for the IGS data portal☆11May 6, 2021Updated 5 years ago
- ☆32Aug 17, 2026Updated last month