大语言模型工具集
☆28Aug 1, 2025Updated last year
Alternatives and similar repositories for llm-tools
Users that are interested in llm-tools are comparing it to the libraries listed below. We may earn a commission when you buy through links labeled 'Ad' on this page.
Sorting:
- LvLLM is a special NUMA extension of vllm that makes full use of CPU and memory resources, reduces GPU memory requirements, and features …☆434Updated this week
- Lsglang is a special extension of sglang that fully utilizes CPU and GPU computing resources with an efficient GPU parallel + NUMA parall…☆109Updated this week
- forked from vllm-project/flash-attention☆59May 9, 2026Updated 3 months ago
- vllm混合推理扩展插件，支持多NUMA混合推理，单卡推理Qwen3-Next模型可达1000+ prefill☆34Nov 7, 2025Updated 9 months ago
- ☆19Apr 15, 2026Updated 4 months ago
- Wordpress hosting with auto-scaling - Free Trial Offer • AdFully Managed hosting for WordPress and WooCommerce businesses that need reliable, auto-scalable performance. Cloudways SafeUpdates now available.
- 主要写er-nerf从零到一所有部署过程☆44Aug 28, 2024Updated last year
- ☆10May 27, 2025Updated last year
- Revision of official yolov7-pose to support custom dataset for keypoint detection☆11Nov 12, 2023Updated 2 years ago
- Image converter☆13Jun 18, 2026Updated last month
- ☆12May 16, 2024Updated 2 years ago
- ☆20Jul 16, 2026Updated 3 weeks ago
- KODI视频插件 for 新版6V电影(https://www.66s.cc/)☆10Aug 24, 2022Updated 3 years ago
- 基于官方提供的CosyVoice改造，整体交互适配CosyVoice2模型，开箱即用☆24Jun 15, 2025Updated last year
- OpenAI-compatible TTS API that unifies multiple backends with smart chunking for unlimited-length generation☆50Aug 3, 2026Updated last week
- Virtual machines for every use case on DigitalOcean • AdGet dependable uptime with 99.99% SLA, simple security tools, and predictable monthly pricing with DigitalOcean's virtual machines, called Droplets.
- GenPiCam - a RaspberryPi based camera that reimagines the world with GenAI.☆10Jun 28, 2023Updated 3 years ago
- MMLU-Pro eval results☆15Aug 21, 2025Updated 11 months ago
- Adapted iPerf3 iOS sample☆12Mar 15, 2017Updated 9 years ago
- 基于cnstd+cnocr作为基础，封装的一个ocr的web服务☆10Nov 21, 2021Updated 4 years ago
- Gantt Chart using echarts☆13Mar 31, 2021Updated 5 years ago
- plugin to process JavaScript and TypeScript code with `twoslash` and highlight it with `starry-night`☆23Aug 2, 2024Updated 2 years ago
- Unofficial One-click Version of LivePortrait, with Webcam Support☆24Jul 28, 2024Updated 2 years ago
- ☆15Nov 10, 2023Updated 2 years ago
- Repository for running LLMs efficiently on Mac silicon (M1, M2, M3). Features Jupyter notebook for Meta-Llama-3 setup using MLX framework…☆11May 4, 2024Updated 2 years ago
- Wordpress hosting with auto-scaling - Free Trial Offer • AdFully Managed hosting for WordPress and WooCommerce businesses that need reliable, auto-scalable performance. Cloudways SafeUpdates now available.
- Minimal engine to execute python code generated by LLMs, with a lot of customisation options.☆16Jan 13, 2025Updated last year
- Deploy Kubernetes Using OpenStack Ironic☆11Jul 27, 2017Updated 9 years ago
- Implementation of SoundtStream from the paper: "SoundStream: An End-to-End Neural Audio Codec"☆13Jan 27, 2025Updated last year
- A shell which could make a dmg image by using Mac OS install APP☆21Apr 5, 2017Updated 9 years ago
- ☆15Oct 8, 2023Updated 2 years ago
- kodexplorer4.40☆14Sep 2, 2020Updated 5 years ago
- SNDR Core Engine (Genesis) — vLLM runtime patch-overlay for Qwen3.6 + Gemma4 on consumer NVIDIA (Ampere sm_86, 2× A5000/3090). Qwen3.6-35…☆132Updated this week
- nas场景使用的vnc镜像，安装了百度云，迅雷，网易云音乐等软件，也可按同样的思路，扩展一个线上的轻办工/开发环境。☆15Mar 7, 2021Updated 5 years ago
- niRvana-Theme 的 typecho 移植版☆18Jul 12, 2026Updated last month
- Serverless GPU API endpoints on Runpod - Get Bonus Credits • AdSkip the infrastructure headaches. Auto-scaling, pay-as-you-go, no-ops approach lets you focus on innovating your application.
- Minimal Jekyll theme for storytellers☆14Mar 8, 2024Updated 2 years ago
- Source code for Truth-Aware Context Selection: Mitigating the Hallucinations of Large Language Models Being Misled by Untruthful Contexts☆17Sep 2, 2024Updated last year
- Generate graphviz dot files from InfiniBand topology dumps.☆17Feb 11, 2024Updated 2 years ago
- vLLM fork for Tesla V100 (SM70) with AWQ 4-bit support, CUDA 12.8 build flow, and validated Qwen3.5 27B/35B deployment on multi-GPU V…☆604Updated this week
- WGE (Web Graphics Engine) 是一个web平台下的图形引擎。主要使用webgl实现，同时编写html5-2d兼容版本☆15Jun 13, 2023Updated 3 years ago
- 一个基于 Golang 开发的 AV 刮削工具。☆17Jul 9, 2022Updated 4 years ago
- 一个可视化Python环境管理工具☆34May 27, 2025Updated last year