autoscriptlabs / nccl-mesh-pluginLinks
☆75Updated last week
Alternatives and similar repositories for nccl-mesh-plugin
Users that are interested in nccl-mesh-plugin are comparing it to the libraries listed below
Sorting:
- 33B Chinese LLM, DPO QLORA, 100K context, AirLLM 70B inference with single 4GB GPU☆13Updated last year
- Run multiple resource-heavy Large Models (LM) on the same machine with limited amount of VRAM/other resources by exposing them on differe…☆88Updated this week
- Enhancing LLMs with LoRA☆206Updated 3 months ago
- ☆62Updated 6 months ago
- Generate a llama-quantize command to copy the quantization parameters of any GGUF☆28Updated last week
- Pivotal Token Search☆144Updated last month
- The DPAB-α Benchmark☆32Updated last year
- Smart proxy for LLM APIs that enables model-specific parameter control, automatic mode switching (like Qwen3's /think and /no_think), and…☆50Updated 8 months ago
- ☆64Updated 7 months ago
- High-performance FlashAttention-2 for AMD, Intel, and Apple GPUs. Drop-in replacement for PyTorch SDPA. Triton backend for ROCm (MI300X, …☆140Updated last month
- A TTS model capable of generating ultra-realistic dialogue in one pass.☆31Updated 9 months ago
- fully local, temporally aware natural language file search on your pc! even without a GPU. find relevant files using natural language i…☆165Updated last month
- Wraps any OpenAI API interface as Responses with MCPs support so it supports Codex. Adding any missing stateful features. Ollama and Vllm…☆146Updated 2 months ago
- InferX: Inference as a Service Platform☆151Updated last week
- LLM powered drawio live editor☆50Updated last month
- Running Microsoft's BitNet via Electron, React & Astro☆51Updated 4 months ago
- Chat WebUI is an easy-to-use user interface for interacting with AI, and it comes with multiple useful built-in tools such as web search …☆48Updated 5 months ago
- A python package for serving LLM on OpenAI-compatible API endpoints with prompt caching using MLX.☆100Updated 7 months ago
- Yet Another (LLM) Web UI, made with Gemini☆12Updated last year
- ☆51Updated 4 months ago
- A cli app for experimenting with kokoro voice creating and mixing using the available voices to interpolate new ones☆36Updated 11 months ago
- ☆109Updated 7 months ago
- Digital Red Queen: Adversarial Program Evolution in Core War with LLMs☆173Updated 2 weeks ago
- No-messing-around sh client for llama.cpp's server☆30Updated last year
- ☆439Updated last month
- Local Qwen3 LLM inference. One easy-to-understand file of C source with no dependencies.☆156Updated 6 months ago
- Editor with LLM generation tree exploration☆82Updated 11 months ago
- Aggregates compute from spare GPU capacity☆189Updated this week
- The most feature-complete local AI workstation. Multi-GPU inference, integrated Stable Diffusion + ADetailer, voice cloning, research-gra…☆52Updated this week
- Sparse Inferencing for transformer based LLMs☆218Updated 5 months ago