ModelCloud / Device-SMI
Self-contained Python lib with zero-dependencies that give you a unified device properties for gpu, cpu, and npu. No more calling separate tools such as nvidia-smi or /proc/cpuinfo and parsing it yourself.
☆10Updated last month
Alternatives and similar repositories for Device-SMI:
Users that are interested in Device-SMI are comparing it to the libraries listed below
- Video+code lecture on building nanoGPT from scratch☆66Updated 9 months ago
- an open source reproduction of NVIDIA's nGPT (Normalized Transformer with Representation Learning on the Hypersphere)☆91Updated 3 weeks ago
- Tcurtsni: Reverse Instruction Chat, ever wonder what your LLM wants to ask you?☆21Updated 9 months ago
- Open TTS models, built for streaming on the edge☆39Updated 2 weeks ago
- An unsupervised model merging algorithm for Transformers-based language models.☆104Updated 11 months ago
- Collection of Open Source Speech Data☆152Updated 4 months ago
- ☆62Updated 8 months ago
- Google TPU optimizations for transformers models☆104Updated 2 months ago
- Model REVOLVER, a human in the loop model mixing system.☆33Updated last year
- ☆16Updated 4 months ago
- a simplified version of Google's Gemma model to be used for learning☆24Updated last year
- ☆112Updated 6 months ago
- An open source real-time AI inference engine for seamless scaling☆17Updated 2 weeks ago
- A high-throughput and memory-efficient inference and serving engine for LLMs☆28Updated last year
- Notebook and Scripts that showcase running quantized diffusion models on consumer GPUs☆38Updated 5 months ago
- GPT-4 Level Conversational QA Trained In a Few Hours☆59Updated 7 months ago
- ☆84Updated this week
- Lightweight continuous batching OpenAI compatibility using HuggingFace Transformers include T5 and Whisper.☆20Updated 2 weeks ago
- The simplest, fastest repository for training/finetuning medium-sized xLSTMs.☆42Updated 10 months ago
- LLMVoX: Autoregressive Streaming Text-to-Speech Model for Any LLM☆224Updated 2 weeks ago
- Lego for GRPO☆25Updated 2 weeks ago
- ☆104Updated this week
- Maya: An Instruction Finetuned Multilingual Multimodal Model using Aya☆107Updated last month
- ☆27Updated last year
- Deploy your GGML models to HuggingFace Spaces with Docker and gradio☆36Updated last year
- Public reports detailing responses to sets of prompts by Large Language Models.☆30Updated 3 months ago
- VoiceBox neural network implementation☆105Updated 8 months ago
- Scripts to create your own moe models using mlx☆89Updated last year
- A collection of optimizers for MLX☆34Updated 2 weeks ago
- ☆45Updated last month