Running a 30B MoE LLM on CPU at 30-50+ tok/s with a 256K Context Window via Hybrid Mamba-2 SSM, L3 NTA Slicing, AVX-512 VNNI Tile Repacking & 2MB HugePages
☆61Oct 31, 2026Updated this week
Alternatives and similar repositories for nemotron-30b-cpu-256k
Users that are interested in nemotron-30b-cpu-256k are comparing it to the libraries listed below. We may earn a commission when you buy through links labeled 'Ad' on this page.
Sorting:
- A Free Minimal Landing Template.☆11Aug 26, 2024Updated 2 years ago
- A stupid easy distributed actor system in rust☆15Updated this week
- Kubernetes-native runtime for persistent, collaborative AI agents.☆18Updated this week
- My blog made with love and https://github.com/darul75/web-react☆12Dec 11, 2022Updated 3 years ago
- 🌊 water super app☆18Updated this week
- Deploy to Railway using AI coding agents - Free Credits Offer • AdUse Claude Code, Codex, OpenCode, and more. Autonomous software development now has the infrastructure to match with Railway.
- ☆16Oct 3, 2022Updated 4 years ago
- Crow: build your second brain from the documents on your computer. Downloads for macOS, Windows and Linux.☆18Updated this week
- Claude Code mod: rotates between your Claude logins as their usage limits fill☆17Oct 16, 2026Updated 2 weeks ago
- CLI/API for Google Flights using Selenium☆10Feb 8, 2021Updated 5 years ago
- Docker unix-socket proxy to provide unharmful, read-only API calls☆15Mar 10, 2018Updated 8 years ago
- Kafka Streams for Scala with ZIO☆14Jul 21, 2021Updated 5 years ago
- Yapily’s OpenAPI Specification. Use this complete definition of our API to generate client libraries in the language of your choice.☆15Sep 18, 2026Updated last month
- This repo contains re-implementations of guitar musical games☆42Updated this week
- Your phone, on your command. Gotcha is world's first fully on-device AI copilot for Android that turns natural language into real device …☆22Updated this week
- AI Agents on DigitalOcean Gradient AI Platform • AdBuild production-ready AI agents using customizable tools or access multiple LLMs through a single endpoint. Create custom knowledge bases or connect external data.
- Time series values aggregation in redis using redis modules api☆47Nov 29, 2016Updated 9 years ago
- ☆11Jun 3, 2025Updated last year
- Cross Platform simple and secure password management from commandline.☆16Sep 23, 2019Updated 7 years ago
- The frontend service for GOV.UK Verify☆20Dec 8, 2023Updated 2 years ago
- EOS Extension to alert and change configuration based on host(s) ICMP reachability☆11Nov 6, 2025Updated 11 months ago
- Template for V Repos☆16Aug 18, 2020Updated 6 years ago
- ☆15Jun 25, 2026Updated 4 months ago
- SideFX Houdini MCP adapter for AI agents to inspect scenes, author procedural node graphs, and automate geometry, animation and rendering…☆19Updated this week
- additional "s3" protocol for apt so you can host your giant apt repository in s3 on the cheap!☆20Jul 23, 2014Updated 12 years ago
- Managed Database hosting by DigitalOcean • AdPostgreSQL, MySQL, MongoDB, Kafka, Valkey, and OpenSearch available. Automatically scale up storage and focus on building your apps.
- WFM Frontend: UI translation files☆14Oct 24, 2026Updated last week
- ESBuild Plugin to bundle Scala.js module☆16Dec 10, 2024Updated last year
- OpenVPN with Terraform and Ansible on AWS☆21Apr 30, 2021Updated 5 years ago
- Modern C++, Linux systems programming, concurrency, networking, performance engineering, and low level architecture explorations.☆22Oct 13, 2026Updated 2 weeks ago
- Security-First Agentic IDE Coding Harness☆26Updated this week
- JCS (JSON Canonicalization Scheme), JSON digests, and JSON Merkle hashes☆15Mar 10, 2024Updated 2 years ago
- LLMinster is a powerful and extensible client designed to streamline your interactions with Large Language Models (LLMs), like ChatGPT, G…☆17Dec 9, 2024Updated last year
- Commodore 64 knowledge base for AI-assisted development — Qdrant vector search + FalkorDB knowledge graph, served over MCP☆26Oct 7, 2026Updated 3 weeks ago
- Automated Twitch highlight videos. Clip filter and download, video assembly, thumbnail creation, and upload. Currently in use for all Puf…☆18Dec 13, 2022Updated 3 years ago
- Deploy to Railway using AI coding agents - Free Credits Offer • AdUse Claude Code, Codex, OpenCode, and more. Autonomous software development now has the infrastructure to match with Railway.
- Simple study repo for tiny GPT-like model training (not a complete, functional model, for education only)☆33Oct 14, 2026Updated 2 weeks ago
- Packer Template to build a AWS OpenVPN AMI☆22Jan 3, 2022Updated 4 years ago
- Busca semântica e memória persistente para projetos Django (e qualquer projeto Python), integrado ao VSCode e Antigravity via protocolo M…☆14Mar 7, 2026Updated 7 months ago
- ☆20Jun 13, 2025Updated last year
- Simple proxy application for the Docker Remote API via sockets☆21Dec 29, 2015Updated 10 years ago
- A ZIO-based interface to Google Cloud API☆18Aug 6, 2024Updated 2 years ago
- Scala Interpreter / AOT Compiler written in Rust☆40Updated this week