Inference service built in Rust for deploying Large Language Models
☆59Jan 22, 2025Updated last year
Alternatives and similar repositories for rust-inference-service
Users that are interested in rust-inference-service are comparing it to the libraries listed below. We may earn a commission when you buy through links labeled 'Ad' on this page.
Sorting:
- A distributed multi-modal agent orchestration framework implementing advanced natural language processing, computer vision, and audio pro…☆57Jan 19, 2025Updated last year
- Megatron's multi-modal data loader☆53Jan 17, 2025Updated last year
- An enterprise-grade implementation of multi-agent systems using OllamaJS, featuring advanced orchestration, dynamic agent allocation, and…☆57Jan 19, 2025Updated last year
- A high-performance framework for reinforcement learning research utilizing NVIDIA's Isaac Gym physics simulation engine.☆53Jan 18, 2025Updated last year
- Decentralized adapter registry for AI agent-tool interfacing☆63Jun 15, 2025Updated last year
- Managed Kubernetes at scale on DigitalOcean • AdDigitalOcean Kubernetes includes the control plane, bandwidth allowance, container registry, automatic updates, and more for free.
- A project demonstrating Lidar related AI solutions, including three GPU accelerated Lidar/camera DL networks (PointPillars, CenterPoint, …☆54Dec 3, 2024Updated last year
- Build multi-modal Agents with memory, knowledge, tools and reasoning. Chat with them using a beautiful Agent UI.☆53Jan 19, 2025Updated last year
- A flexible, high-performance 3D simulator for Embodied AI research.☆53Jan 17, 2025Updated last year
- A Chrome extension to download YouTube videos in 4K, convert to MP3, and save YouTube Shorts. https://tubly.download☆374Jul 16, 2026Updated 3 weeks ago
- Automate farming grass getgrass.io with our auto bot! 🚀 Farm supports multi-account, full automation, and an intuitive interface. Perfec …☆54Apr 22, 2025Updated last year
- BBullet - A Raydium & pump.fun bundler.☆85May 23, 2025Updated last year
- ☆18Apr 15, 2025Updated last year
- AI-Powered Development Workflow Orchestration☆60Jun 24, 2025Updated last year
- A powerful Go framework for building production-ready AI agents!☆587Jul 27, 2026Updated last week
- Managed hosting for WordPress and PHP on Cloudways • AdManaged hosting for WordPress, Magento, Laravel, or PHP apps, on multiple cloud providers. Deploy in minutes on Cloudways by DigitalOcean.
- TSGram - Telegram MCP Server for local Claude Code integration - debug and vibe code on the go!☆92Jun 26, 2025Updated last year
- ☆19Dec 4, 2025Updated 8 months ago
- Social Media Native Headers☆95Jul 21, 2026Updated 2 weeks ago
- ☆144Nov 26, 2025Updated 8 months ago
- ☆136Dec 7, 2024Updated last year
- Achieve peak efficiency farming x3 Grass Points on GetGrass.io. Perfect for DePIN participants, crypto airdrop hunters, and anyone chasin…☆81Jun 22, 2025Updated last year
- RUSocial OFM / Fame Panel☆152Jul 21, 2026Updated 2 weeks ago
- Examples of programs built using Modal☆152Jan 20, 2024Updated 2 years ago
- BitDive Model Context Protocol (MCP) server. The Autonomous Quality Loop for AI agents. Provides real runtime context, before/after trace…☆77May 30, 2026Updated 2 months ago
- Bare Metal GPUs on DigitalOcean Gradient AI • AdPurpose-built for serious AI teams training foundational models, running large-scale inference, and pushing the boundaries of what's possible.
- Mock-free JUnit integration testing for Java & Spring Boot. Close the verification gap by turning captured runtime traces into determinis…☆70Nov 5, 2025Updated 9 months ago
- ☆144Aug 27, 2023Updated 2 years ago
- (NeurIPS 2020 Spotlight) Wasserstein Distances for Stereo Disparity Estimation☆236Apr 13, 2022Updated 4 years ago
- Python examples for the Robbie.run service☆162Mar 27, 2025Updated last year
- This is an open-source version of the representation engineering framework for stopping harmful outputs or hallucinations on the level of…☆344Updated this week
- Rust/Axum server implementation with PCR(Prisma Client Rust)☆39Jul 28, 2025Updated last year
- (NeurIPS '21 Spotlight) IQ-Learn: Inverse Q-Learning for Imitation☆377Nov 28, 2022Updated 3 years ago
- Run a cloud exit assessment on your infrastructure to understand the challenges and constraints of a potential exit, and take a concrete …☆156Updated this week
- Xcode colourscheme for neovim☆16Feb 9, 2026Updated 6 months ago
- Simple, predictable pricing with DigitalOcean hosting • AdAlways know what you'll pay with monthly caps and flat pricing. Enterprise-grade infrastructure trusted by 600k+ customers.
- Build your Swarm of Internet Agents using MultiOn 🚀☆199Dec 28, 2023Updated 2 years ago
- AGI SDK☆434Dec 5, 2025Updated 8 months ago
- Automate farming nodego.ai with our auto bot! 🚀 Farm supports multi-account, full automation, and an intuitive interface. Perfect for mi…☆14Apr 22, 2025Updated last year
- Firefox add-on to download YouTube videos and Shorts, and convert to MP3 in one click.☆66Jan 29, 2026Updated 6 months ago
- ✅ ESLint plugin to enforce the JavaScript Baseline.☆229Aug 1, 2026Updated last week
- #1 Free IP Stresser / IP Booter V6 - Ultimate Network Stress Testing tool Made by https://ipstresser.pro/ for educational network stress …☆142Feb 25, 2026Updated 5 months ago
- Automate farming nodepay.ai with our auto bot! 🚀 Farm supports multi-account, full automation, and an intuitive interface. Perfect for m…☆12Apr 22, 2025Updated last year