LLM Inference API in Rust. It also has a streamlit app that requests the running API in Rust.
☆21Sep 24, 2023Updated 3 years ago
Alternatives and similar repositories for LLM-Inference-API-in-Rust
Users that are interested in LLM-Inference-API-in-Rust are comparing it to the libraries listed below. We may earn a commission when you buy through links labeled 'Ad' on this page.
Sorting:
- A simple Sentiment Analysis API in FastAPI.☆14Dec 17, 2024Updated last year
- A SaaS Startup using Generative AI. This is a code bug fixer SaaS built using Azure OpenAI, Stripe, SQLite, and web technologies.☆16Sep 22, 2023Updated 3 years ago
- Get Started with Qdrant Vector DB. From Setup to First RAG Implementation using Qdrant.☆29Oct 14, 2023Updated 3 years ago
- Faster Stable Diffusion using SSD-1B. A gradio app inside for demo.☆15Oct 26, 2023Updated 3 years ago
- Chat with Your Data App using Langchain, ChromaDB, Sentence Transformers, and LaMiNi LM Model. This Chatbot is completely powered by Open…☆16Jun 26, 2023Updated 3 years ago
- Deploy to Railway using AI coding agents - Free Credits Offer • AdUse Claude Code, Codex, OpenCode, and more. Autonomous software development now has the infrastructure to match with Railway.
- AI News Anchor Generator App built using Midjourney, D-ID, OpenAI, NewsAPI, and Streamlit.☆16Sep 18, 2023Updated 3 years ago
- Design to Website App using Generative AI. It is a streamlit application that uses OCR and LLM to generate code/website from design.☆20Aug 13, 2023Updated 3 years ago
- ☆14Jul 18, 2021Updated 5 years ago
- This is "Your Private StackOverflow" app that helps you perform generative search in your code bases. This is built using open-source sta…☆11Aug 14, 2023Updated 3 years ago
- ☆11Jan 24, 2023Updated 3 years ago
- ☆16Feb 18, 2024Updated 2 years ago
- ☆13Jul 15, 2023Updated 3 years ago
- ☆26Jun 24, 2023Updated 3 years ago
- An ACP (Agent Client Protocol) client for Nvim☆12Jun 24, 2026Updated 4 months ago
- AI Agents on DigitalOcean Gradient AI Platform • AdBuild production-ready AI agents using customizable tools or access multiple LLMs through a single endpoint. Create custom knowledge bases or connect external data.
- This is a QA bot based on Code Llama. It is a new LLM for code by Meta AI.☆12Aug 25, 2023Updated 3 years ago
- Free AI Youtube Summarizer on your computer using mistral-instruct-v0.2, langchain and llama_index☆20Dec 19, 2023Updated 2 years ago
- Text to Music Generation App built using Meta's Audiocraft library. It is a Streamlit application utilises Music Gen small model.☆25Aug 12, 2023Updated 3 years ago
- Configuration settings I use☆10Updated this week
- ☆14Feb 8, 2024Updated 2 years ago
- Simple pentesting demo using Grok☆13Apr 16, 2026Updated 7 months ago
- A docker container that runs Laravel Octane with Swoole.☆11Jun 17, 2021Updated 5 years ago
- ☆16Jan 8, 2023Updated 3 years ago
- ☆18Feb 3, 2021Updated 5 years ago
- Deploy to Railway using AI coding agents - Free Credits Offer • AdUse Claude Code, Codex, OpenCode, and more. Autonomous software development now has the infrastructure to match with Railway.
- A demo project to test Meta SDK Colocation Features☆14Nov 27, 2024Updated last year
- Run LLMs in the Browser with MLC / WebLLM ✨☆13Jan 22, 2025Updated last year
- Open Source Crypto Authentication USB Dongle☆23Oct 3, 2025Updated last year
- Deterministic AI Workflows with an AI programming language. (Writing Agents should be as easy as writing markdown!)☆12May 12, 2026Updated 6 months ago
- A cross-platform code editor that supports execution of multiple languages using the Piston API☆11Jun 8, 2024Updated 2 years ago
- RustFS NixOS☆15Updated this week
- A JavaScript to Rust compiler☆14Jan 16, 2021Updated 5 years ago
- ☆19Nov 27, 2023Updated 2 years ago
- Personal Typst note-taking system☆12Updated this week
- Managed hosting for WordPress and PHP on Cloudways • AdManaged hosting for WordPress, Magento, Laravel, or PHP apps, on multiple cloud providers. Deploy in minutes on Cloudways by DigitalOcean.
- An HTML5 Real Time Clock based on WebSocket☆12Mar 23, 2017Updated 9 years ago
- A hypervisor for declarative nerds; craft your homelab and take it anywhere.☆23Updated this week
- Logseq home page☆15Updated this week
- ☆21Oct 17, 2020Updated 6 years ago
- [mirror] 🐈⬛ | NeoVim Discord rich presence plugin☆13Feb 11, 2026Updated 9 months ago
- React webrtc server. Custom from https://github.com/oney/react-native-webrtc-server☆18Sep 19, 2017Updated 9 years ago
- A Vietnamese dataset of over 12 thousands questions about common disease symptoms. Perfect for researchers and developers building Vietna…☆18May 27, 2024Updated 2 years ago
Are these results useful?