LLM Inference API in Rust. It also has a streamlit app that requests the running API in Rust.
☆21Sep 24, 2023Updated 2 years ago
Alternatives and similar repositories for LLM-Inference-API-in-Rust
Users that are interested in LLM-Inference-API-in-Rust are comparing it to the libraries listed below. We may earn a commission when you buy through links labeled 'Ad' on this page.
Sorting:
- Get Started with Qdrant Vector DB. From Setup to First RAG Implementation using Qdrant.☆28Oct 14, 2023Updated 2 years ago
- A SaaS Startup using Generative AI. This is a code bug fixer SaaS built using Azure OpenAI, Stripe, SQLite, and web technologies.☆15Sep 22, 2023Updated 2 years ago
- Faster Stable Diffusion using SSD-1B. A gradio app inside for demo.☆15Oct 26, 2023Updated 2 years ago
- Chat with Your Data App using Langchain, ChromaDB, Sentence Transformers, and LaMiNi LM Model. This Chatbot is completely powered by Open…☆16Jun 26, 2023Updated 3 years ago
- A simple Sentiment Analysis API in FastAPI.☆14Dec 17, 2024Updated last year
- GPU virtual machines on DigitalOcean Gradient AI • AdGet to production fast with high-performance AMD and NVIDIA GPUs you can spin up in seconds. The definition of operational simplicity.
- ☆10Aug 31, 2023Updated 2 years ago
- This is "Your Private StackOverflow" app that helps you perform generative search in your code bases. This is built using open-source sta…☆11Aug 14, 2023Updated 2 years ago
- ☆13Jul 15, 2023Updated 3 years ago
- Example of ML app using Streamlit.☆18Sep 17, 2024Updated last year
- Simple Live Face Recognition Streamlit App☆32Oct 21, 2025Updated 8 months ago
- ☆25Jun 24, 2023Updated 3 years ago
- This is a QA bot based on Code Llama. It is a new LLM for code by Meta AI.☆12Aug 25, 2023Updated 2 years ago
- ☆13Apr 20, 2023Updated 3 years ago
- ☆14Feb 8, 2024Updated 2 years ago
- Managed hosting for WordPress and PHP on Cloudways • AdManaged hosting for WordPress, Magento, Laravel, or PHP apps, on multiple cloud providers. Deploy in minutes on Cloudways by DigitalOcean.
- Text to Music Generation App built using Meta's Audiocraft library. It is a Streamlit application utilises Music Gen small model.☆25Aug 12, 2023Updated 2 years ago
- ☆18Feb 3, 2021Updated 5 years ago
- ☆16Jan 8, 2023Updated 3 years ago
- A Streamlit application that summarizes documents using LaMini-LM.☆18Jun 4, 2023Updated 3 years ago
- A source generator that generates partial helper classes where member properties are attributed with ProtoMember attribute.☆14Jul 14, 2026Updated last week
- A generator for golang alfred workflow that helps you create boilerplate code.☆13Jun 26, 2024Updated 2 years ago
- Node, Express and MongoDB fullstack application☆15Dec 12, 2022Updated 3 years ago
- A simple llm bot that act as an assistant☆28Sep 6, 2024Updated last year
- An HTML5 Real Time Clock based on WebSocket☆12Mar 23, 2017Updated 9 years ago
- 1-Click AI Models by DigitalOcean Gradient • AdDeploy popular AI models on DigitalOcean Gradient GPU virtual machines with just a single click. Zero configuration with optimized deployments.
- ☆17Dec 1, 2024Updated last year
- ☆27May 25, 2022Updated 4 years ago
- ☆15Nov 1, 2023Updated 2 years ago
- A simple microservice which exposes elastic search☆10Jun 1, 2018Updated 8 years ago
- ☆20Feb 19, 2021Updated 5 years ago
- ☆21Oct 17, 2020Updated 5 years ago
- Docker image build for backtrader running on Jupyter Notebook / Anaconda 3 / Python 3☆13Oct 22, 2020Updated 5 years ago
- ☆18Jan 5, 2023Updated 3 years ago
- 基于bpmn 2.0协议实现的工作流引擎☆12Jan 17, 2024Updated 2 years ago
- Deploy on Railway without the complexity - Free Credits Offer • AdConnect your repo and Railway handles the rest with instant previews. Quickly provision container image services, databases, and storage volumes.
- Training Small Language Model☆29Dec 26, 2023Updated 2 years ago
- An MCP server that aggregates real-time cryptocurrency news from multiple RSS feeds.☆17Jul 24, 2025Updated 11 months ago
- ☆19Aug 25, 2024Updated last year
- Build & Download 2700+ popular brands Badge, SVG, Hex & so on to use in GitHub Markdown or Any Web Pages wth fast, reliable with amazing …☆15Nov 25, 2023Updated 2 years ago
- Looks up command line syntax from cheatsheets using fuzzy search☆16May 27, 2026Updated last month
- YouTube Video Summarization App built using open source LLM and Framework like Llama 2, Haystack, Whisper, and Streamlit. This app smooth…☆58May 7, 2024Updated 2 years ago
- Command Line Interface for OpenAI's GPT☆12Feb 13, 2026Updated 5 months ago