LLM Inference API in Rust. It also has a streamlit app that requests the running API in Rust.
☆21Sep 24, 2023Updated 2 years ago
Alternatives and similar repositories for LLM-Inference-API-in-Rust
Users that are interested in LLM-Inference-API-in-Rust are comparing it to the libraries listed below. We may earn a commission when you buy through links labeled 'Ad' on this page.
Sorting:
- Get Started with Qdrant Vector DB. From Setup to First RAG Implementation using Qdrant.☆29Oct 14, 2023Updated 2 years ago
- A SaaS Startup using Generative AI. This is a code bug fixer SaaS built using Azure OpenAI, Stripe, SQLite, and web technologies.☆16Sep 22, 2023Updated 2 years ago
- Faster Stable Diffusion using SSD-1B. A gradio app inside for demo.☆15Oct 26, 2023Updated 2 years ago
- Chat with Your Data App using Langchain, ChromaDB, Sentence Transformers, and LaMiNi LM Model. This Chatbot is completely powered by Open…☆16Jun 26, 2023Updated 3 years ago
- A simple Sentiment Analysis API in FastAPI.☆14Dec 17, 2024Updated last year
- End-to-end encrypted cloud storage - Proton Drive • AdSpecial offer: 40% Off Yearly / 80% Off First Month. Protect your most important files, photos, and documents from prying eyes.
- ☆11Jan 24, 2023Updated 3 years ago
- ☆14Jul 18, 2021Updated 5 years ago
- This is "Your Private StackOverflow" app that helps you perform generative search in your code bases. This is built using open-source sta…☆11Aug 14, 2023Updated 3 years ago
- Example of ML app using Streamlit.☆18Sep 17, 2024Updated last year
- ☆26Jun 24, 2023Updated 3 years ago
- ☆13Apr 11, 2022Updated 4 years ago
- Text to Music Generation App built using Meta's Audiocraft library. It is a Streamlit application utilises Music Gen small model.☆25Aug 12, 2023Updated 3 years ago
- Free AI Youtube Summarizer on your computer using mistral-instruct-v0.2, langchain and llama_index☆20Dec 19, 2023Updated 2 years ago
- A Streamlit application that summarizes documents using LaMini-LM.☆18Jun 4, 2023Updated 3 years ago
- AI Agents on DigitalOcean Gradient AI Platform • AdBuild production-ready AI agents using customizable tools or access multiple LLMs through a single endpoint. Create custom knowledge bases or connect external data.
- A generator for golang alfred workflow that helps you create boilerplate code.☆13Jun 26, 2024Updated 2 years ago
- An HTML5 Real Time Clock based on WebSocket☆12Mar 23, 2017Updated 9 years ago
- ☆27May 25, 2022Updated 4 years ago
- ☆12Mar 31, 2017Updated 9 years ago
- ☆26Jun 11, 2020Updated 6 years ago
- ☆21Oct 17, 2020Updated 5 years ago
- Docker image build for backtrader running on Jupyter Notebook / Anaconda 3 / Python 3☆13Oct 22, 2020Updated 5 years ago
- ☆18Jan 5, 2023Updated 3 years ago
- ☆19Aug 25, 2024Updated 2 years ago
- Virtual machines for every use case on DigitalOcean • AdGet dependable uptime with 99.99% SLA, simple security tools, and predictable monthly pricing with DigitalOcean's virtual machines, called Droplets.
- Command Line Interface for OpenAI's GPT☆12Feb 13, 2026Updated 6 months ago
- YouTube Video Summarization App built using open source LLM and Framework like Llama 2, Haystack, Whisper, and Streamlit. This app smooth…☆58May 7, 2024Updated 2 years ago
- Asynchronous Python client for the Syncthing REST API☆10Jan 19, 2026Updated 7 months ago
- A terminal user interface for searching google☆11Mar 19, 2022Updated 4 years ago
- Context Sherpa MCP server provides code mapping, deterministic feedback loops, and tiered inference for AI coding agents to increase accu…☆27Mar 26, 2026Updated 5 months ago
- Python SDK and CLI utility for searchcode.com.☆10Jun 20, 2026Updated 2 months ago
- Deploy a Streamlit app to train, evaluate and optimize a Prophet forecasting model visually.☆46Feb 1, 2024Updated 2 years ago
- fanuc mtconnect adapter☆12Jan 22, 2016Updated 10 years ago
- Rust bindings to simple, a SQLite3 fts5 tokenizer which supports Chinese and PinYin.☆13Mar 15, 2026Updated 5 months ago
- Deploy on Railway without the complexity - Free Credits Offer • AdConnect your repo and Railway handles the rest with instant previews. Quickly provision container image services, databases, and storage volumes.
- Cookiecutter for community-maintained Jupyter Docker images☆18Aug 3, 2026Updated 3 weeks ago
- A tool for you to load natvie module in your vm like otto and goja☆18Oct 27, 2017Updated 8 years ago
- beego study lesson☆12Apr 14, 2018Updated 8 years ago
- Framework to evaluate LLM generated ReactJS code.☆59Mar 25, 2024Updated 2 years ago
- Python server to communicate with Blockly@rduino : supervision of Arduino pin, upload to Arduino card, transfer code to IDE Arduino.☆10Apr 1, 2020Updated 6 years ago
- Python3 update to Klipper☆10Jan 20, 2022Updated 4 years ago
- Authentication and CORS helper for Python cloud functions☆11Jun 12, 2019Updated 7 years ago