LLM Inference API in Rust. It also has a streamlit app that requests the running API in Rust.
☆20Sep 24, 2023Updated 2 years ago
Alternatives and similar repositories for LLM-Inference-API-in-Rust
Users that are interested in LLM-Inference-API-in-Rust are comparing it to the libraries listed below
Sorting:
- A SaaS Startup using Generative AI. This is a code bug fixer SaaS built using Azure OpenAI, Stripe, SQLite, and web technologies.☆16Sep 22, 2023Updated 2 years ago
- Faster Stable Diffusion using SSD-1B. A gradio app inside for demo.☆15Oct 26, 2023Updated 2 years ago
- A simple Sentiment Analysis API in FastAPI.☆14Dec 17, 2024Updated last year
- ☆16Feb 18, 2024Updated 2 years ago
- ☆11Jan 24, 2023Updated 3 years ago
- This is "Your Private StackOverflow" app that helps you perform generative search in your code bases. This is built using open-source sta…☆11Aug 14, 2023Updated 2 years ago
- ☆14Apr 20, 2023Updated 2 years ago
- ☆13Jul 15, 2023Updated 2 years ago
- ☆25Jun 24, 2023Updated 2 years ago
- This is a QA bot based on Code Llama. It is a new LLM for code by Meta AI.☆13Aug 25, 2023Updated 2 years ago
- This is the official repo of Text Summarizer Streamlit App video from AI Anytime YouTube channel.☆16Mar 21, 2024Updated 2 years ago
- ☆12Apr 11, 2022Updated 3 years ago
- RL agent using private and shared world models☆11Jun 12, 2023Updated 2 years ago
- ☆16Jan 8, 2023Updated 3 years ago
- 📚 Build knowledge bases for RAG☆32Jul 3, 2025Updated 8 months ago
- Lightweight dockerized SMB server exposed to Tailscale for sharing folders with friends☆11May 28, 2022Updated 3 years ago
- ☆19Nov 27, 2023Updated 2 years ago
- ☆19Aug 25, 2024Updated last year
- ☆21Oct 17, 2020Updated 5 years ago
- A Streamlit application that summarizes documents using LaMini-LM.☆18Jun 4, 2023Updated 2 years ago
- Code for "Are “Hierarchical” Visual Representations Hierarchical?" in NeurIPS Workshop for Symmetry and Geometry in Neural Representation…☆22Nov 8, 2023Updated 2 years ago
- Shugok-AI is a Streamlit-based web application that makes AI research papers from arXiv more accessible by simplifying their academic lan…☆28Dec 20, 2024Updated last year
- ☆12Mar 31, 2017Updated 8 years ago
- Docker image build for backtrader running on Jupyter Notebook / Anaconda 3 / Python 3☆13Oct 22, 2020Updated 5 years ago
- ☆18Jan 5, 2023Updated 3 years ago
- ☆20Feb 19, 2021Updated 5 years ago
- tsellm: LLMs in SQLite and DuckDB☆25Apr 21, 2025Updated 11 months ago
- Training Small Language Model☆28Dec 26, 2023Updated 2 years ago
- Looks up command line syntax from cheatsheets using fuzzy search☆16Feb 20, 2026Updated last month
- A lightweight, cryptographically-authenticated UDP daemon for remote access, logging, and job control.☆24Mar 7, 2026Updated 2 weeks ago
- Asynchronous Python client for the Syncthing REST API☆10Jan 19, 2026Updated 2 months ago
- Rust bindings to simple, a SQLite3 fts5 tokenizer which supports Chinese and PinYin.☆13Mar 15, 2026Updated last week
- Rate limits extension for the Robyn framework☆11Oct 1, 2025Updated 5 months ago
- ☆23Feb 27, 2024Updated 2 years ago
- ☆14Jun 20, 2023Updated 2 years ago
- Trivial CLI wrapper around go.crypto/nacl/box. Easy secure public key authenticated encryption.☆14Feb 14, 2017Updated 9 years ago
- Web scraping API for building AI applications.☆40Jan 24, 2024Updated 2 years ago
- AES GCM : Authenticated Encryption with Associated Data (AEAD) algorithm in Go language☆11Jan 5, 2016Updated 10 years ago
- Repo2GPT is a Python application that clones a GitHub repository and generates a tree diagram of the repository's file structure and a co…☆10Nov 21, 2025Updated 4 months ago