LLM Inference API in Rust. It also has a streamlit app that requests the running API in Rust.
☆20Sep 24, 2023Updated 2 years ago
Alternatives and similar repositories for LLM-Inference-API-in-Rust
Users that are interested in LLM-Inference-API-in-Rust are comparing it to the libraries listed below
Sorting:
- Chat with Your Data App using Langchain, ChromaDB, Sentence Transformers, and LaMiNi LM Model. This Chatbot is completely powered by Open…☆17Jun 26, 2023Updated 2 years ago
- A SaaS Startup using Generative AI. This is a code bug fixer SaaS built using Azure OpenAI, Stripe, SQLite, and web technologies.☆16Sep 22, 2023Updated 2 years ago
- Get Started with Qdrant Vector DB. From Setup to First RAG Implementation using Qdrant.☆27Oct 14, 2023Updated 2 years ago
- A simple llm bot that act as an assistant☆28Sep 6, 2024Updated last year
- A simple Sentiment Analysis API in FastAPI.☆15Dec 17, 2024Updated last year
- ☆17Sep 1, 2024Updated last year
- 《商业数据分析》的授课课件（包含作业）☆14Sep 20, 2025Updated 5 months ago
- ☆13Apr 27, 2021Updated 4 years ago
- This repository contains the registries for components, agents and services, the second part of the autonolas-v1 protocol.☆15Updated this week
- An LLM-powered (CodeLlama or OpenAI) local diff code review tool.☆41Jul 18, 2024Updated last year
- マキノJ3シリーズにFANUC FOCASライブラリを使って通信するPythonのサンプルです。☆15Mar 29, 2019Updated 6 years ago
- A Rust implementation of Yolo for object detection and tracking.☆10Nov 17, 2022Updated 3 years ago
- For engineers seeking a fast, memory-efficient database, Rapto provides transposition-heuristic storage, low memory footprint and high-pe…☆22Oct 10, 2025Updated 4 months ago
- Docker image build for backtrader running on Jupyter Notebook / Anaconda 3 / Python 3☆13Oct 22, 2020Updated 5 years ago
- Concurrent data extraction from unstructured text and images using AI models.☆18Aug 10, 2025Updated 6 months ago
- Designed to help lawyers and legal professionals find precedent fast and prepare for case negotiations by simulating trajectories☆10Oct 16, 2024Updated last year
- An Awesome, Feature Rich Discord Bot for Hosting and Managing CTF Challenges on Discord Written in Python3☆11Jun 29, 2024Updated last year
- A Google Apps - Clickup API Integeration☆10Jul 25, 2020Updated 5 years ago
- Kait's Site☆14Sep 7, 2021Updated 4 years ago
- A simple interpreter☆19Nov 13, 2018Updated 7 years ago
- ☆11Mar 28, 2025Updated 11 months ago
- The repository provides code for the paper RECE: Reduced Cross-Entropy Loss for Large-Catalogue Sequential Recommenders, CIKM'24☆11Oct 21, 2024Updated last year
- Ask AI to test your website with a specific goal☆15Dec 22, 2023Updated 2 years ago
- ☆11Jan 24, 2023Updated 3 years ago
- A platform aimed at creating websites that perform self-optimization☆12May 4, 2024Updated last year
- A flexible data structure for multi-input multi-output models☆10Oct 12, 2021Updated 4 years ago
- Collection of Jupyter notebooks☆12Jan 9, 2022Updated 4 years ago
- This is a large language model chat client built with Rust and Slint GUI, compatible with OpenAI's API.（这是一个基于Rust和Slint GUI构建的大语言模型聊天客户端…☆14Jan 10, 2026Updated last month
- An autonomous Mall assistant that can answer user queries using tools. Powered by LLMs.☆14Nov 5, 2023Updated 2 years ago
- 中文错别字纠正工具。音似、形似错字（或变体字）纠正，可用于中文拼音、笔画输入法的错误纠正。python开发。☆10Mar 5, 2018Updated 7 years ago
- Python3 update to Klipper☆10Jan 20, 2022Updated 4 years ago
- chat-history☆19Nov 12, 2025Updated 3 months ago
- ☆14Apr 20, 2024Updated last year
- An implementation of an augmented red-black tree in Zig with 3 layers of abstraction☆12Aug 27, 2025Updated 6 months ago
- Asynchronous Python client for the Syncthing REST API☆10Jan 19, 2026Updated last month
- 🤖 A list of latest AGI-related repos, resources and courses including LLMs and AI Agents.☆13Sep 24, 2024Updated last year
- ☆12Sep 11, 2024Updated last year
- A shell script to setup an AWS EC2 instance that can be used to deploy a FastAPI application using Ngrok☆10Feb 7, 2023Updated 3 years ago
- Rate limits extension for the Robyn framework☆11Oct 1, 2025Updated 5 months ago