LLM Inference API in Rust. It also has a streamlit app that requests the running API in Rust.
☆21Sep 24, 2023Updated 3 years ago
Alternatives and similar repositories for LLM-Inference-API-in-Rust
Users that are interested in LLM-Inference-API-in-Rust are comparing it to the libraries listed below. We may earn a commission when you buy through links labeled 'Ad' on this page.
Sorting:
- A SaaS Startup using Generative AI. This is a code bug fixer SaaS built using Azure OpenAI, Stripe, SQLite, and web technologies.☆16Sep 22, 2023Updated 3 years ago
- Faster Stable Diffusion using SSD-1B. A gradio app inside for demo.☆15Oct 26, 2023Updated 3 years ago
- AI News Anchor Generator App built using Midjourney, D-ID, OpenAI, NewsAPI, and Streamlit.☆16Sep 18, 2023Updated 3 years ago
- ☆11Jan 24, 2023Updated 3 years ago
- This is "Your Private StackOverflow" app that helps you perform generative search in your code bases. This is built using open-source sta…☆11Aug 14, 2023Updated 3 years ago
- AI Agents on DigitalOcean Gradient AI Platform • AdBuild production-ready AI agents using customizable tools or access multiple LLMs through a single endpoint. Create custom knowledge bases or connect external data.
- ☆26Jun 24, 2023Updated 3 years ago
- This is the official repo of Text Summarizer Streamlit App video from AI Anytime YouTube channel.☆15Mar 21, 2024Updated 2 years ago
- ☆13Apr 11, 2022Updated 4 years ago
- ☆13Feb 8, 2024Updated 2 years ago
- Free AI Youtube Summarizer on your computer using mistral-instruct-v0.2, langchain and llama_index☆20Dec 19, 2023Updated 2 years ago
- ☆19Nov 27, 2023Updated 2 years ago
- LibSodium.NET is a library that provides .NET bindings for libsodium☆11Jun 8, 2025Updated last year
- An HTML5 Real Time Clock based on WebSocket☆12Mar 23, 2017Updated 9 years ago
- ☆21Oct 17, 2020Updated 6 years ago
- Deploy to Railway using AI coding agents - Free Credits Offer • AdUse Claude Code, Codex, OpenCode, and more. Autonomous software development now has the infrastructure to match with Railway.
- ☆18Jan 5, 2023Updated 3 years ago
- Bot to verify and manage Memberships.☆11Aug 1, 2026Updated 2 months ago
- A terminal user interface for searching google☆11Mar 19, 2022Updated 4 years ago
- Customize the player loop from the settings window. One of the "j1Tech" series developed by jwellone Inc for Unity.☆12Sep 9, 2021Updated 5 years ago
- ☆22Oct 18, 2026Updated last week
- Training Small Language Model☆29Dec 26, 2023Updated 2 years ago
- Looks up command line syntax from cheatsheets using fuzzy search☆16May 27, 2026Updated 5 months ago
- Command Line Interface for OpenAI's GPT☆12Sep 16, 2026Updated last month
- ENERGY Designer is developed in Go and implemented via self-bootstrapping based on the ENERGY GUI framework, supporting Windows, macOS, a…☆14Jun 30, 2026Updated 4 months ago
- 1-Click AI Models by DigitalOcean Gradient • AdDeploy popular AI models on DigitalOcean Gradient GPU virtual machines with just a single click. Zero configuration with optimized deployments.
- Asynchronous Python client for the Syncthing REST API☆10Jan 19, 2026Updated 9 months ago
- LanceDB C# SDK☆17Jul 6, 2026Updated 3 months ago
- YouTube Video Summarization App built using open source LLM and Framework like Llama 2, Haystack, Whisper, and Streamlit. This app smooth…☆58May 7, 2024Updated 2 years ago
- A High-performance Server-side Rendering (SSR) Framework for Vue Apps, Powered by V8 and Golang.☆11Dec 31, 2025Updated 9 months ago
- 基于bpmn 2.0协议实现的工作流引擎☆12Jan 17, 2024Updated 2 years ago
- ☆27Jan 3, 2023Updated 3 years ago
- Very simple Telnet server written in C#. You can add your own commands and enable password control for connecting to the telnet server. V…☆14Feb 7, 2018Updated 8 years ago
- ☆19Aug 25, 2024Updated 2 years ago
- a self-hostable layer-3 mesh networking system with stateless, lightweight nodes.☆15Sep 29, 2026Updated last month
- Deploy open-source AI quickly and easily - Special Bonus Offer • AdRunpod Hub is built for open source. One-click deployment and autoscaling endpoints without provisioning your own infrastructure.
- Automatic Generation of Visualizations and Infographics with LLMs and Streamlit for your CSV data.☆31Oct 25, 2023Updated 3 years ago
- A fast and async SQL database wrapper for Python, with support for MySQL, PostgreSQL, SQLite and MS SQL Server.☆14Dec 30, 2024Updated last year
- Cookiecutter for community-maintained Jupyter Docker images☆18Updated this week
- StrongOf helps to implement primitives as a strong type that represents a domain object (e.g. UserId, EmailAddress, etc.). It is a simpl…☆13Oct 4, 2026Updated 3 weeks ago
- Python module for converting SuperMemo collections to Anki☆13Nov 16, 2012Updated 13 years ago
- Clone any GitHub repo and flatten it into a file-tree diagram plus one consolidated code file - quick repo context for LLMs☆10Nov 21, 2025Updated 11 months ago
- beco a gateway for microservices☆10May 17, 2016Updated 10 years ago