LLM Inference API in Rust. It also has a streamlit app that requests the running API in Rust.
☆20Sep 24, 2023Updated 2 years ago
Alternatives and similar repositories for LLM-Inference-API-in-Rust
Users that are interested in LLM-Inference-API-in-Rust are comparing it to the libraries listed below. We may earn a commission when you buy through links labeled 'Ad' on this page.
Sorting:
- Get Started with Qdrant Vector DB. From Setup to First RAG Implementation using Qdrant.☆28Oct 14, 2023Updated 2 years ago
- A SaaS Startup using Generative AI. This is a code bug fixer SaaS built using Azure OpenAI, Stripe, SQLite, and web technologies.☆15Sep 22, 2023Updated 2 years ago
- Faster Stable Diffusion using SSD-1B. A gradio app inside for demo.☆15Oct 26, 2023Updated 2 years ago
- ☆10Aug 31, 2023Updated 2 years ago
- ☆11Jan 24, 2023Updated 3 years ago
- 1-Click AI Models by DigitalOcean Gradient • AdDeploy popular AI models on DigitalOcean Gradient GPU virtual machines with just a single click and start building anything your business needs.
- This is "Your Private StackOverflow" app that helps you perform generative search in your code bases. This is built using open-source sta…☆11Aug 14, 2023Updated 2 years ago
- ☆14Apr 20, 2023Updated 2 years ago
- ☆13Jul 15, 2023Updated 2 years ago
- Example of ML app using Streamlit.☆18Sep 17, 2024Updated last year
- ☆25Jun 24, 2023Updated 2 years ago
- This is a QA bot based on Code Llama. It is a new LLM for code by Meta AI.☆13Aug 25, 2023Updated 2 years ago
- ☆14Jul 18, 2021Updated 4 years ago
- This is the official repo of Text Summarizer Streamlit App video from AI Anytime YouTube channel.☆16Mar 21, 2024Updated 2 years ago
- Dart native binary cross compilation☆14Dec 14, 2019Updated 6 years ago
- DigitalOcean Gradient AI Platform • AdBuild production-ready AI agents using customizable tools or access multiple LLMs through a single endpoint. Create custom knowledge bases or connect external data.
- ☆13Oct 3, 2024Updated last year
- Free AI Youtube Summarizer on your computer using mistral-instruct-v0.2, langchain and llama_index☆20Dec 19, 2023Updated 2 years ago
- Create React App for Fuse-Box, TypeScript, components and more☆13Mar 30, 2019Updated 7 years ago
- ☆16Jan 8, 2023Updated 3 years ago
- librgb, the "consensus layer" of RGB: creation and validation of contracts and proofs☆13Jun 23, 2019Updated 6 years ago
- Lightning Kube provides a simple way to deploy a Lightning Node into Kubernetes.☆13Mar 14, 2019Updated 7 years ago
- 📚 Build knowledge bases for RAG☆32Jul 3, 2025Updated 9 months ago
- ☆52Updated this week
- ☆19Nov 27, 2023Updated 2 years ago
- 1-Click AI Models by DigitalOcean Gradient • AdDeploy popular AI models on DigitalOcean Gradient GPU virtual machines with just a single click and start building anything your business needs.
- Node, Express and MongoDB fullstack application☆15Dec 12, 2022Updated 3 years ago
- An HTML5 Real Time Clock based on WebSocket☆12Mar 23, 2017Updated 9 years ago
- Enable GitHub developers to deploy to Okteto using GitHub Actions☆18Sep 21, 2023Updated 2 years ago
- ☆21Oct 17, 2020Updated 5 years ago
- A Streamlit application that summarizes documents using LaMini-LM.☆18Jun 4, 2023Updated 2 years ago
- A generator for golang alfred workflow that helps you create boilerplate code.☆13Jun 26, 2024Updated last year
- A mocking toolkit leveraging the power of TypeScript to enhance your jest experience.☆14Feb 3, 2023Updated 3 years ago
- Tor2Web HTTP/1.x reverse proxy to consume onion endpoints without installing a tor client☆20Sep 26, 2022Updated 3 years ago
- ☆18Jan 5, 2023Updated 3 years ago
- 1-Click AI Models by DigitalOcean Gradient • AdDeploy popular AI models on DigitalOcean Gradient GPU virtual machines with just a single click and start building anything your business needs.
- ☆17Apr 18, 2025Updated 11 months ago
- 基于bpmn 2.0协议实现的工作流引擎☆12Jan 17, 2024Updated 2 years ago
- Building Simple P2PKH, P2SH-P2WPKH and P2WPKH Transactions in bitcoinjs-lib☆13May 6, 2018Updated 7 years ago
- Launch btcpayserver on LunaNode (https://launchbtcpay.lunanode.com)☆13Jun 12, 2025Updated 9 months ago
- Build & Download 2700+ popular brands Badge, SVG, Hex & so on to use in GitHub Markdown or Any Web Pages wth fast, reliable with amazing …☆15Nov 25, 2023Updated 2 years ago
- Looks up command line syntax from cheatsheets using fuzzy search☆16Mar 26, 2026Updated 2 weeks ago
- Customize the player loop from the settings window. One of the "j1Tech" series developed by jwellone Inc for Unity.☆12Sep 9, 2021Updated 4 years ago