AIAnytime / LLM-Inference-API-in-RustLinks
LLM Inference API in Rust. It also has a streamlit app that requests the running API in Rust.
☆20Updated 2 years ago
Alternatives and similar repositories for LLM-Inference-API-in-Rust
Users that are interested in LLM-Inference-API-in-Rust are comparing it to the libraries listed below
Sorting:
- Super-simple, fully Rust powered "memory" (doc store + semantic search) for LLM projects, semantic search, etc.☆65Updated 2 years ago
- ⚡️Lightning fast in-memory VectorDB written in rust🦀☆30Updated 10 months ago
- Here is a collection of cool applications that I've built with AssemblyAI☆35Updated last year
- Rust implementation of Surya☆65Updated 11 months ago
- Light WebUI for lm.rs☆24Updated last year
- On-device LLM Inference using Mediapipe LLM Inference API.☆23Updated last year
- An educational Rust project for exporting and running inference on Qwen3 LLM family☆40Updated 6 months ago
- Ask shortgpt for instant and concise answers☆13Updated 2 years ago
- OpenAI compatible API for serving LLAMA-2 model☆218Updated 2 years ago
- Using langchain, deeplake and openai to create a Q&A on the Mojo lang programming manual☆22Updated 2 years ago
- 🤖📝 A markdown editor powered by AI (Ollama)☆64Updated last year
- ☆59Updated last year
- The MCP enterprise actors-based server or mcp-ectors for short☆31Updated 8 months ago
- Ingest any document type and query☆13Updated 2 years ago
- auto-rust is an experimental project that automatically generate Rust code with LLM (Large Language Models) during compilation, utilizing…☆46Updated last year
- Simple Chainlit UI for running llms locally using Ollama and LangChain☆118Updated last year
- ☆74Updated last year
- Source code for "$0 Embeddings (OpenAI vs. free & open source)" 🎥☆167Updated 2 years ago
- Run CrewAI agent workflows on local LLM models with Llamafile and Ollama☆39Updated last year
- Cody the coding ai assistant☆63Updated 10 months ago
- Run AI models anywhere. https://muna.ai/explore☆80Updated last week
- Fast, simple tool to concatenate Git repositories into single files for LLM analysis☆20Updated 11 months ago
- CrustAGI is an Task-driven Autonomous Agent experiment written in Rust☆46Updated 2 years ago
- Aitino is a platform that allows for the creation of crews of AI Agents to help you automate tasks and solve complex problems.☆91Updated 10 months ago
- Your Python AI Coder!☆36Updated 8 months ago
- A collection of apps powered by the LlamaIndex LLM framework.☆55Updated 3 months ago
- Welcome to FluidAPI, it's a framework that allows you to interact with APIs using natural language. No more JSON, headers, or complex for…☆32Updated 3 months ago
- AI Agents with Google's Gemini Pro and Gemini Pro Vision Models☆28Updated 2 years ago
- ☆47Updated last year
- ☆46Updated 2 years ago