AIAnytime / LLM-Inference-API-in-RustLinks
LLM Inference API in Rust. It also has a streamlit app that requests the running API in Rust.
☆20Updated last year
Alternatives and similar repositories for LLM-Inference-API-in-Rust
Users that are interested in LLM-Inference-API-in-Rust are comparing it to the libraries listed below
Sorting:
- ⚡️Lightning fast in-memory VectorDB written in rust🦀☆23Updated 5 months ago
- 🤖📝 A markdown editor powered by AI (Ollama)☆62Updated 9 months ago
- Super-simple, fully Rust powered "memory" (doc store + semantic search) for LLM projects, semantic search, etc.☆62Updated last year
- A quick Crew AI tutorial☆23Updated last year
- Get up and running with Llama 2, Mistral, Gemma, and other large language models.☆20Updated last year
- A generalist agent that can go online and accomplish complex tasks using semantic-kernel and autogen.☆27Updated 3 weeks ago
- A simple, CUDA or CPU powered, library for creating vector embeddings using Candle and models from Hugging Face☆37Updated last year
- Web Application that can generate code and fix bugs and run using various LLM's (GPT,Gemini,PALM)☆123Updated last year
- Built for demanding AI workflows, this gateway offers low-latency, provider-agnostic access, ensuring your AI applications run smoothly a…☆74Updated 2 months ago
- The version 0.2 is a prompt based agent workflow that integrates with other Lyzr agents☆32Updated last year
- Model Context Protocol (MCP) CLI server template for Rust☆79Updated 3 months ago
- Rust implementation of Surya☆58Updated 5 months ago
- Rivet plugin for integration with Ollama, the tool for running LLMs locally easily☆42Updated 2 months ago
- Turn natual language into commands. Your CLI tasks, now as easy as a conversation. Run it 100% offline, or use OpenAI's models.☆60Updated last year
- skills for autogen studio agents. python code skills. copy and paste into autogen studio☆65Updated last year
- OpenAI compatible API for serving LLAMA-2 model☆219Updated last year
- Simple Chainlit UI for running llms locally using Ollama and LangChain☆120Updated 11 months ago
- Multi-platform desktop app to download and run Large Language Models(LLM) locally in your computer.☆288Updated 2 years ago
- Using langchain, deeplake and openai to create a Q&A on the Mojo lang programming manual☆22Updated last year
- auto-rust is an experimental project that automatically generate Rust code with LLM (Large Language Models) during compilation, utilizing…☆40Updated 8 months ago
- ☆32Updated 7 months ago
- Light WebUI for lm.rs☆24Updated 9 months ago
- Aitino is a platform that allows for the creation of crews of AI Agents to help you automate tasks and solve complex problems.☆88Updated 4 months ago
- VSCode Copilot for Groq fans!☆41Updated last month
- Run AI models anywhere. https://muna.ai/explore☆63Updated 2 weeks ago
- Dagger functions to import Hugging Face GGUF models into a local ollama instance and optionally push them to ollama.com.☆116Updated last year
- ☆80Updated last year
- Storage for examples of autogen skillz☆41Updated last year
- A collection of apps powered by the LlamaIndex LLM framework.☆55Updated 4 months ago
- ☆11Updated 8 months ago