AIAnytime / LLM-Inference-API-in-Rust
LLM Inference API in Rust. It also has a streamlit app that requests the running API in Rust.
☆17Updated last year
Related projects ⓘ
Alternatives and complementary repositories for LLM-Inference-API-in-Rust
- A quick Crew AI tutorial☆23Updated 6 months ago
- Light WebUI for lm.rs☆21Updated last month
- Function Calling Mistral 7B. Learn how to make functions call for open source LLMs.☆48Updated 8 months ago
- Local first human friendly agents toolkit for the browser and Nodejs☆25Updated last week
- ☆43Updated 5 months ago
- Data extraction with LLM on CPU☆64Updated last year
- A Python library to orchestrate LLMs in a neural network-inspired structure☆41Updated last month
- An advanced distributed knowledge fabric for intelligent document processing, featuring multi-document agents, optimized query handling, …☆21Updated 2 months ago
- CodeWhisper: AI-Powered End-to-End Task Implementation & blazingly fast Codebase-to-LLM Context Bridge☆54Updated last month
- Using langchain, deeplake and openai to create a Q&A on the Mojo lang programming manual☆22Updated 10 months ago
- Collection of rivet examples to get you going! (scroll down for more information)☆50Updated 7 months ago
- A framework for hosting and scaling AI agents.☆18Updated this week
- ☆16Updated 10 months ago
- A generalist agent that can go online and accomplish complex tasks using semantic-kernel and autogen.☆25Updated 11 months ago
- ☆44Updated 4 months ago
- Hacker News AI Search☆31Updated 6 months ago
- ☆110Updated 3 weeks ago
- OpenAI GPT hosted Agent Framework for Windows and MacOS☆36Updated 4 months ago
- Groqqle is a powerful web search and content summarization tool built with Python, leveraging Groq's LLM API for advanced natural languag…☆103Updated last month
- Aitino is a platform that allows for the creation of crews of AI Agents to help you automate tasks and solve complex problems.☆69Updated 3 weeks ago
- This is the Mixture-of-Agents (MoA) concept, adapted from the original work by TogetherAI. My version is tailored for local model usage a…☆11Updated 4 months ago
- Ask anything☆25Updated 5 months ago
- ☆18Updated 3 months ago
- developersdigest / Groq-API-Quick-Guide-with-Examples-Groq-SDK-Langchain-LlamaIndex-OpenAI-SDK-VercelGroq API: Quick Guide with Examples Groq SDK, Langchain, LlamaIndex, OpenAI SDK, Vercel☆38Updated 8 months ago
- Your Python AI Coder!☆28Updated 3 weeks ago
- Simple Graph Memory for AI applications☆79Updated 3 months ago
- Code generator using LlamaIndexTS workflows with OpenAI o1 model☆41Updated last month
- A project that brings the power of Large Language Models (LLM) and Retrieval-Augmented Generation (RAG) within reach of everyone, particu…☆32Updated 10 months ago
- Private RAG app sample using Llama3, Ollama and PostgreSQL☆24Updated last week