Nero10578 / LLM-Inference-BenchmarkLinks
☆14Updated 9 months ago
Alternatives and similar repositories for LLM-Inference-Benchmark
Users that are interested in LLM-Inference-Benchmark are comparing it to the libraries listed below
Sorting:
- ☆17Updated 5 months ago
- Experience the power of AI with this free AI voice generator demo. Utilizing Deepgram and Groq, we transform text into voice seamlessly. …☆37Updated 11 months ago
- Serving LLMs in the HF-Transformers format via a PyFlask API☆71Updated 8 months ago
- LLM backed Fantasy Tribe Game☆18Updated 6 months ago
- Use smol agents to do research and then update csv coumns with its findings.☆40Updated 4 months ago
- Local LLM inference & management server with built-in OpenAI API☆31Updated last year
- Complex RAG backend☆28Updated last year
- Embed anything.☆28Updated last year
- LlamaCards is a web application that provides a dynamic interface for interacting with LLM models in real-time. This app allows users to …☆39Updated 9 months ago
- Yet Another (LLM) Web UI, made with Gemini☆12Updated 5 months ago
- ☆66Updated last year
- A simple experiment on letting two local LLM have a conversation about anything!☆110Updated 11 months ago
- ☆75Updated 2 weeks ago
- a lightweight, open-source blueprint for building powerful and scalable LLM chat applications☆28Updated 11 months ago
- Allows two LLMs to communicate and run code in the terminal☆24Updated 5 months ago
- ☆24Updated 4 months ago
- A Python library to orchestrate LLMs in a neural network-inspired structure☆49Updated 8 months ago
- run ollama & gguf easily with a single command☆50Updated last year
- ☆28Updated 8 months ago
- Glyphs, acting as collaboratively defined symbols linking related concepts, add a layer of multidimensional semantic richness to user-AI …☆48Updated 3 months ago
- ☆28Updated 6 months ago
- High level library for batched embeddings generation, blazingly-fast web-based RAG and quantized indexes processing ⚡☆66Updated 7 months ago
- Tcurtsni: Reverse Instruction Chat, ever wonder what your LLM wants to ask you?☆22Updated 11 months ago
- GRDN.AI app for garden optimization☆70Updated last year
- Create text chunks which end at natural stopping points without using a tokenizer☆25Updated 2 months ago
- A framework that uses multi-agents to enable users to perform a systematic data science pipeline with just two inputs.☆42Updated 9 months ago
- never forget anything again! combine AI and intelligent tooling for a local knowledge base to track catalogue, annotate, and plan for you…☆37Updated last year
- An API for VoiceCraft.☆25Updated 11 months ago
- Proteus is an experimental platform that combines the power of Large Language Models with the Genesis physics engine☆22Updated 5 months ago
- Gradio based tool to run opensource LLM models directly from Huggingface☆91Updated 11 months ago