☆14Aug 25, 2024Updated last year
Alternatives and similar repositories for LLM-Inference-Benchmark
Users that are interested in LLM-Inference-Benchmark are comparing it to the libraries listed below
Sorting:
- LLM backed Fantasy Tribe Game☆19Nov 21, 2024Updated last year
- A tool that can be used to measure the sequential performance of any OpenAI-compatible LLM API☆23Aug 1, 2024Updated last year
- Proteus is an experimental platform that combines the power of Large Language Models with the Genesis physics engine☆26Dec 20, 2024Updated last year
- A bot that checks your grammar and phrasing using LLM of choice☆32Feb 6, 2025Updated last year
- Yet another frontend for LLM, written using .NET and WinUI 3☆10Sep 14, 2025Updated 6 months ago
- Basic Streamlit Application for testing, and displaying Multi-GPU LLM timings☆10Mar 30, 2024Updated last year
- Modified Beam Search with periodical restart☆12Sep 12, 2024Updated last year
- WebXR Input Profiles Loader in Unity. Based on https://github.com/immersive-web/webxr-input-profiles☆20Jan 23, 2024Updated 2 years ago
- Scrape reddit posts into a single markdown file☆12Jul 28, 2024Updated last year
- Zextras Technical Documentation☆12Updated this week
- Visual Tagger is a JavaScript tool that visually highlights HTML elements for AIs, aiding in identifying interactive components on web pa…☆11Oct 28, 2024Updated last year
- AI Reddit bot that scrapes subreddits for questions, conducts research, and posts automated answers to help users with relevant informati…☆17Sep 13, 2024Updated last year
- ☆12Jan 19, 2024Updated 2 years ago
- A custom Lovelace card for Home Assistant to display RSS feed items in an accordion style.☆21Updated this week
- LLM_Buttplug extension Control Sex Toy for oobabooga/text-generation-webui☆17Jan 8, 2024Updated 2 years ago
- reimagine the implementation of C-3PO droid voice synthesizer and multilingual translation and communication capabilities with the latest…☆12Mar 6, 2024Updated 2 years ago
- Proxy server for triton gRPC server that inferences embedding model in Rust☆21Aug 10, 2024Updated last year
- ICLR Blog Track 2025☆19Sep 21, 2025Updated 6 months ago
- Chrome extension that provides comprehensive browser fingerprint protection by defending against various tracking techniques used across …☆22Oct 26, 2025Updated 4 months ago
- This project is an app that shows a map with Electric Charging Stations and their information. The app supports station markers clusterin…☆12Jan 15, 2024Updated 2 years ago
- The TinyLlama project is an open endeavor to pretrain a 1.1B Llama model on 3 trillion tokens.☆14Mar 30, 2024Updated last year
- ☆11Aug 11, 2025Updated 7 months ago
- Ctrl + F but fancy.☆16Sep 30, 2024Updated last year
- Y'all thought the dead internet theory wasn't real, but HERE IT IS☆16Apr 27, 2024Updated last year
- LLM-only topic extraction and classification☆11Sep 20, 2024Updated last year
- Keystroke injection and Keylogger with an ESP8266 + Arduino Pro Micro + USB Host Shield☆17Nov 7, 2017Updated 8 years ago
- Orchestration middleware for Home Assistant + Ollama: enables 8-20B models to handle complex multi-intent commands through intelligent ta…☆24Feb 6, 2026Updated last month
- Neuroengine is a service to share LLMs in the form of a webchat and API.☆45Oct 21, 2024Updated last year
- Synthèses vocale piper oobabooga☆14Feb 24, 2024Updated 2 years ago
- ☆14Mar 17, 2025Updated last year
- Dashboard system (Grafana+Prometheus+Node-Exporter+Cadvisor)☆17Jul 25, 2021Updated 4 years ago
- An extension for oobabooga/text-generation-webui that automatically unloads and reloads your model.☆17Apr 22, 2024Updated last year
- LLm Collaboration☆12Aug 23, 2024Updated last year
- Text-to-video generation.☆19Jul 18, 2022Updated 3 years ago
- A powerful AI-integrated Terminal Shell powered by the Ollama LLM interface.☆14May 30, 2025Updated 9 months ago
- 🛡️ AI-powered system security auditor. A cross-platform TUI/CLI tool to analyze processes, network, and packages on Linux & Windows usin…☆41Dec 9, 2025Updated 3 months ago
- ☆11Jan 28, 2024Updated 2 years ago
- A simple apache logs analyzer.☆18Oct 1, 2017Updated 8 years ago
- This repo contains a demo of adversarial strings poisoning vector database and forching specific hallucinations on RAG chatbot.☆10May 2, 2024Updated last year