Nero10578 / LLM-Inference-Benchmark
☆13Updated 3 weeks ago
Related projects: ⓘ
- Automated LLM novelist☆32Updated 5 months ago
- 5X faster 60% less memory QLoRA finetuning☆21Updated 3 months ago
- Experience the power of AI with this free AI voice generator demo. Utilizing Deepgram and Groq, we transform text into voice seamlessly. …☆37Updated 3 months ago
- Complex RAG backend☆28Updated 5 months ago
- A simple updated colab doc that will allow you to run the Ooba Booga Text-Generation-Webui for free with just a few lines of codes.☆19Updated 2 months ago
- Branch Out Your Conversations☆14Updated 3 weeks ago
- Easily view and modify JSON datasets for large language models☆55Updated this week
- An extension that lets the AI take the wheel, allowing it to use the mouse and keyboard, recognize UI elements, and prompt itself :3☆33Updated last week
- LlamaCards is a web application that provides a dynamic interface for interacting with LLM models in real-time. This app allows users to …☆35Updated 3 weeks ago
- run ollama & gguf easily with a single command☆46Updated 4 months ago
- A Windows tool to query various LLM AIs. Supports branched conversations, history and summaries among others.☆26Updated last week
- Dockerized AI with CUDA. Llama-cpp-python and stable diffusion.☆0Updated 7 months ago
- Local LLM inference & management server with built-in OpenAI API☆30Updated 5 months ago
- A framework for agentic workflow creation and deployment☆49Updated this week
- Gradio based tool to run opensource LLM models directly from Huggingface☆84Updated 2 months ago
- Eternal is an experimental platform for machine learning models and workflows.☆36Updated last month
- 4 million public stable diffusion prompts -- interactive neural search and llama chat☆19Updated 3 weeks ago
- An open source, Gradio-based chatbot app that combines the best of retrieval augmented generation and prompt engineering into an intellig…☆29Updated last month
- A bot that checks your grammar and phrasing using LLM of choice☆27Updated 3 months ago
- ☆21Updated this week
- Large Model Proxy is designed to make it easy to run multiple resource-heavy Large Models (LM) on the same machine with limited amount of…☆44Updated last month
- ☆31Updated 8 months ago
- "a towel is about the most massively useful thing an interstellar AI hitchhiker can have"☆46Updated last month
- A local AI companion that uses a collection of free, open source AI models in order to create two virtual companions that will follow you…☆68Updated 3 weeks ago
- Conduct in-depth research with AI-driven insights : DeepDive is a command-line tool that leverages web searches and AI models to generate…☆34Updated 3 weeks ago
- A simple experiment on letting two local LLM have a conversation about anything!☆81Updated 2 months ago
- Local character AI chatbot with chroma vector store memory and some scripts to process documents for Chroma☆29Updated this week
- Text generation in Python, as easy as possible☆39Updated this week
- Serving LLMs in the HF-Transformers format via a PyFlask API☆68Updated last week
- A stock market bot that automatically, once a day, rebalances your Robinhood portfolio by gathering information about each ticker in the …☆30Updated last month