Nero10578 / LLM-Inference-Benchmark
☆14Updated 7 months ago
Alternatives and similar repositories for LLM-Inference-Benchmark:
Users that are interested in LLM-Inference-Benchmark are comparing it to the libraries listed below
- ☆17Updated 4 months ago
- ☆66Updated 10 months ago
- Complex RAG backend☆28Updated last year
- LLM backed Fantasy Tribe Game☆18Updated 4 months ago
- A bot that checks your grammar and phrasing using LLM of choice☆29Updated 2 months ago
- run ollama & gguf easily with a single command☆50Updated 11 months ago
- Serving LLMs in the HF-Transformers format via a PyFlask API☆71Updated 7 months ago
- Gradio based tool to run opensource LLM models directly from Huggingface☆90Updated 9 months ago
- A Python library to orchestrate LLMs in a neural network-inspired structure☆46Updated 6 months ago
- Attend - to what matters.☆14Updated last month
- 5X faster 60% less memory QLoRA finetuning☆21Updated 10 months ago
- Tcurtsni: Reverse Instruction Chat, ever wonder what your LLM wants to ask you?☆21Updated 9 months ago
- Conduct in-depth research with AI-driven insights : DeepDive is a command-line tool that leverages web searches and AI models to generate…☆42Updated 7 months ago
- Proteus is an experimental platform that combines the power of Large Language Models with the Genesis physics engine☆21Updated 3 months ago
- Running Microsoft's BitNet inference framework via FastAPI, Uvicorn and Docker.☆21Updated 5 months ago
- ☆28Updated 6 months ago
- ☆24Updated 2 months ago
- Local LLM inference & management server with built-in OpenAI API☆31Updated 11 months ago
- Radiantloom Email Assist 7B is an email-assistant large language model fine-tuned from Zephyr-7B-Beta, over a custom-curated dataset of 1…☆14Updated last year
- ☆28Updated last year
- Use Codestral Mamba with Visual Studio Code and the Continue extension. A local LLM alternative to GitHub Copilot.☆31Updated 8 months ago
- Automated LLM novelist☆44Updated last year
- Easily view and modify JSON datasets for large language models☆73Updated last month
- Experience the power of AI with this free AI voice generator demo. Utilizing Deepgram and Groq, we transform text into voice seamlessly. …☆37Updated 10 months ago
- ☆29Updated 4 months ago
- ☆30Updated 9 months ago
- A Windows tool to query various LLM AIs. Supports branched conversations, history and summaries among others.☆30Updated this week
- Create text chunks which end at natural stopping points without using a tokenizer☆26Updated last month
- never forget anything again! combine AI and intelligent tooling for a local knowledge base to track catalogue, annotate, and plan for you…☆37Updated 11 months ago
- Build HTML artefacts with Ollama☆11Updated 4 months ago