A guide to testing different runpod (and other linux VMs) configurations. Specifically the speed of LLM outputs
☆18Jan 12, 2024Updated 2 years ago
Alternatives and similar repositories for runpod-ollama-speedtest-guide
Users that are interested in runpod-ollama-speedtest-guide are comparing it to the libraries listed below. We may earn a commission when you buy through links labeled 'Ad' on this page.
Sorting:
- ☆12Jan 19, 2024Updated 2 years ago
- The TinyLlama project is an open endeavor to pretrain a 1.1B Llama model on 3 trillion tokens.☆14Mar 30, 2024Updated 2 years ago
- ☆11Jan 28, 2024Updated 2 years ago
- ☆14Aug 25, 2024Updated 2 years ago
- An OpenAI API compatible images server to generate or manipulate images.☆18Feb 2, 2025Updated last year
- Serverless GPU API endpoints on Runpod - Get Bonus Credits • AdSkip the infrastructure headaches. Auto-scaling, pay-as-you-go, no-ops approach lets you focus on innovating your application.
- ☆16Dec 16, 2024Updated last year
- SLAM-Map-Compression-OR-Tools☆13Sep 23, 2023Updated 3 years ago
- Implementation of stop sequencer for Huggingface Transformers☆16Jun 6, 2023Updated 3 years ago
- ☆19Jun 5, 2023Updated 3 years ago
- Code for paper: "QuIP: 2-Bit Quantization of Large Language Models With Guarantees" adapted for Llama models☆40Aug 4, 2023Updated 3 years ago
- Reproducing GPT on the TinyStories dataset☆22Jan 18, 2024Updated 2 years ago
- Non-official repo for the old Cursor version (first release)☆46Sep 14, 2024Updated 2 years ago
- TAXII 2.0 Server implemented in Node JS with MongoDB backend☆12Jan 3, 2023Updated 3 years ago
- 一个静态链接glibc的示例程序☆10Oct 8, 2022Updated 4 years ago
- Managed Kubernetes at scale on DigitalOcean • AdDigitalOcean Kubernetes includes the control plane, bandwidth allowance, container registry, automatic updates, and more for free.
- A powerful prompt template engine built upon Jinja☆12Oct 22, 2025Updated 11 months ago
- CI scripts designed to build a Pascal-compatible version of vLLM.☆13Aug 10, 2024Updated 2 years ago
- ☆17Dec 18, 2023Updated 2 years ago
- Friendly Terminal Assistant for Developers☆17Mar 23, 2024Updated 2 years ago
- A monthly Windows PE baseline dataset for Cyber security researchers☆24Sep 27, 2026Updated 3 weeks ago
- In this training will be covered about a very basic step for malware analysis. Using several free tools to recognize malware behavior. Si…☆12Aug 17, 2026Updated 2 months ago
- ☆18Jul 13, 2024Updated 2 years ago
- Nim-based encryption tool for obfuscating shellcode and payloads for evading Windows Defender.☆28Jul 14, 2026Updated 3 months ago
- A client to gather vulnerability-related information from the Fediverse.☆12Oct 9, 2026Updated last week
- Managed hosting for WordPress and PHP on Cloudways • AdManaged hosting for WordPress, Magento, Laravel, or PHP apps, on multiple cloud providers. Deploy in minutes on Cloudways by DigitalOcean.
- Small repository that enables linenumbers on CodeJar code editor with >= v4.☆12Sep 19, 2024Updated 2 years ago
- Demo of an "always-on" AI assistant.☆23Feb 14, 2024Updated 2 years ago
- 🔒 Your private AI assistant, 100% local on Windows: chat, vision, documents (RAG), web search, images, videos with sound, voice, code pr…☆43Updated this week
- Detection engineering with durable memory, a five-stage lifecycle, and an agentic surface — the sibling of ATHF.☆33Updated this week
- ☆10Aug 9, 2024Updated 2 years ago
- Download a Bunch of Malware for Demos and Testing☆13Sep 28, 2018Updated 8 years ago
- ☆11Apr 2, 2025Updated last year
- Klara docker compose☆11May 19, 2020Updated 6 years ago
- A simple pipeline representation for .NET. It represents a sequence of steps that are processed consistently. This approach enables break…☆16Jan 18, 2025Updated last year
- Managed Kubernetes at scale on DigitalOcean • AdDigitalOcean Kubernetes includes the control plane, bandwidth allowance, container registry, automatic updates, and more for free.
- Generate Brave Goggles using your favorite subreddit(s).☆22Apr 16, 2023Updated 3 years ago
- ☆11Jun 18, 2024Updated 2 years ago
- A simple no-install web UI for Ollama and OAI-Compatible APIs!☆31Jan 30, 2025Updated last year
- Convert MISP events to Elastalert rules☆12Aug 10, 2021Updated 5 years ago
- ojjson is a library designed to facilitate JSON interactions with Ollama, a large language api (LLM). It leverages the power of Zod for s…☆12Nov 7, 2024Updated last year
- CRATE (Compile Raw Archives, Tracked in the vault, into Encyclopedic wiki)☆16May 16, 2026Updated 5 months ago
- Converts Sigma detection rules to a Splunk alert configuration.☆12Jul 1, 2021Updated 5 years ago