☆17Aug 18, 2023Updated 2 years ago
Alternatives and similar repositories for exllama-runpod-serverless
Users that are interested in exllama-runpod-serverless are comparing it to the libraries listed below. We may earn a commission when you buy through links labeled 'Ad' on this page.
Sorting:
- ☆50Oct 10, 2023Updated 2 years ago
- Create speaker voiceprints from a few seconds of audio. And, identify individuals in real-time streaming or recorded conversations.☆15Feb 4, 2019Updated 7 years ago
- Next Auth IORedisAdapter example☆20Feb 21, 2023Updated 3 years ago
- The RunPod worker template for serving our large language model endpoints. Powered by vLLM.☆422Updated this week
- A guidance compatibility layer for llama-cpp-python☆36Sep 11, 2023Updated 2 years ago
- Serverless GPU API endpoints on Runpod - Bonus Credits • AdSkip the infrastructure headaches. Auto-scaling, pay-as-you-go, no-ops approach lets you focus on innovating your application.
- Working with Assistants☆15Jul 6, 2024Updated last year
- Output high level Pcode (PcodeAST) in Ghidra☆16Apr 7, 2023Updated 3 years ago
- Automates Flatcam generation of G-code for my (and maybe your) PCB milling process☆10Jun 16, 2023Updated 2 years ago
- This repo helps to transform text into a better form for lora training☆13Apr 9, 2023Updated 3 years ago
- Codebase for fine-tuning Llama2 70B to generate math test questions and answers.☆11Aug 30, 2024Updated last year
- AdonisJS Cloudinary☆10Jul 25, 2021Updated 4 years ago
- Fuzzing Infrastructure with k8s & cephfs☆12Jul 23, 2020Updated 5 years ago
- ☆15Nov 13, 2023Updated 2 years ago
- A fully customizable react native Animated Bottom navigation tabs 🚀.☆10Mar 21, 2022Updated 4 years ago
- Managed hosting for WordPress and PHP on Cloudways • AdManaged hosting for WordPress, Magento, Laravel, or PHP apps, on multiple cloud providers. Deploy in minutes on Cloudways by DigitalOcean.
- Spen's Official OpenOCD Mirror (no pull requests)☆12Jan 27, 2020Updated 6 years ago
- A high-throughput and memory-efficient inference and serving engine for LLMs☆13Nov 27, 2023Updated 2 years ago
- Drop-in replacement for onnxruntime-node with GPU support using CUDA or DirectML☆17Aug 28, 2023Updated 2 years ago
- ☆12Aug 15, 2023Updated 2 years ago
- Docker that queries Starlinks Dishy and serves you the response on it's own web server☆11Nov 6, 2021Updated 4 years ago
- This repository contains the code snippets used in "LLM Prompt Engineering For Developers"☆12Apr 22, 2024Updated last year
- Starting point to build your own custom serverless endpoint☆133May 9, 2025Updated 11 months ago
- Minimal Appclip made with React Native☆14Oct 27, 2020Updated 5 years ago
- Files related to the SKR Mini E3 v2.0☆10Jun 16, 2020Updated 5 years ago
- Managed hosting for WordPress and PHP on Cloudways • AdManaged hosting for WordPress, Magento, Laravel, or PHP apps, on multiple cloud providers. Deploy in minutes on Cloudways by DigitalOcean.
- Genie in the Box: Distill Whisper STT => Mistral-7B => Phind/Phind-CodeLlama-34B-v2 => GPT 3.5 => Coqui's TTS/OpenAI TTS☆16Apr 24, 2024Updated last year
- AI QA interface to your obsidian notes☆18May 31, 2023Updated 2 years ago
- TheBloke's Dockerfiles☆308Mar 8, 2024Updated 2 years ago
- Pytorch directly integrated to the cloud all through Bench AI!☆10Dec 10, 2023Updated 2 years ago
- An experiment with movie scenes and contrastive learning☆11Feb 1, 2025Updated last year
- A common protocol for AI agent tools☆10Oct 21, 2024Updated last year
- ☆29Jul 2, 2025Updated 9 months ago
- An efficient LinkedIn Messaging Bot that Messages a group of interests, YouTube link in Documentation for guidance.☆12Aug 25, 2021Updated 4 years ago
- A demo Android phone application intended as an educational tool for demonstrating how Amazon IVS can be used to build a scrolling feed o…☆15Nov 12, 2025Updated 5 months ago
- Managed hosting for WordPress and PHP on Cloudways • AdManaged hosting for WordPress, Magento, Laravel, or PHP apps, on multiple cloud providers. Deploy in minutes on Cloudways by DigitalOcean.
- ☆10Jul 29, 2023Updated 2 years ago
- Let's build a blog with next.js - Udemy course☆14Jan 23, 2020Updated 6 years ago
- Generate Large Language Model text in a container.☆20Mar 24, 2023Updated 3 years ago
- Generate a dataset to finetune a LLM to generate Cypher code from questions given in natural language (English).☆15May 24, 2024Updated last year
- Lokal Webpack Plugin, works with NextJS and all webpack-based dev server.☆15Aug 12, 2024Updated last year
- A dataset of posters for movies from MovieLens-25M☆11May 17, 2021Updated 4 years ago
- doug is an ai experiment with openai, llama-cpp-python, and langchain☆16Sep 2, 2025Updated 7 months ago