Practical and advanced guide to LLMOps. It provides a solid understanding of large language models’ general concepts, deployment techniques, and software engineering practices. (work in progress)
☆85Aug 16, 2024Updated 2 years ago
Alternatives and similar repositories for llmops-handbook
Users that are interested in llmops-handbook are comparing it to the libraries listed below. We may earn a commission when you buy through links labeled 'Ad' on this page.
Sorting:
- Extracts structured data from unstructured input. Programming language agnostic. Uses llama.cpp☆45May 16, 2024Updated 2 years ago
- In this course navigates through the LLMOps pipeline, enabling you to preprocess training data for supervised fine-tuning and deploy cust…☆16Feb 13, 2024Updated 2 years ago
- AI Based "Happiness Optimizer"☆12Oct 20, 2024Updated last year
- ☆25May 31, 2024Updated 2 years ago
- AutoREADME is an AI-powered tool that genereates a README file for any given input repository.☆36Oct 2, 2024Updated last year
- Deploy to Railway using AI coding agents - Free Credits Offer • AdUse Claude Code, Codex, OpenCode, and more. Autonomous software development now has the infrastructure to match with Railway.
- "a towel is about the most massively useful thing an interstellar AI hitchhiker can have"☆48Oct 9, 2024Updated last year
- Turn any Mac or GPU into an OpenAI-compatible inference node. One-command setup, automatic HTTPS, model management, and distributed reque…☆25Sep 5, 2026Updated 3 weeks ago
- A multimodal live AI assistant designed to enhance the browsing experience using Gemini.☆11Feb 15, 2025Updated last year
- ☆28Apr 7, 2025Updated last year
- Offline-first, desktop AI assistant tailored for educators, enabling them to generate questions directly from source materials.☆24Aug 2, 2025Updated last year
- Crow is a Desktop AI Assistant☆33Aug 9, 2024Updated 2 years ago
- A sleek, customizable interface for managing LLMs with responsive design and easy agent personalization.☆19Aug 30, 2024Updated 2 years ago
- Tcurtsni: Reverse Instruction Chat, ever wonder what your LLM wants to ask you?☆23Jun 25, 2024Updated 2 years ago
- Experience the power of AI with this free AI voice generator demo. Utilizing Deepgram and Groq, we transform text into voice seamlessly. …☆38Jun 12, 2024Updated 2 years ago
- Deploy on Railway without the complexity - Free Credits Offer • AdConnect your repo and Railway handles the rest with instant previews. Quickly provision container image services, databases, and storage volumes.
- Yet Another (LLM) Web UI, made with Gemini☆12Dec 25, 2024Updated last year
- An interface that features barely zero external dependencies beyond the Ollama API itself, making it lightweight and portable to easily i…☆12Mar 25, 2025Updated last year
- ☆20Jan 24, 2024Updated 2 years ago
- AI management tool☆119Nov 9, 2024Updated last year
- jemma & her ai agents that build software☆94May 25, 2024Updated 2 years ago
- An OpenAI API compatible API for chat with image input and questions about the images. aka Multimodal.☆264Mar 6, 2025Updated last year
- Run Ollama LLM models in Google Colab for free☆42Nov 24, 2024Updated last year
- A repository to store helpful information and emerging insights in regard to LLMs☆21Oct 27, 2023Updated 2 years ago
- Code Repository for Blog - How to Productionize Large Language Models (LLMs)☆12Mar 27, 2024Updated 2 years ago
- Serverless GPU API endpoints on Runpod - Get Bonus Credits • AdSkip the infrastructure headaches. Auto-scaling, pay-as-you-go, no-ops approach lets you focus on innovating your application.
- an AI interaction tool with RAG hybrid search, conversation context, web content processing and structured data analysis with LLM / GPT☆214Jun 17, 2025Updated last year
- Building reliable Retrieval Augmented Generation(RAG) AI Architecture☆13Jul 30, 2024Updated 2 years ago
- Inspect LLM's logprobs and perplexity over a piece of text, or compare two LLMs (like a git diff)☆18Aug 3, 2026Updated last month
- Attend - to what matters.☆17Feb 22, 2025Updated last year
- ☆18Jul 1, 2025Updated last year
- Latent Large Language Models☆19Aug 24, 2024Updated 2 years ago
- Ultra-lightweight C++ inference engine for BitMamba-2 (1.58-bit SSM). Runs 1B models on consumer CPUs at 50+ tok/s using <700MB RAM. No h…☆21Jun 2, 2026Updated 3 months ago
- Forking for the purpose of continuing its development☆25Updated this week
- DEPRICATED: See ChiScraper Instead☆17Oct 13, 2024Updated last year
- 1-Click AI Models by DigitalOcean Gradient • AdDeploy popular AI models on DigitalOcean Gradient GPU virtual machines with just a single click. Zero configuration with optimized deployments.
- ☆14Apr 22, 2024Updated 2 years ago
- ☆20Feb 18, 2025Updated last year
- ☆31Mar 26, 2025Updated last year
- The code for LexDrafter framework: a framework that assists in drafting Definitions articles for legislative documents using retrieval au…☆13May 12, 2025Updated last year
- OllaDeck is a purple technology stack for Generative AI (text modality) cybersecurity. It provides a comprehensive set of tools for both …☆17Sep 21, 2024Updated 2 years ago
- A Fabric mod that brings intelligent NPCs to your minecraft world.☆17Jul 23, 2026Updated 2 months ago
- Comparison of the output quality of quantization methods, using Llama 3, transformers, GGUF, EXL2.☆169May 16, 2024Updated 2 years ago