distantmagic / llmops-handbook
Practical and advanced guide to LLMOps. It provides a solid understanding of large language models’ general concepts, deployment techniques, and software engineering practices. (work in progress)
☆53Updated 3 months ago
Related projects ⓘ
Alternatives and complementary repositories for llmops-handbook
- ☆112Updated this week
- Text generation in Python, as easy as possible☆42Updated this week
- High level library for batched embeddings generation, blazingly-fast web-based RAG and quantized indexes processing ⚡☆62Updated 2 weeks ago
- An open source, Gradio-based chatbot app that combines the best of retrieval augmented generation and prompt engineering into an intellig…☆43Updated 3 months ago
- Serving LLMs in the HF-Transformers format via a PyFlask API☆68Updated 2 months ago
- Dataset Crafting w/ RAG/Wikipedia ground truth and Efficient Fine-Tuning Using MLX and Unsloth. Includes configurable dataset annotation …☆162Updated 4 months ago
- Code for evaluating with Flow-Judge-v0.1 - an open-source, lightweight (3.8B) language model optimized for LLM system evaluations. Crafte…☆53Updated 3 weeks ago
- Client-side toolkit for using large language models, including where self-hosted☆102Updated this week
- Declarative framework to build LLM-based applications☆99Updated last week
- A stable, fast and easy-to-use inference library with a focus on a sync-to-async API☆45Updated last month
- RAG example using DSPy, Gradio, FastAPI☆66Updated 7 months ago
- Embed anything.☆29Updated 6 months ago
- Experimental LLM Inference UX to aid in creative writing☆106Updated 4 months ago
- Generate Synthetic Data Using OpenAI, MistralAI or AnthropicAI☆221Updated 6 months ago
- Generate python documentation using LLMs☆57Updated 4 months ago
- This small API downloads and exposes access to NeuML's txtai-wikipedia and full wikipedia datasets, taking in a query and returning full …☆51Updated this week
- A fast batching API to serve LLM models☆172Updated 6 months ago
- Simple examples using Argilla tools to build AI☆42Updated this week
- Convert Files / Folders / GitHub Repos Into AI / LLM-ready Files☆130Updated last week
- Framework for building, orchestrating and deploying multi-agent systems. Managed by OpenAI Solutions team. Experimental framework.☆78Updated last month
- ☆64Updated 5 months ago
- CaSIL is an advanced natural language processing system that implements a sophisticated four-layer semantic analysis architecture. It pro…☆62Updated 2 weeks ago
- An extension that lets the AI take the wheel, allowing it to use the mouse and keyboard, recognize UI elements, and prompt itself :3...no…☆97Updated last month
- ☆128Updated this week
- 🚀 A list of Haystack Integrations, maintained by the community or deepset.☆64Updated last week
- A python application that routes incoming prompts to an LLM by category, and can support a single incoming connection from a front end to…☆173Updated this week
- idea: https://github.com/nyxkrage/ebook-groupchat/☆82Updated 3 months ago
- Synthetic Data for LLM Fine-Tuning☆97Updated 11 months ago
- a lightweight, open-source blueprint for building powerful and scalable LLM chat applications☆30Updated 5 months ago
- Easily view and modify JSON datasets for large language models☆62Updated last month