ialacol / text-inference-batcherLinks
A high performance batching router optimises max throughput for text inference workload
☆16Updated 2 years ago
Alternatives and similar repositories for text-inference-batcher
Users that are interested in text-inference-batcher are comparing it to the libraries listed below
Sorting:
- Using modal.com to process FineWeb-edu data☆20Updated 9 months ago
- Complex RAG backend☆29Updated last year
- Radiantloom Email Assist 7B is an email-assistant large language model fine-tuned from Zephyr-7B-Beta, over a custom-curated dataset of 1…☆14Updated 2 years ago
- Python client library for improving your LLM app accuracy☆97Updated 11 months ago
- auto fine tune of models with synthetic data☆78Updated last year
- Embed anything.☆27Updated last year
- A guidance compatibility layer for llama-cpp-python☆36Updated 2 years ago
- Very basic framework for composable parameterized large language model (Q)LoRA / (Q)Dora fine-tuning using mlx, mlx_lm, and OgbujiPT.☆43Updated 7 months ago
- ☆68Updated last year
- ☆47Updated last year
- Leveraging DSPy for AI-driven task understanding and solution generation, the Self-Discover Framework automates problem-solving through r…☆72Updated 2 months ago
- 🚀 Scale your RAG pipeline using Ragswift: A scalable centralized embeddings management platform☆38Updated last year
- Simple Graph Memory for AI applications☆90Updated 8 months ago
- ☆119Updated last year
- A data-centric AI package for ML/AI. Get the best high-quality data for the best results. Discord: https://discord.gg/t6ADqBKrdZ☆63Updated 2 years ago
- 🔓 The open-source autonomous agent LLM initiative 🔓☆91Updated last year
- A stable, fast and easy-to-use inference library with a focus on a sync-to-async API☆47Updated last year
- ☆135Updated 2 years ago
- Grammar checker with a keyboard shortcut for Ollama and Apple MLX with Automator on macOS.☆82Updated last year
- OpenAI GPT hosted Agent Framework for Windows and MacOS☆36Updated last year
- Unofficial python bindings for the rust llm library. 🐍❤️🦀☆76Updated 2 years ago
- ☆36Updated last year
- the small distributed language model toolkit; fine-tune state-of-the-art LLMs anywhere, rapidly☆32Updated last year
- Verbosity control for AI agents☆66Updated last year
- Easily create LLM automation/agent workflows☆60Updated last year
- Generate visual podcasts about novels using open source models☆25Updated 2 years ago
- A Python library to orchestrate LLMs in a neural network-inspired structure☆52Updated last year
- GRDN.AI app for garden optimization☆69Updated 2 months ago
- LLM finetuning☆42Updated 2 years ago
- Official homepage for "Self-Harmonized Chain of Thought" (NAACL 2025)☆91Updated 11 months ago