ialacol / text-inference-batcherLinks
A high performance batching router optimises max throughput for text inference workload
☆16Updated last year
Alternatives and similar repositories for text-inference-batcher
Users that are interested in text-inference-batcher are comparing it to the libraries listed below
Sorting:
- Using modal.com to process FineWeb-edu data☆20Updated last month
- Complex RAG backend☆28Updated last year
- A guidance compatibility layer for llama-cpp-python☆34Updated last year
- ☆23Updated 6 months ago
- ☆47Updated last year
- Radiantloom Email Assist 7B is an email-assistant large language model fine-tuned from Zephyr-7B-Beta, over a custom-curated dataset of 1…☆14Updated last year
- Generate visual podcasts about novels using open source models☆25Updated 2 years ago
- ☆25Updated 5 months ago
- Leveraging DSPy for AI-driven task understanding and solution generation, the Self-Discover Framework automates problem-solving through r…☆60Updated 10 months ago
- 🚀 Scale your RAG pipeline using Ragswift: A scalable centralized embeddings management platform☆38Updated last year
- ☆113Updated 5 months ago
- ☆17Updated 5 months ago
- Very basic framework for composable parameterized large language model (Q)LoRA / (Q)Dora fine-tuning using mlx, mlx_lm, and OgbujiPT.☆40Updated 3 months ago
- The DPAB-α Benchmark☆23Updated 4 months ago
- The Benefits of a Concise Chain of Thought on Problem Solving in Large Language Models☆22Updated 6 months ago
- ☆30Updated last year
- ☆66Updated last year
- auto fine tune of models with synthetic data☆74Updated last year
- Embed anything.☆28Updated last year
- Public reports detailing responses to sets of prompts by Large Language Models.☆30Updated 4 months ago
- High level library for batched embeddings generation, blazingly-fast web-based RAG and quantized indexes processing ⚡☆66Updated 6 months ago
- ☆28Updated last year
- Chat Markup Language conversation library☆55Updated last year
- A Python library to orchestrate LLMs in a neural network-inspired structure☆49Updated 7 months ago
- Code for evaluating with Flow-Judge-v0.1 - an open-source, lightweight (3.8B) language model optimized for LLM system evaluations. Crafte…☆70Updated 7 months ago
- ☆24Updated last year
- An intelligent code optimization system leveraging AI analysis, automated refactoring, and test generation. Built with DSPy and Gradio, i…☆19Updated 4 months ago
- Easily create LLM automation/agent workflows☆59Updated last year
- jQuery, React and Streamlit applications written by LLMs☆16Updated last year
- Tools for formatting large language model prompts.☆13Updated last year