ialacol / text-inference-batcherLinks
A high performance batching router optimises max throughput for text inference workload
☆16Updated last year
Alternatives and similar repositories for text-inference-batcher
Users that are interested in text-inference-batcher are comparing it to the libraries listed below
Sorting:
- Using modal.com to process FineWeb-edu data☆20Updated 3 months ago
- auto fine tune of models with synthetic data☆76Updated last year
- Embed anything.☆28Updated last year
- LLM finetuning☆42Updated last year
- ☆47Updated last year
- A guidance compatibility layer for llama-cpp-python☆35Updated last year
- Leveraging DSPy for AI-driven task understanding and solution generation, the Self-Discover Framework automates problem-solving through r…☆62Updated 11 months ago
- 🔓 The open-source autonomous agent LLM initiative 🔓☆91Updated last year
- ☆17Updated 6 months ago
- Verbosity control for AI agents☆64Updated last year
- ☆22Updated last year
- LLM-Training-API: Including Embeddings & ReRankers, mergekit, LaserRMT☆27Updated last year
- Radiantloom Email Assist 7B is an email-assistant large language model fine-tuned from Zephyr-7B-Beta, over a custom-curated dataset of 1…☆14Updated last year
- ☆18Updated last year
- Very basic framework for composable parameterized large language model (Q)LoRA / (Q)Dora fine-tuning using mlx, mlx_lm, and OgbujiPT.☆42Updated 3 weeks ago
- Code for evaluating with Flow-Judge-v0.1 - an open-source, lightweight (3.8B) language model optimized for LLM system evaluations. Crafte…☆73Updated 8 months ago
- Python client library for improving your LLM app accuracy☆98Updated 5 months ago
- GPT-4 Level Conversational QA Trained In a Few Hours☆62Updated 10 months ago
- A Python library to orchestrate LLMs in a neural network-inspired structure☆49Updated 9 months ago
- Simple examples using Argilla tools to build AI☆53Updated 7 months ago
- Distributed Inference for mlx LLm☆93Updated 11 months ago
- A seamless matchmaking application that is programmed with Cohere Command R+, Stanford NLP DSPy framework, Weaviate Vector store and Crew…☆59Updated last year
- Complex RAG backend☆28Updated last year
- A data-centric AI package for ML/AI. Get the best high-quality data for the best results. Discord: https://discord.gg/t6ADqBKrdZ☆63Updated last year
- ☆131Updated 2 months ago
- OpenMindedChatbot is a Proof Of Concept that leverages the power of Open source Large Language Models (LLM) with Function Calling capabil…☆29Updated last year
- ☆115Updated 6 months ago
- My journey learning LangChain☆68Updated last year
- GRDN.AI app for garden optimization☆70Updated last year
- Simple Graph Memory for AI applications☆87Updated last month