Alternatives and similar repositories for text-inference-batcher

Users that are interested in text-inference-batcher are comparing it to the libraries listed below

• enjalot / latent-data-modal
  Using modal.com to process FineWeb-edu data
  ☆20Updated 4 months ago
• shivamsanju / ragswift
  🚀 Scale your RAG pipeline using Ragswift: A scalable centralized embeddings management platform
  ☆38Updated last year
• QuixiAI / kraken
  ☆66Updated last year
• l4b4r4b4b4 / AIDocks
  LLM-Training-API: Including Embeddings & ReRankers, mergekit, LaserRMT
  ☆27Updated last year
• spyglass-search / talos
  Easily create LLM automation/agent workflows
  ☆59Updated last year
• nath1295 / MLX-Textgen
  A python package for serving LLM on OpenAI-compatible API endpoints with prompt caching using MLX.
  ☆92Updated last month
• LLukas22 / llm-rs-python
  Unofficial python bindings for the rust llm library. 🐍❤️🦀
  ☆75Updated 2 years ago
• nicholasyager / llama-cpp-guidance
  A guidance compatibility layer for llama-cpp-python
  ☆36Updated last year
• discus-labs / discus
  A data-centric AI package for ML/AI. Get the best high-quality data for the best results. Discord: https://discord.gg/t6ADqBKrdZ
  ☆63Updated last year
• michaelfeil / embed
  A stable, fast and easy-to-use inference library with a focus on a sync-to-async API
  ☆45Updated 11 months ago
• chimezie / mlx-tuning-fork
  Very basic framework for composable parameterized large language model (Q)LoRA / (Q)Dora fine-tuning using mlx, mlx_lm, and OgbujiPT.
  ☆42Updated 2 months ago
• teleprint-me / py.gpt.prompt
  PyGPTPrompt: A CLI tool that manages context windows for AI models, facilitating user interaction and data ingestion for optimized long-t…
  ☆30Updated last year
• multiplexerai / mplx_rag
  Complex RAG backend
  ☆29Updated last year
• teknium1 / ShareGPT-Builder
  ☆116Updated 8 months ago
• flowaicom / flow-judge
  Code for evaluating with Flow-Judge-v0.1 - an open-source, lightweight (3.8B) language model optimized for LLM system evaluations. Crafte…
  ☆77Updated 9 months ago
• Prismadic / magnet
  the small distributed language model toolkit; fine-tune state-of-the-art LLMs anywhere, rapidly
  ☆31Updated 10 months ago
• 4dh / GRDN
  GRDN.AI app for garden optimization
  ☆70Updated last year
• aigeek0x0 / radiantloom-email-assist-7b
  Radiantloom Email Assist 7B is an email-assistant large language model fine-tuned from Zephyr-7B-Beta, over a custom-curated dataset of 1…
  ☆14Updated last year
• taylorai / onnx_embedding_models
  utilities for loading and running text embeddings with onnx
  ☆44Updated last week
• desik1998 / MathWithLLMs
  ☆49Updated last year
• itsPreto / VECTR8
  Embed anything.
  ☆28Updated last year
• bodaay / HuggingChatAllInOne
  One Repo To Quickly Build One Docker File for HuggingChat Front and BackEnd
  ☆26Updated 2 years ago
• jina-ai / jerboa
  LLM finetuning
  ☆42Updated 2 years ago
• mzbac / mlx-moe
  Scripts to create your own moe models using mlx
  ☆90Updated last year
• catena-labs / moa-llm
  A Python library to orchestrate LLMs in a neural network-inspired structure
  ☆51Updated 10 months ago
• OpenAgentLLM / OpenAgent
  🔓 The open-source autonomous agent LLM initiative 🔓
  ☆91Updated last year
• lightblue-tech / lb-reranker
  ☆23Updated 6 months ago
• log10-io / log10
  Python client library for improving your LLM app accuracy
  ☆98Updated 6 months ago
• katanaml / llm-rag-invoice-cpu
  Data extraction with LLM on CPU
  ☆68Updated last year
• simonw / llm-embed-jina
  Embedding models from Jina AI
  ☆64Updated last year