Alternatives and similar repositories for text-inference-batcher

Users that are interested in text-inference-batcher are comparing it to the libraries listed below

• nicholasyager / llama-cpp-guidance
  A guidance compatibility layer for llama-cpp-python
  ☆35Updated last year
• enjalot / latent-data-modal
  Using modal.com to process FineWeb-edu data
  ☆20Updated 2 months ago
• chimezie / mlx-tuning-fork
  Very basic framework for composable parameterized large language model (Q)LoRA / (Q)Dora fine-tuning using mlx, mlx_lm, and OgbujiPT.
  ☆40Updated last week
• multiplexerai / mplx_rag
  Complex RAG backend
  ☆28Updated last year
• charmandercha / ArchiDoc
  ☆17Updated 6 months ago
• swyxio / openlangmem
  ☆47Updated last year
• 4dh / GRDN
  GRDN.AI app for garden optimization
  ☆70Updated last year
• itsPreto / VECTR8
  Embed anything.
  ☆28Updated last year
• catena-labs / moa-llm
  A Python library to orchestrate LLMs in a neural network-inspired structure
  ☆49Updated 8 months ago
• cognitivecomputations / kraken
  ☆66Updated last year
• michaelfeil / embed
  A stable, fast and easy-to-use inference library with a focus on a sync-to-async API
  ☆45Updated 8 months ago
• aigeek0x0 / radiantloom-email-assist-7b
  Radiantloom Email Assist 7B is an email-assistant large language model fine-tuned from Zephyr-7B-Beta, over a custom-curated dataset of 1…
  ☆14Updated last year
• yoheinakajima / autofinetune
  auto fine tune of models with synthetic data
  ☆75Updated last year
• OpenAgentLLM / OpenAgent
  🔓 The open-source autonomous agent LLM initiative 🔓
  ☆91Updated last year
• shivamsanju / ragswift
  🚀 Scale your RAG pipeline using Ragswift: A scalable centralized embeddings management platform
  ☆38Updated last year
• cognitivecomputations / agenticworker
  ☆23Updated 7 months ago
• Maximilian-Winter / llama_cpp_function_calling
  ☆31Updated last year
• BBischof / yapping
  Verbosity control for AI agents
  ☆63Updated last year
• teknium1 / ShareGPT-Builder
  ☆114Updated 6 months ago
• martinbowling / thoughtful-lightning
  Thoughtful Lightning AI Assistant - Dual-engine system with DeepSeek reasoning and Groq inference, featuring Gradio UI, secure API manage…
  ☆20Updated 5 months ago
• deployradiant / pychatml
  Chat Markup Language conversation library
  ☆55Updated last year
• teleprint-me / py.gpt.prompt
  PyGPTPrompt: A CLI tool that manages context windows for AI models, facilitating user interaction and data ingestion for optimized long-t…
  ☆29Updated last year
• abacaj / openhermes-function-calling
  ☆135Updated last year
• monk1337 / auto-ollama
  run ollama & gguf easily with a single command
  ☆51Updated last year
• OpenAccess-AI-Collective / servereless-runpod-ggml
  ☆55Updated 2 years ago
• louisbrulenaudet / ragoon
  High level library for batched embeddings generation, blazingly-fast web-based RAG and quantized indexes processing ⚡
  ☆66Updated 7 months ago
• mzbac / mlx-lora
  ☆38Updated last year
• FanaHOVA / openai-o1-code-interpreter
  Code interpreter support for o1
  ☆32Updated 9 months ago
• MaximeRivest / funnydspy
  Vanilla-Python ergonomics on top of DSPy
  ☆31Updated 2 weeks ago
• tom-doerr / awesome-dspy
  ☆18Updated last year