Alternatives and similar repositories for text-inference-batcher:

Users that are interested in text-inference-batcher are comparing it to the libraries listed below

• enjalot / latent-data-modal
  Using modal.com to process FineWeb-edu data
  ☆20Updated last week
• chimezie / mlx-tuning-fork
  Very basic framework for composable parameterized large language model (Q)LoRA / (Q)Dora fine-tuning using mlx, mlx_lm, and OgbujiPT.
  ☆38Updated last month
• aigeek0x0 / radiantloom-email-assist-7b
  Radiantloom Email Assist 7B is an email-assistant large language model fine-tuned from Zephyr-7B-Beta, over a custom-curated dataset of 1…
  ☆14Updated last year
• charmandercha / ArchiDoc
  ☆17Updated 4 months ago
• nicholasyager / llama-cpp-guidance
  A guidance compatibility layer for llama-cpp-python
  ☆34Updated last year
• itsPreto / VECTR8
  Embed anything.
  ☆29Updated 10 months ago
• swyxio / openlangmem
  ☆47Updated last year
• jmanhype / dspy-self-discover-framework
  Leveraging DSPy for AI-driven task understanding and solution generation, the Self-Discover Framework automates problem-solving through r…
  ☆60Updated 8 months ago
• multiplexerai / mplx_rag
  Complex RAG backend
  ☆28Updated last year
• catena-labs / moa-llm
  A Python library to orchestrate LLMs in a neural network-inspired structure
  ☆46Updated 6 months ago
• shivamsanju / ragswift
  🚀 Scale your RAG pipeline using Ragswift: A scalable centralized embeddings management platform
  ☆38Updated last year
• cognitivecomputations / kraken
  ☆66Updated 10 months ago
• kyegomez / Exa
  Unleash the full potential of exascale LLMs on consumer-class GPUs, proven by extensive benchmarks, with no long-term adjustments and min…
  ☆26Updated 5 months ago
• gaborvecsei / Prometh-Review
  AI Pull-Request Reviewer Companion (in the command line)
  ☆13Updated last year
• Xalp / ECHO
  Official homepage for "Self-Harmonized Chain of Thought" (NAACL 2025)
  ☆90Updated 2 months ago
• tom-doerr / awesome-dspy
  ☆16Updated 11 months ago
• yoheinakajima / autofinetune
  auto fine tune of models with synthetic data
  ☆75Updated last year
• vintrocode / curation-buddy
  Don't bug your friends with articles they'll never read. AI's have infinite attention, leverage them instead! Use the curation buddy to e…
  ☆22Updated 11 months ago
• raphaelmansuy / iteration_of_tought
  Example implementation of Iteration of Tought - Gives a star if you like the project
  ☆40Updated 3 months ago
• Prismadic / magnet
  the small distributed language model toolkit; fine-tune state-of-the-art LLMs anywhere, rapidly
  ☆31Updated 5 months ago
• logankeenan / george
  George is an API leveraging AI to make it easy to control a computer with natural language.
  ☆44Updated 3 months ago
• pipizhaoa / Pandalyst
  large language model for mastering data analysis using pandas
  ☆47Updated last year
• BBischof / yapping
  Verbosity control for AI agents
  ☆61Updated 10 months ago
• lightblue-tech / lb-reranker
  ☆22Updated 2 months ago
• hwchase17 / chain-of-verification
  ☆32Updated last year
• Attunewise / GPT
  OpenAI GPT hosted Agent Framework for Windows and MacOS
  ☆36Updated 9 months ago
• SohamGovande / podplex
  🦾💻🌐 distributed training & serverless inference at scale on RunPod
  ☆17Updated 10 months ago
• noco-ai / spellbook-ui
  ☆16Updated last year
• The-Swarm-Corporation / swarm-ecosystem
  The Swarm Ecosystem
  ☆20Updated 8 months ago
• nexusflowai / nexusraven-pip
  ☆38Updated last year