Alternatives and similar repositories for text-inference-batcher:

Users that are interested in text-inference-batcher are comparing it to the libraries listed below

• enjalot / latent-data-modal
  Using modal.com to process FineWeb-edu data
  ☆20Updated 2 weeks ago
• multiplexerai / mplx_rag
  Complex RAG backend
  ☆28Updated 11 months ago
• yoheinakajima / autofinetune
  auto fine tune of models with synthetic data
  ☆75Updated last year
• chimezie / mlx-tuning-fork
  Very basic framework for composable parameterized large language model (Q)LoRA / (Q)Dora fine-tuning using mlx, mlx_lm, and OgbujiPT.
  ☆37Updated last month
• itsPreto / VECTR8
  Embed anything.
  ☆29Updated 9 months ago
• SLAM-group / newhope
  ☆22Updated last year
• nicholasyager / llama-cpp-guidance
  A guidance compatibility layer for llama-cpp-python
  ☆34Updated last year
• swyxio / openlangmem
  ☆47Updated 11 months ago
• aigeek0x0 / radiantloom-email-assist-7b
  Radiantloom Email Assist 7B is an email-assistant large language model fine-tuned from Zephyr-7B-Beta, over a custom-curated dataset of 1…
  ☆14Updated last year
• cognitivecomputations / kraken
  ☆65Updated 9 months ago
• cognitivecomputations / agenticworker
  ☆23Updated 4 months ago
• catena-labs / moa-llm
  A Python library to orchestrate LLMs in a neural network-inspired structure
  ☆46Updated 5 months ago
• shivamsanju / ragswift
  🚀 Scale your RAG pipeline using Ragswift: A scalable centralized embeddings management platform
  ☆37Updated last year
• lightblue-tech / lb-reranker
  ☆20Updated last month
• vintrocode / curation-buddy
  Don't bug your friends with articles they'll never read. AI's have infinite attention, leverage them instead! Use the curation buddy to e…
  ☆22Updated 10 months ago
• multiplexerai / Complex-to-Simple-RAG
  ☆39Updated last year
• teknium1 / ShareGPT-Builder
  ☆111Updated 3 months ago
• hwchase17 / chain-of-verification
  ☆30Updated last year
• charmandercha / ArchiDoc
  ☆17Updated 3 months ago
• mshumer / portal
  ☆29Updated 3 months ago
• WismutHansen / READ2ME
  Turn text from websites into spoken audio with edge-tts, F5, etc. and save as mp3 files
  ☆45Updated 3 weeks ago
• nath1295 / MLX-Textgen
  A python package for serving LLM on OpenAI-compatible API endpoints with prompt caching using MLX.
  ☆73Updated 3 months ago
• Attunewise / GPT
  OpenAI GPT hosted Agent Framework for Windows and MacOS
  ☆36Updated 8 months ago
• jmanhype / dspy-self-discover-framework
  Leveraging DSPy for AI-driven task understanding and solution generation, the Self-Discover Framework automates problem-solving through r…
  ☆60Updated 8 months ago
• jquesnelle / literAI
  Generate visual podcasts about novels using open source models
  ☆25Updated 2 years ago
• Not-Diamond / RoRF
  Routing on Random Forest (RoRF)
  ☆135Updated 5 months ago
• mithril-security / blind_llama_client
  Zero-trust AI APIs for easy and private consumption of open-source LLMs
  ☆38Updated 7 months ago
• the-crypt-keeper / the-muse
  Experimental sampler to make LLMs more creative
  ☆30Updated last year
• taylorai / onnx_embedding_models
  utilities for loading and running text embeddings with onnx
  ☆44Updated 7 months ago