Alternatives and similar repositories for nos:

Users that are interested in nos are comparing it to the libraries listed below

• sumo43 / loopvlm
  run paligemma in real time
  ☆131Updated 10 months ago
• Preemo-Inc / text-generation-inference
  ☆199Updated last year
• deepsilicon / Sila
  ☆89Updated 5 months ago
• DeployQL / LintDB
  Vector Database with support for late interaction and token level embeddings.
  ☆53Updated 5 months ago
• mzbac / mlx-lora
  ☆38Updated last year
• modal-labs / awesome-modal
  A curated list of amazingly awesome Modal applications, demos, and shiny things. Inspired by awesome-php.
  ☆124Updated last week
• interlocklabs / trellis
  A simple DAG for executing LLM calls and using tools.
  ☆41Updated last year
• deployradiant / pychatml
  Chat Markup Language conversation library
  ☆55Updated last year
• mobiusml / aana_sdk
  Aana SDK is a powerful framework for building AI enabled multimodal applications.
  ☆43Updated last week
• mustafaaljadery / mlxserver
  Start a server from the MLX library.
  ☆182Updated 7 months ago
• Trainy-ai / llm-atc
  Fine-tuning and serving LLMs on any cloud
  ☆89Updated last year
• 4dh / GRDN
  GRDN.AI app for garden optimization
  ☆70Updated last year
• RichardKelley / dendron
  A library for building software agents using behavior trees and language models.
  ☆80Updated last month
• Not-Diamond / RoRF
  Routing on Random Forest (RoRF)
  ☆135Updated 6 months ago
• log10-io / log10
  Python client library for improving your LLM app accuracy
  ☆97Updated last month
• pixeltable / pixeltable
  Pixeltable — AI Data infrastructure providing a declarative, incremental approach for multimodal workloads.
  ☆164Updated this week
• premAI-io / benchmarks
  🕹️ Performance Comparison of MLOps Engines, Frameworks, and Languages on Mainstream AI Models.
  ☆136Updated 7 months ago
• mixedbread-ai / batched
  The Batched API provides a flexible and efficient way to process multiple requests in a batch, with a primary focus on dynamic batching o…
  ☆125Updated 3 months ago
• automorphic-ai / trex
  Enforce structured output from LLMs 100% of the time
  ☆248Updated 8 months ago
• virevolai / logos-shift-client
  Replace expensive LLM calls with finetunes automatically
  ☆65Updated last year
• kolinko / effort
  An implementation of bucketMul LLM inference
  ☆215Updated 8 months ago
• epolewski / EricLLM
  A fast batching API to serve LLM models
  ☆182Updated 10 months ago
• trzy / llava-cpp-server
  LLaVA server (llama.cpp).
  ☆178Updated last year
• npi-ai / npi
  Action library for AI Agent
  ☆211Updated this week
• sdan / selfextend
  an implementation of Self-Extend, to expand the context window via grouped attention
  ☆118Updated last year
• multiplexerai / Complex-to-Simple-RAG
  ☆39Updated last year
• IntrinsicLabsAI / gbnfgen
  TypeScript generator for llama.cpp Grammar directly from TypeScript interfaces
  ☆135Updated 8 months ago
• AnswerDotAI / fastdata
  ☆150Updated 3 months ago
• michaelfeil / embed
  A stable, fast and easy-to-use inference library with a focus on a sync-to-async API
  ☆45Updated 5 months ago
• mgerstgrasser / tacheles
  a lightweight, open-source blueprint for building powerful and scalable LLM chat applications
  ☆30Updated 9 months ago