Alternatives and similar repositories for nos

Users that are interested in nos are comparing it to the libraries listed below

• deployradiant / pychatml
  Chat Markup Language conversation library
  ☆55Updated last year
• Preemo-Inc / text-generation-inference
  ☆199Updated last year
• DeployQL / LintDB
  Vector Database with support for late interaction and token level embeddings.
  ☆55Updated last week
• sumo43 / loopvlm
  run paligemma in real time
  ☆131Updated last year
• mixedbread-ai / batched
  The Batched API provides a flexible and efficient way to process multiple requests in a batch, with a primary focus on dynamic batching o…
  ☆137Updated last month
• dstackai / gpuhunt
  GPU prices aggregator for cloud providers
  ☆39Updated this week
• redotvideo / pluto
  Synthetic Data for LLM Fine-Tuning
  ☆119Updated last year
• premAI-io / benchmarks
  🕹️ Performance Comparison of MLOps Engines, Frameworks, and Languages on Mainstream AI Models.
  ☆137Updated 11 months ago
• log10-io / log10
  Python client library for improving your LLM app accuracy
  ☆98Updated 4 months ago
• kolinko / effort
  An implementation of bucketMul LLM inference
  ☆218Updated 11 months ago
• cognitivecomputations / kraken
  ☆66Updated last year
• multiplexerai / Complex-to-Simple-RAG
  ☆38Updated last year
• aniketmaurya / fastserve-ai
  Machine Learning Serving focused on GenAI with simplicity as the top priority.
  ☆59Updated 2 months ago
• cohere-ai / BinaryVectorDB
  Efficient vector database for hundred millions of embeddings.
  ☆206Updated last year
• Trainy-ai / llm-atc
  Fine-tuning and serving LLMs on any cloud
  ☆90Updated last year
• automorphic-ai / trex
  Enforce structured output from LLMs 100% of the time
  ☆249Updated 11 months ago
• pyember / ember
  ☆182Updated 2 months ago
• migtissera / Sensei
  Generate Synthetic Data Using OpenAI, MistralAI or AnthropicAI
  ☆221Updated last year
• mobiusml / aana_sdk
  Aana SDK is a powerful framework for building AI enabled multimodal applications.
  ☆47Updated last week
• modal-labs / awesome-modal
  A curated list of amazingly awesome Modal applications, demos, and shiny things. Inspired by awesome-php.
  ☆151Updated last week
• jlewi / foyle
  Foyle is a copilot to help developers deploy and operate their applications.
  ☆130Updated 3 months ago
• r2d4 / parserllm
  Use context-free grammars with an LLM
  ☆170Updated last year
• FL33TW00D / embd
  GPU accelerated client-side embeddings for vector search, RAG etc.
  ☆66Updated last year
• willccbb / mlx_parallm
  Fast parallel LLM inference for MLX
  ☆193Updated 11 months ago
• interlocklabs / trellis
  A simple DAG for executing LLM calls and using tools.
  ☆41Updated last year
• Ziems / arbor
  A framework for optimizing DSPy programs with RL
  ☆76Updated this week
• sdan / selfextend
  an implementation of Self-Extend, to expand the context window via grouped attention
  ☆118Updated last year
• 4dh / GRDN
  GRDN.AI app for garden optimization
  ☆70Updated last year
• michaelthwan / llm_family_chart
  LLM family chart
  ☆51Updated last year
• danielgross / ggml-k8s
  Run GGML models with Kubernetes.
  ☆173Updated last year