Alternatives and similar repositories for nos

Users that are interested in nos are comparing it to the libraries listed below

• Preemo-Inc / text-generation-inference
  ☆198Updated last year
• NousResearch / Obsidian
  Maybe the new state of the art vision model? we'll see 🤷‍♂️
  ☆163Updated last year
• sumo43 / loopvlm
  run paligemma in real time
  ☆131Updated last year
• DeployQL / LintDB
  Vector Database with support for late interaction and token level embeddings.
  ☆54Updated 8 months ago
• premAI-io / benchmarks
  🕹️ Performance Comparison of MLOps Engines, Frameworks, and Languages on Mainstream AI Models.
  ☆137Updated 10 months ago
• npi-ai / npi
  Action library for AI Agent
  ☆214Updated 2 months ago
• sdan / selfextend
  an implementation of Self-Extend, to expand the context window via grouped attention
  ☆119Updated last year
• deepsilicon / Sila
  ☆89Updated 8 months ago
• danielgross / ggml-k8s
  Run GGML models with Kubernetes.
  ☆172Updated last year
• kolinko / effort
  An implementation of bucketMul LLM inference
  ☆217Updated 11 months ago
• migtissera / Sensei
  Generate Synthetic Data Using OpenAI, MistralAI or AnthropicAI
  ☆222Updated last year
• titanml / takeoff-community
  TitanML Takeoff Server is an optimization, compression and deployment platform that makes state of the art machine learning models access…
  ☆114Updated last year
• multiplexerai / Complex-to-Simple-RAG
  ☆39Updated last year
• willccbb / mlx_parallm
  Fast parallel LLM inference for MLX
  ☆189Updated 10 months ago
• michaelthwan / llm_family_chart
  LLM family chart
  ☆51Updated last year
• deployradiant / pychatml
  Chat Markup Language conversation library
  ☆55Updated last year
• modal-labs / awesome-modal
  A curated list of amazingly awesome Modal applications, demos, and shiny things. Inspired by awesome-php.
  ☆143Updated last week
• 4dh / GRDN
  GRDN.AI app for garden optimization
  ☆70Updated last year
• epolewski / EricLLM
  A fast batching API to serve LLM models
  ☆181Updated last year
• Trainy-ai / llm-atc
  Fine-tuning and serving LLMs on any cloud
  ☆90Updated last year
• artas728 / spelltest
  AI-to-AI Testing | Simulation framework for LLM-based applications
  ☆137Updated last year
• Vaibhavs10 / fast-llm.rs
  ☆137Updated last year
• itsPreto / VECTR8
  Embed anything.
  ☆28Updated last year
• pixeltable / pixeltable
  Pixeltable — AI Data infrastructure providing a declarative, incremental approach for multimodal workloads.
  ☆241Updated this week
• aniketmaurya / fastserve-ai
  Machine Learning Serving focused on GenAI with simplicity as the top priority.
  ☆58Updated last month
• mixedbread-ai / batched
  The Batched API provides a flexible and efficient way to process multiple requests in a batch, with a primary focus on dynamic batching o…
  ☆136Updated 2 weeks ago
• log10-io / log10
  Python client library for improving your LLM app accuracy
  ☆98Updated 3 months ago
• teknium1 / ShareGPT-Builder
  ☆114Updated 5 months ago
• mistralai / vllm-release
  A high-throughput and memory-efficient inference and serving engine for LLMs
  ☆52Updated last year
• jlscheerer / xtr-warp
  XTR/WARP (SIGIR'25) is an extremely fast and accurate retrieval engine based on Stanford's ColBERTv2/PLAID and Google DeepMind's XTR.
  ☆130Updated last month