tensorchord / openmodelz

Related projects ⓘ

Alternatives and complementary repositories for openmodelz

• tensorchord / modelz-llm
  OpenAI compatible API for LLMs and embeddings (LLaMA, Vicuna, ChatGLM and many others)
  ☆265Updated last year
• index-labs / evalgpt
  EvalGPT is an code interpreter framework that utilizes large language models to automate the process of code-writing and execution, deliv…
  ☆252Updated last year
• vtuber-plan / olah
  Self-hosted huggingface mirror service.
  ☆79Updated last week
• jina-ai / rungpt
  An open-source cloud-native of large multi-modal models (LMMs) serving framework.
  ☆155Updated last year
• myscale / myscale-telemetry
  Open-source observability for your LLM application.
  ☆44Updated 3 weeks ago
• tensorchord / ai-infra-landscape
  This is a landscape of the infrastructure that powers the generative AI ecosystem
  ☆130Updated last month
• intel / llm-on-ray
  Pretrain, finetune and serve LLMs on Intel platforms with Ray
  ☆103Updated last week
• kubeagi / arcadia
  A diverse, simple, and secure all-in-one LLMOps platform
  ☆86Updated 2 months ago
• myscale / ChatData
  ChatData 🔍 📖 brings RAG to real applications with FREE✨ knowledge bases. Now enjoy your chat with 6 million wikipedia pages and 2 milli…
  ☆155Updated last week
• neural-maze / talking_with_hn
  The full experience of chatting with your favourite news website.
  ☆109Updated 11 months ago
• leptonai / gpud
  ☆214Updated this week
• dbpunk-labs / octogen
  Octogen is an Open-Source Code Interpreter Agent Framework
  ☆254Updated 3 months ago
• milvus-io / milvus-lite
  A lightweight version of Milvus
  ☆280Updated this week
• redis / redis-vl-python
  Redis Vector Library (RedisVL) interfaces with Redis' vector database for realtime semantic search, RAG, and recommendation systems.
  ☆234Updated this week
• log10-io / log10
  Python client library for improving your LLM app accuracy
  ☆96Updated this week
• ray-project / langchain-ray
  Examples on how to use LangChain and Ray
  ☆221Updated last year
• OpenRouterTeam / openrouter-runner
  Inference engine powering open source models on OpenRouter
  ☆588Updated 4 months ago
• pingcap / autoflow
  pingcap/autoflow is a Graph RAG based and conversational knowledge base tool built with TiDB Serverless Vector Storage. Demo: https://tid…
  ☆204Updated this week
• ray-project / llmperf
  LLMPerf is a library for validating and benchmarking LLMs
  ☆645Updated 3 months ago
• shroominic / codebox-api
  👾📦 CodeBoxAPI is the simplest sandboxing infrastructure for your LLM Apps and Services.
  ☆316Updated 2 weeks ago
• redis-developer / LLM-Document-Chat
  Using LlamaIndex, Redis, and OpenAI to chat with PDF documents. Supplementary material for blog post on Microsoft Developer Blog
  ☆108Updated last year
• pandodao / botastic
  An AI framework for building cool things.
  ☆210Updated last year
• aniketmaurya / fastserve-ai
  Machine Learning Serving focused on GenAI with simplicity as the top priority.
  ☆57Updated 4 months ago
• mshumer / anthropic_with_functions
  ☆194Updated last year
• muyuworks / myla
  a local implementation of OpenAI Assistants API: myla stands for MY Local Assistant
  ☆50Updated 2 months ago
• ninehills / LLM-Fusion-API
  ☆32Updated 9 months ago
• BerriAI / liteLLM-proxy
  ☆123Updated 9 months ago
• karminski / streaming-json-py
  A streamlined, user-friendly JSON streaming preprocessor, crafted in Python.
  ☆75Updated 2 months ago
• intergalacticalvariable / reader
  📚 This is an adapted version of Jina AI's Reader for local deployment using Docker. Convert any URL to an LLM-friendly input with a simp…
  ☆56Updated last month
• triton-inference-server / vllm_backend
  ☆191Updated this week