xorbitsai / xoscarLinks
Python actor framework for heterogeneous computing.
☆170Updated last week
Alternatives and similar repositories for xoscar
Users that are interested in xoscar are comparing it to the libraries listed below
Sorting:
- A pydantic based python ORM framework for graph database NebulaGraph 3.☆52Updated last year
- A lightweight version of Milvus☆419Updated 3 weeks ago
- Byzer-retrieval is a distributed retrieval system which designed as a backend for LLM RAG (Retrieval Augmented Generation). The system su…☆49Updated 10 months ago
- Autoscale LLM (vLLM, SGLang, LMDeploy) inferences on Kubernetes (and others)☆279Updated 2 years ago
- Mobius is an AI infrastructure platform for distributed online learning, including online sample processing, training and serving.☆99Updated last year
- Open-source observability for your LLM application.☆53Updated last year
- A streamlined, user-friendly JSON streaming preprocessor, crafted in Python.☆115Updated last year
- Ray is an AI compute engine. Ray consists of a core distributed runtime and a set of AI Libraries for accelerating ML workloads. AntRay i…☆164Updated this week
- A Cloud-Native WAL Storage Implementation☆76Updated this week
- Python code execution sandbox with programmatic MCP tool calling (PTC)☆62Updated last week
- ☆114Updated last year
- an MLOps/LLMOps platform☆236Updated last year
- llm-inference is a platform for publishing and managing llm inference, providing a wide range of out-of-the-box features for model deploy…☆91Updated last year
- Pretrain, finetune and serve LLMs on Intel platforms with Ray☆131Updated 4 months ago
- A library integrating embedding and reranker models from OpenAI, SentenceTransformers etc for semantic search in vector database.☆59Updated 10 months ago
- Awesome multilingual OCR toolkits based on PaddlePaddle (practical ultra lightweight OCR system, support 80+ languages recognition, provi…☆41Updated 10 months ago
- Rayvens makes it possible for data scientists to access hundreds of data services within Ray with little effort.☆50Updated 3 years ago
- Ray - A curated list of resources: https://github.com/ray-project/ray☆79Updated 3 months ago
- A simple service that integrates vLLM with Ray Serve for fast and scalable LLM serving.☆78Updated last year
- The driver for LMCache core to run in vLLM☆60Updated 11 months ago
- A high-performance inference system for large language models, designed for production environments.☆491Updated last month
- Framework for benchmarking fully-managed vector databases☆80Updated last year
- ☆222Updated 2 years ago
- TiDB Vector SDK for Python, including code examples. Join our Discord: https://discord.gg/XzSW23Jg9p☆61Updated 6 months ago
- Examples on how to use LangChain and Ray☆233Updated 2 years ago
- Apache Pulsar Python client library☆74Updated this week
- AI Native database for embedding vectors☆175Updated last year
- DuckDB 3FS Extension☆38Updated 8 months ago
- Easy, fast, and cheap pretrain,finetune, serving for everyone☆315Updated 6 months ago
- The integration of HugeGraph with AI/LLM & GraphRAG☆115Updated last month