xorbitsai / xoscar
Python actor framework for heterogeneous computing.
☆149Updated this week
Alternatives and similar repositories for xoscar
Users that are interested in xoscar are comparing it to the libraries listed below
Sorting:
- A pydantic based python ORM framework for graph database NebulaGraph 3.☆44Updated 6 months ago
- Open-source observability for your LLM application.☆51Updated 4 months ago
- ☆108Updated last year
- A lightweight version of Milvus☆326Updated last week
- A high-performance inference system for large language models, designed for production environments.☆437Updated this week
- Pretrain, finetune and serve LLMs on Intel platforms with Ray☆126Updated 2 weeks ago
- Byzer-retrieval is a distributed retrieval system which designed as a backend for LLM RAG (Retrieval Augmented Generation). The system su…☆48Updated 2 months ago
- Python 数据科学加速:Dask、Ray、Xorbits、mpi4py☆61Updated 3 months ago
- Easy, fast, and cheap pretrain,finetune, serving for everyone☆295Updated last month
- Mobius is an AI infrastructure platform for distributed online learning, including online sample processing, training and serving.☆97Updated 10 months ago
- LM inference server implementation based on *.cpp.☆185Updated this week
- The driver for LMCache core to run in vLLM☆39Updated 3 months ago
- A high-performance, extensible Python AOT compiler.☆424Updated last year
- Formatron empowers everyone to control the format of language models' output with minimal overhead.☆197Updated 4 months ago
- Pond is a high performance object-pooling library for Python☆55Updated last year
- Comparison of Language Model Inference Engines☆217Updated 4 months ago
- Mixture-of-Experts (MoE) Language Model☆186Updated 8 months ago
- Framework for benchmarking fully-managed vector databases☆78Updated 7 months ago
- An enterprise-grade AI retriever designed to streamline AI integration into your applications, ensuring cutting-edge accuracy.☆284Updated 2 weeks ago
- Multi-Faceted AI Agent and Workflow Autotuning. Automatically optimizes LangChain, LangGraph, DSPy programs for better quality, lower exe…☆229Updated last month
- Awesome multilingual OCR toolkits based on PaddlePaddle (practical ultra lightweight OCR system, support 80+ languages recognition, provi…☆36Updated last month
- A library integrating embedding and reranker models from OpenAI, SentenceTransformers etc for semantic search in vector database.☆40Updated last month
- high performance in-memory cache☆393Updated this week
- ER model friendly data composition tool☆238Updated last week
- Simple, lightweight, extensible DAG framework for Python with a Kubeflow-like API☆79Updated last year
- Lyric: A Rust-powered secure runtime for AI-Agent.☆19Updated 2 months ago
- Python fast on-disk dictionary / RocksDB & SpeeDB Python binding☆220Updated 2 weeks ago
- Efficient and easy multi-instance LLM serving☆404Updated this week
- Ray is an AI compute engine. Ray consists of a core distributed runtime and a set of AI Libraries for accelerating ML workloads. AntRay i…☆122Updated this week
- a local implementation of OpenAI Assistants API: myla stands for MY Local Assistant☆54Updated 8 months ago