xorbitsai / xoscarLinks
Python actor framework for heterogeneous computing.
☆169Updated 3 weeks ago
Alternatives and similar repositories for xoscar
Users that are interested in xoscar are comparing it to the libraries listed below
Sorting:
- Awesome multilingual OCR toolkits based on PaddlePaddle (practical ultra lightweight OCR system, support 80+ languages recognition, provi…☆41Updated 9 months ago
- Open-source observability for your LLM application.☆53Updated last year
- Autoscale LLM (vLLM, SGLang, LMDeploy) inferences on Kubernetes (and others)☆279Updated 2 years ago
- The driver for LMCache core to run in vLLM☆59Updated 11 months ago
- ☆114Updated last year
- A lightweight version of Milvus☆418Updated this week
- Byzer-retrieval is a distributed retrieval system which designed as a backend for LLM RAG (Retrieval Augmented Generation). The system su…☆49Updated 10 months ago
- an MLOps/LLMOps platform☆234Updated last year
- Pretrain, finetune and serve LLMs on Intel platforms with Ray☆131Updated 3 months ago
- A Cloud-Native WAL Storage Implementation☆72Updated 2 weeks ago
- llm-inference is a platform for publishing and managing llm inference, providing a wide range of out-of-the-box features for model deploy…☆90Updated last year
- Ray - A curated list of resources: https://github.com/ray-project/ray☆77Updated 2 months ago
- A high-performance inference system for large language models, designed for production environments.☆489Updated 3 weeks ago
- A library integrating embedding and reranker models from OpenAI, SentenceTransformers etc for semantic search in vector database.☆58Updated 9 months ago
- Framework for benchmarking fully-managed vector databases☆80Updated last year
- Simple, lightweight, extensible DAG framework for Python with a Kubeflow-like API☆82Updated last year
- Python code sandbox with programmatic MCP tool calling for AI agents☆57Updated 2 weeks ago
- Mobius is an AI infrastructure platform for distributed online learning, including online sample processing, training and serving.☆99Updated last year
- TiDB Vector SDK for Python, including code examples. Join our Discord: https://discord.gg/XzSW23Jg9p☆61Updated 5 months ago
- ☆24Updated 2 years ago
- A Python package that parses sql and converts it to ibis expressions☆56Updated 2 years ago
- Ray is an AI compute engine. Ray consists of a core distributed runtime and a set of AI Libraries for accelerating ML workloads. AntRay i…☆162Updated this week
- A simple service that integrates vLLM with Ray Serve for fast and scalable LLM serving.☆78Updated last year
- AI Native database for embedding vectors☆175Updated last year
- Distributed data mesh for real-time access, migration, and replication across diverse databases — built for AI, security, and scale.☆75Updated last month
- Python fast on-disk dictionary / RocksDB & SpeeDB Python binding☆275Updated 3 weeks ago
- Easy, fast, and cheap pretrain,finetune, serving for everyone☆315Updated 5 months ago
- DuckDB 3FS Extension☆38Updated 7 months ago
- Tune efficiently any LLM model from HuggingFace using distributed training (multiple GPU) and DeepSpeed. Uses Ray AIR to orchestrate the …☆60Updated 2 years ago
- Lyric: A Rust-powered secure runtime for AI-Agent.☆24Updated 10 months ago