xorbitsai / xoscarLinks
Python actor framework for heterogeneous computing.
☆155Updated this week
Alternatives and similar repositories for xoscar
Users that are interested in xoscar are comparing it to the libraries listed below
Sorting:
- A pydantic based python ORM framework for graph database NebulaGraph 3.☆46Updated 9 months ago
- Byzer-retrieval is a distributed retrieval system which designed as a backend for LLM RAG (Retrieval Augmented Generation). The system su…☆48Updated 5 months ago
- ☆111Updated last year
- Open-source observability for your LLM application.☆53Updated 7 months ago
- Autoscale LLM (vLLM, SGLang, LMDeploy) inferences on Kubernetes (and others)☆270Updated last year
- A lightweight version of Milvus☆355Updated last week
- an MLOps/LLMOps platform☆229Updated 7 months ago
- Awesome multilingual OCR toolkits based on PaddlePaddle (practical ultra lightweight OCR system, support 80+ languages recognition, provi…☆38Updated 4 months ago
- a local implementation of OpenAI Assistants API: myla stands for MY Local Assistant☆55Updated 11 months ago
- Mobius is an AI infrastructure platform for distributed online learning, including online sample processing, training and serving.☆98Updated last year
- A high-performance inference system for large language models, designed for production environments.☆459Updated 2 weeks ago
- ☆24Updated last year
- Lyric: A Rust-powered secure runtime for AI-Agent.☆23Updated 4 months ago
- Pretrain, finetune and serve LLMs on Intel platforms with Ray☆128Updated this week
- Ray is an AI compute engine. Ray consists of a core distributed runtime and a set of AI Libraries for accelerating ML workloads. AntRay i…☆136Updated this week
- AI Native database for embedding vectors☆173Updated 9 months ago
- Easy, fast, and cheap pretrain,finetune, serving for everyone☆313Updated 3 weeks ago
- Rayvens makes it possible for data scientists to access hundreds of data services within Ray with little effort.☆50Updated 2 years ago
- Framework for benchmarking fully-managed vector databases☆80Updated 10 months ago
- Yet another coding assistant powered by LLM.☆16Updated 10 months ago
- This repository contains statistics about the AI Infrastructure products.☆18Updated 5 months ago
- The driver for LMCache core to run in vLLM☆45Updated 6 months ago
- A simple service that integrates vLLM with Ray Serve for fast and scalable LLM serving.☆69Updated last year
- llm-inference is a platform for publishing and managing llm inference, providing a wide range of out-of-the-box features for model deploy…☆85Updated last year
- TiDB Vector SDK for Python, including code examples. Join our Discord: https://discord.gg/XzSW23Jg9p☆59Updated 3 weeks ago
- OpenAI compatible API for LLMs and embeddings (LLaMA, Vicuna, ChatGLM and many others)☆275Updated last year
- Ray - A curated list of resources: https://github.com/ray-project/ray☆66Updated last month
- Turn PostgreSQL into your search engine in a Pythonic way.☆47Updated this week
- Python fast on-disk dictionary / RocksDB & SpeeDB Python binding☆241Updated 2 months ago
- A diverse, simple, and secure all-in-one LLMOps platform☆107Updated 10 months ago