xorbitsai / xoscar
Python actor framework for heterogeneous computing.
☆105Updated this week
Related projects ⓘ
Alternatives and complementary repositories for xoscar
- ☆100Updated 7 months ago
- Byzer-retrieval is a distributed retrieval system which designed as a backend for LLM RAG (Retrieval Augmented Generation). The system su…☆43Updated 8 months ago
- Easy, fast, and cheap pretrain,finetune, serving for everyone☆263Updated 2 weeks ago
- Open-source observability for your LLM application.☆45Updated last month
- A high-performance inference system for large language models, designed for production environments.☆393Updated this week
- A pydantic based python ORM framework for graph database NebulaGraph 3.☆42Updated last month
- llm-inference is a platform for publishing and managing llm inference, providing a wide range of out-of-the-box features for model deploy…☆70Updated 6 months ago
- greptime instrument sdk for popular LLM (LangChain, OpenAI, etc.)☆13Updated 6 months ago
- a local implementation of OpenAI Assistants API: myla stands for MY Local Assistant☆50Updated 2 months ago
- Pretrain, finetune and serve LLMs on Intel platforms with Ray☆103Updated last week
- A lightweight version of Milvus☆281Updated this week
- an MLOps/LLMOps platform☆209Updated 3 months ago
- Yet another coding assistant powered by LLM.☆12Updated 2 months ago
- ☆35Updated this week
- Hyperparameter, Make configurable AI applications.Build for Python hackers.☆23Updated 5 months ago
- The ChatGPT plugin to enhance OpenMLDB.☆51Updated last year
- Mobius is an AI infrastructure platform for distributed online learning, including online sample processing, training and serving.☆90Updated 5 months ago
- AI Native database for embedding vectors☆168Updated 2 weeks ago
- Framework for benchmarking fully-managed vector databases☆68Updated last month
- 🍎APPL: A Prompt Programming Language. Seamlessly integrate LLMs with programs.☆75Updated last month
- ☆18Updated last year
- A Rust-based regex crate wrapper for Python3 to get faster performance. 👾☆64Updated 4 months ago
- A streamlined, user-friendly JSON streaming preprocessor, crafted in Python.☆75Updated 2 months ago
- One-click machine learning deployment (LLM, text-to-image and so on) at scale on any cluster (GCP, AWS, Lambda labs, your home lab, or ev…☆239Updated last year
- DashInfer is a native LLM inference engine aiming to deliver industry-leading performance atop various hardware architectures, including …☆137Updated 2 months ago
- Locality Sensitive Hashing☆70Updated last year
- A curated list of awesome Milvus projects and resources.☆28Updated last year
- Deployment a light and full OpenAI API for production with vLLM to support /v1/embeddings with all embeddings models.☆37Updated 4 months ago
- Tune efficiently any LLM model from HuggingFace using distributed training (multiple GPU) and DeepSpeed. Uses Ray AIR to orchestrate the …☆53Updated last year
- RTP-LLM: Alibaba's high-performance LLM inference engine for diverse applications.☆545Updated last month