xorbitsai / xoscarLinks
Python actor framework for heterogeneous computing.
☆153Updated last week
Alternatives and similar repositories for xoscar
Users that are interested in xoscar are comparing it to the libraries listed below
Sorting:
- Open-source observability for your LLM application.☆51Updated 5 months ago
- ☆108Updated last year
- Byzer-retrieval is a distributed retrieval system which designed as a backend for LLM RAG (Retrieval Augmented Generation). The system su…☆48Updated 3 months ago
- Framework for benchmarking fully-managed vector databases☆79Updated 8 months ago
- A lightweight version of Milvus☆328Updated last week
- The driver for LMCache core to run in vLLM☆41Updated 4 months ago
- LM inference server implementation based on *.cpp.☆203Updated this week
- ☆79Updated 6 months ago
- ☆183Updated this week
- Lyric: A Rust-powered secure runtime for AI-Agent.☆21Updated 2 months ago
- a local implementation of OpenAI Assistants API: myla stands for MY Local Assistant☆54Updated 9 months ago
- Pretrain, finetune and serve LLMs on Intel platforms with Ray☆127Updated last month
- The ChatGPT plugin to enhance OpenMLDB.☆51Updated 2 years ago
- ☆17Updated 2 years ago
- Autoscale LLM (vLLM, SGLang, LMDeploy) inferences on Kubernetes (and others)☆267Updated last year
- xllamacpp - a Python wrapper of llama.cpp☆40Updated last week
- An enterprise-grade AI retriever designed to streamline AI integration into your applications, ensuring cutting-edge accuracy.☆284Updated last month
- Elasticsearch integration into LangChain☆57Updated 3 months ago
- A simple service that integrates vLLM with Ray Serve for fast and scalable LLM serving.☆67Updated last year
- sqlgpt-parser is a Python implementation of an SQL parser that effectively converts SQL statements into Abstract Syntax Trees (AST). By l…☆30Updated last month
- A library integrating embedding and reranker models from OpenAI, SentenceTransformers etc for semantic search in vector database.☆42Updated 2 months ago
- A simple, easy-to-hack Vector Database☆143Updated 6 months ago
- Pond is a high performance object-pooling library for Python☆56Updated last year
- Multi-Faceted AI Agent and Workflow Autotuning. Automatically optimizes LangChain, LangGraph, DSPy programs for better quality, lower exe…☆236Updated 3 weeks ago
- Awesome multilingual OCR toolkits based on PaddlePaddle (practical ultra lightweight OCR system, support 80+ languages recognition, provi…☆37Updated 2 months ago
- This repository contains statistics about the AI Infrastructure products.☆18Updated 3 months ago
- Model Context Protocol Servers for Milvus☆129Updated 2 weeks ago
- TiDB Vector SDK for Python, including code examples. Join our Discord: https://discord.gg/XzSW23Jg9p☆58Updated 6 months ago
- A prompting library☆165Updated 8 months ago
- LongCite: Enabling LLMs to Generate Fine-grained Citations in Long-context QA☆495Updated 5 months ago