xorbitsai / xoscarLinks
Python actor framework for heterogeneous computing.
☆152Updated this week
Alternatives and similar repositories for xoscar
Users that are interested in xoscar are comparing it to the libraries listed below
Sorting:
- A pydantic based python ORM framework for graph database NebulaGraph 3.☆45Updated 8 months ago
- xllamacpp - a Python wrapper of llama.cpp☆44Updated last week
- ☆109Updated last year
- Open-source observability for your LLM application.☆53Updated 5 months ago
- A library integrating embedding and reranker models from OpenAI, SentenceTransformers etc for semantic search in vector database.☆45Updated 2 months ago
- Pretrain, finetune and serve LLMs on Intel platforms with Ray☆129Updated last month
- Byzer-retrieval is a distributed retrieval system which designed as a backend for LLM RAG (Retrieval Augmented Generation). The system su…☆48Updated 3 months ago
- Awesome multilingual OCR toolkits based on PaddlePaddle (practical ultra lightweight OCR system, support 80+ languages recognition, provi…☆38Updated 3 months ago
- LM inference server implementation based on *.cpp.☆226Updated this week
- A lightweight version of Milvus☆344Updated this week
- Ray - A curated list of resources: https://github.com/ray-project/ray☆61Updated last week
- llm-inference is a platform for publishing and managing llm inference, providing a wide range of out-of-the-box features for model deploy…☆82Updated last year
- sqlgpt-parser is a Python implementation of an SQL parser that effectively converts SQL statements into Abstract Syntax Trees (AST). By l…☆30Updated 2 months ago
- Pond is a high performance object-pooling library for Python☆56Updated last year
- a local implementation of OpenAI Assistants API: myla stands for MY Local Assistant☆54Updated 9 months ago
- A high-performance inference system for large language models, designed for production environments.☆448Updated this week
- ☆54Updated 7 months ago
- TiDB Vector SDK for Python, including code examples. Join our Discord: https://discord.gg/XzSW23Jg9p☆58Updated 7 months ago
- A simple service that integrates vLLM with Ray Serve for fast and scalable LLM serving.☆67Updated last year
- Python API for https://vespa.ai, the open big data serving engine☆127Updated this week
- SDK for Dify plugins☆69Updated this week
- ☆187Updated 2 weeks ago
- A prompting library☆168Updated 9 months ago
- Tune efficiently any LLM model from HuggingFace using distributed training (multiple GPU) and DeepSpeed. Uses Ray AIR to orchestrate the …☆58Updated 2 years ago
- Elasticsearch integration into LangChain☆57Updated 4 months ago
- Yet another coding assistant powered by LLM.☆16Updated 9 months ago
- Easy, fast, and cheap pretrain,finetune, serving for everyone☆306Updated last week
- Lyric: A Rust-powered secure runtime for AI-Agent.☆22Updated 3 months ago
- ☆17Updated 2 years ago
- NebulaGraph Queries and visualization in Jupyter notebook.(previously known as ipython-ngql)☆37Updated 10 months ago