Alternatives and similar repositories for xoscar:

Users that are interested in xoscar are comparing it to the libraries listed below

• myscale / myscale-telemetry
  Open-source observability for your LLM application.
  ☆51Updated 3 months ago
• allwefantasy / BYZER-RETRIEVAL
  Byzer-retrieval is a distributed retrieval system which designed as a backend for LLM RAG (Retrieval Augmented Generation). The system su…
  ☆48Updated last month
• 01-ai / Descartes
  ☆108Updated last year
• myscale / vector-db-benchmark
  Framework for benchmarking fully-managed vector databases
  ☆77Updated 7 months ago
• xorbitsai / xorbits
  Scalable Python DS & ML, in an API compatible & lightning fast way.
  ☆1,175Updated 3 weeks ago
• LMCache / lmcache-vllm
  The driver for LMCache core to run in vLLM
  ☆36Updated 2 months ago
• asprenger / ray_vllm_inference
  A simple service that integrates vLLM with Ray Serve for fast and scalable LLM serving.
  ☆65Updated last year
• Yard1 / Ray-DeepSpeed-Inference
  ☆17Updated 2 years ago
• OrchardUniverse / litchi
  Yet another coding assistant powered by LLM.
  ☆16Updated 7 months ago
• lyric-project / lyric
  Lyric: A Rust-powered secure runtime for AI-Agent.
  ☆19Updated last month
• bentoml / llm-bench
  ☆49Updated 5 months ago
• intel / llm-on-ray
  Pretrain, finetune and serve LLMs on Intel platforms with Ray
  ☆125Updated 3 weeks ago
• tensorchord / openmodelz
  Autoscale LLM (vLLM, SGLang, LMDeploy) inferences on Kubernetes (and others)
  ☆263Updated last year
• muyuworks / myla
  a local implementation of OpenAI Assistants API: myla stands for MY Local Assistant
  ☆53Updated 7 months ago
• JiahaoYao / awesome-ray
  Ray - A curated list of resources: https://github.com/ray-project/ray
  ☆56Updated 2 months ago
• etalab-ia / albert-models
  Deployment a light and full OpenAI API for production with vLLM to support /v1/embeddings with all embeddings models.
  ☆42Updated 9 months ago
• milvus-io / milvus-lite
  A lightweight version of Milvus
  ☆316Updated this week
• nebula-contrib / nebula-carina
  A pydantic based python ORM framework for graph database NebulaGraph 3.
  ☆44Updated 6 months ago
• dataelement / bisheng-unstructured
  bisheng-unstructured library
  ☆44Updated last week
• T-baby / pondpond
  Pond is a high performance object-pooling library for Python
  ☆55Updated last year
• gusye1234 / nano-vectordb
  A simple, easy-to-hack Vector Database
  ☆134Updated 5 months ago
• OpenCSGs / llm-inference
  llm-inference is a platform for publishing and managing llm inference, providing a wide range of out-of-the-box features for model deploy…
  ☆80Updated 11 months ago
• milvus-io / milvus-model
  A library integrating embedding and reranker models from OpenAI, SentenceTransformers etc for semantic search in vector database.
  ☆39Updated 3 weeks ago
• Cyberbolt / CyberDB
  In-memory database based on Python Dictionaries and Lists | 基于 Python 字典和列表的内存数据库
  ☆30Updated 2 years ago
• vectorch-ai / ScaleLLM
  A high-performance inference system for large language models, designed for production environments.
  ☆431Updated this week
• allwefantasy / byzer-llm
  Easy, fast, and cheap pretrain,finetune, serving for everyone
  ☆293Updated 2 weeks ago
• tensorchord / vechord
  Turn PostgreSQL into your search engine in a Pythonic way.
  ☆39Updated last week
• allmonday / pydantic-resolve
  ER model friendly data composition tool
  ☆235Updated 3 weeks ago
• inferflow / inferflow
  Inferflow is an efficient and highly configurable inference engine for large language models (LLMs).
  ☆242Updated last year
• rocksdict / RocksDict
  Python fast on-disk dictionary / RocksDB & SpeeDB Python binding
  ☆213Updated 4 months ago