Alternatives and similar repositories for xoscar:

Users that are interested in xoscar are comparing it to the libraries listed below

• myscale / myscale-telemetry
  Open-source observability for your LLM application.
  ☆47Updated 3 weeks ago
• vectorch-ai / ScaleLLM
  A high-performance inference system for large language models, designed for production environments.
  ☆405Updated this week
• nebula-contrib / nebula-carina
  A pydantic based python ORM framework for graph database NebulaGraph 3.
  ☆42Updated 3 months ago
• muyuworks / myla
  a local implementation of OpenAI Assistants API: myla stands for MY Local Assistant
  ☆50Updated 4 months ago
• Yard1 / Ray-DeepSpeed-Inference
  ☆17Updated last year
• gusye1234 / nano-vectordb
  A simple, easy-to-hack Vector Database
  ☆109Updated 2 months ago
• allwefantasy / BYZER-RETRIEVAL
  Byzer-retrieval is a distributed retrieval system which designed as a backend for LLM RAG (Retrieval Augmented Generation). The system su…
  ☆45Updated 2 weeks ago
• MooreThreads / TurboRAG
  ☆67Updated 2 months ago
• 01-ai / Descartes
  ☆105Updated 9 months ago
• allwefantasy / byzer-llm
  Easy, fast, and cheap pretrain,finetune, serving for everyone
  ☆276Updated this week
• OrchardUniverse / litchi
  Yet another coding assistant powered by LLM.
  ☆13Updated 4 months ago
• bentoml / llm-bench
  ☆42Updated 2 months ago
• karminski / streaming-json-py
  A streamlined, user-friendly JSON streaming preprocessor, crafted in Python.
  ☆86Updated 4 months ago
• tensorchord / openmodelz
  Autoscale LLM (vLLM, SGLang, LMDeploy) inferences on Kubernetes (and others)
  ☆248Updated last year
• ray-project / mobius
  Mobius is an AI infrastructure platform for distributed online learning, including online sample processing, training and serving.
  ☆93Updated 7 months ago
• OpenCSGs / llm-inference
  llm-inference is a platform for publishing and managing llm inference, providing a wide range of out-of-the-box features for model deploy…
  ☆75Updated 8 months ago
• intel / llm-on-ray
  Pretrain, finetune and serve LLMs on Intel platforms with Ray
  ☆110Updated 2 months ago
• myscale / vector-db-benchmark
  Framework for benchmarking fully-managed vector databases
  ☆71Updated 4 months ago
• LMCache / lmcache-vllm
  The driver for LMCache core to run in vLLM
  ☆20Updated 2 weeks ago
• rocksdict / RocksDict
  Python fast on-disk dictionary / RocksDB & SpeeDB Python binding
  ☆198Updated last month
• Cyberbolt / CyberDB
  In-memory database based on Python Dictionaries and Lists | 基于 Python 字典和列表的内存数据库
  ☆30Updated 2 years ago
• milvus-io / milvus-lite
  A lightweight version of Milvus
  ☆294Updated 2 weeks ago
• tensorchord / modelz-llm
  OpenAI compatible API for LLMs and embeddings (LLaMA, Vicuna, ChatGLM and many others)
  ☆270Updated last year
• gpustack / llama-box
  LM inference server implementation based on *.cpp.
  ☆67Updated this week
• c32168 / dyntamic
  Generate pydantic models from JSON Schema
  ☆20Updated last year
• JiahaoYao / awesome-ray
  Ray - A curated list of resources: https://github.com/ray-project/ray
  ☆48Updated this week
• kreneskyp / jsonschema-pydantic
  Python library for converting JSON Schemas to Pydantic models
  ☆11Updated 11 months ago
• serious-scaffold / ss-python
  A Python Project Template for Long-Term Maintainability
  ☆88Updated this week
• michaelnny / Llama3-FunctionCalling
  Fine-tune Llama3 model to support function calling
  ☆31Updated 7 months ago
• smallcloudai / refact-lsp
  Rust executable for Refact Agent, it lives inside your IDE and keeps AST and VecDB indexes up to date, offers agentic tools for an AI mod…
  ☆57Updated this week