Alternatives and similar repositories for xoscar:

Users that are interested in xoscar are comparing it to the libraries listed below

• nebula-contrib / nebula-carina
  A pydantic based python ORM framework for graph database NebulaGraph 3.
  ☆44Updated 4 months ago
• 01-ai / Descartes
  ☆107Updated 11 months ago
• myscale / myscale-telemetry
  Open-source observability for your LLM application.
  ☆51Updated 2 months ago
• allwefantasy / BYZER-RETRIEVAL
  Byzer-retrieval is a distributed retrieval system which designed as a backend for LLM RAG (Retrieval Augmented Generation). The system su…
  ☆47Updated last week
• myscale / vector-db-benchmark
  Framework for benchmarking fully-managed vector databases
  ☆77Updated 5 months ago
• LMCache / lmcache-vllm
  The driver for LMCache core to run in vLLM
  ☆32Updated last month
• vectorch-ai / ScaleLLM
  A high-performance inference system for large language models, designed for production environments.
  ☆421Updated this week
• milvus-io / milvus-lite
  A lightweight version of Milvus
  ☆306Updated last week
• dataelement / bisheng-unstructured
  bisheng-unstructured library
  ☆42Updated 3 months ago
• OpenCSGs / llm-inference
  llm-inference is a platform for publishing and managing llm inference, providing a wide range of out-of-the-box features for model deploy…
  ☆79Updated 9 months ago
• bentoml / llm-bench
  ☆48Updated 3 months ago
• CodeGeeX / codegeex-fastertransformer
  fastertransformer for codegeex model
  ☆63Updated last year
• gusye1234 / nano-vectordb
  A simple, easy-to-hack Vector Database
  ☆124Updated 4 months ago
• Yard1 / Ray-DeepSpeed-Inference
  ☆17Updated last year
• asprenger / ray_vllm_inference
  A simple service that integrates vLLM with Ray Serve for fast and scalable LLM serving.
  ☆63Updated 11 months ago
• tensorchord / openmodelz
  Autoscale LLM (vLLM, SGLang, LMDeploy) inferences on Kubernetes (and others)
  ☆257Updated last year
• muyuworks / myla
  a local implementation of OpenAI Assistants API: myla stands for MY Local Assistant
  ☆53Updated 6 months ago
• Yiling-J / cacheme
  Asyncio cache framework for Python
  ☆45Updated last year
• allwefantasy / super-analysis-doc
  ☆19Updated 5 months ago
• modelscope / dash-infer
  DashInfer is a native LLM inference engine aiming to deliver industry-leading performance atop various hardware architectures, including …
  ☆237Updated this week
• intel / llm-on-ray
  Pretrain, finetune and serve LLMs on Intel platforms with Ray
  ☆120Updated 2 weeks ago
• gpustack / llama-box
  LM inference server implementation based on *.cpp.
  ☆131Updated this week
• onesuper / PDF-Chatbot-Local-LLM-Embeddings
  ☆22Updated last year
• MooreThreads / TurboRAG
  ☆72Updated 3 months ago
• allwefantasy / byzer-llm
  Easy, fast, and cheap pretrain,finetune, serving for everyone
  ☆288Updated this week
• allwefantasy / byzer-agent
  ☆31Updated last year
• fw-ai / benchmark
  Benchmark suite for LLMs from Fireworks.ai
  ☆69Updated last month
• smallcloudai / refact-lsp
  Rust executable for Refact Agent, it lives inside your IDE and keeps AST and VecDB indexes up to date, offers agentic tools for an AI mod…
  ☆58Updated 3 weeks ago
• tobegit3hub / openmldb-chatgpt-plugin
  The ChatGPT plugin to enhance OpenMLDB.
  ☆51Updated last year
• nebula-contrib / nebulagraph-lite
  The minimal, ad-hoc way of plug and play NebulaGraph with pip install, even inside Colab Notebook!
  ☆16Updated 9 months ago