hcd233 / Aris-AI-Model-ServerLinks
An OpenAI Compatible API which integrates LLM, Embedding and Reranker. 一个集成 LLM、Embedding 和 Reranker 的 OpenAI 兼容 API
☆18Updated 4 months ago
Alternatives and similar repositories for Aris-AI-Model-Server
Users that are interested in Aris-AI-Model-Server are comparing it to the libraries listed below
Sorting:
- Open Source Text Embedding Models with OpenAI Compatible API☆164Updated last year
- Lightweight continuous batching OpenAI compatibility using HuggingFace Transformers include T5 and Whisper.☆29Updated 9 months ago
- xllamacpp - a Python wrapper of llama.cpp☆66Updated this week
- Easy to deploy.A cloud service for python code interpreter sandbox for Code-Interpreter.☆57Updated last year
- A text-to-speech and speech-to-text server compatible with the OpenAI API, supporting Whisper, FunASR, Bark, and CosyVoice backends.☆180Updated 2 weeks ago
- mcp-difyworkflow-server is an mcp server Tools application that implements the query and invocation of Dify workflows, supporting the on-…☆60Updated 11 months ago
- 通过该项目将Dify通过Pipeline接入OpenwebUI，可以兼并OpenwebUI的前端优势和相应生态以及Dify强大的模型可拓展性和Workflow的效益。☆38Updated last year
- Get up and running with Llama 3, Mistral, Gemma, and other large language models.☆30Updated last month
- TextEmbed is a REST API crafted for high-throughput and low-latency embedding inference. It accommodates a wide variety of embedding mode…☆27Updated last year
- LLM based agents with proactive interactions, long-term memory, external tool integration, and local deployment capabilities.☆107Updated 4 months ago
- You can play any API server that compatible with OpenAI API☆24Updated last year
- ChatTTS-OpenAI-API is a project built upon the ChatTTS project, implementing the v1/audio/speech endpoint in compliance with OpenAI proto…☆21Updated last year
- Run LLM-related tools in containers.☆55Updated last year
- MinerU API server☆83Updated last year
- A library integrating embedding and reranker models from OpenAI, SentenceTransformers etc for semantic search in vector database.☆58Updated 8 months ago
- The CLI & python API for the well-known project gpt-academic.☆19Updated last year
- 大模型推理框架加速，让 LLM 飞起来☆24Updated last year
- Sentence Transformers API: An OpenAI compatible embedding API server☆68Updated last year
- Deployment a light and full OpenAI API for production with vLLM to support /v1/embeddings with all embeddings models.☆44Updated last year
- The latest graphrag interface is used, using the local ollama to provide the LLM interface.Support for using the pip installation☆155Updated last year
- Real time faster whisper gradio☆25Updated 4 months ago
- Fine-Tuning LLM and embedding models☆28Updated 2 years ago
- Jina DeepSearch UI☆126Updated 3 months ago
- Tutorials from AutoGen Basics to Use Cases☆33Updated 2 years ago
- This is a FastAPI based LLM server. Load multiple LLM models (MLX or llama.cpp) simultaneously using multiprocessing.☆14Updated last week
- LM inference server implementation based on *.cpp.☆294Updated 3 weeks ago
- vllm混合推理扩展插件，支持多NUMA混合推理，单卡推理Qwen3-Next模型可达1000+ prefill☆29Updated last month
- A quick and optimized solution to manage llama based gguf quantized models, download gguf files, retreive messege formatting, add more mo…☆12Updated last year
- A simple service that integrates vLLM with Ray Serve for fast and scalable LLM serving.☆78Updated last year
- A function calling tool can be deployed to Cloudflare Workers with openapi schema☆100Updated last year