xorbitsai / xllamacppLinks
xllamacpp - a Python wrapper of llama.cpp
☆71Updated 2 weeks ago
Alternatives and similar repositories for xllamacpp
Users that are interested in xllamacpp are comparing it to the libraries listed below
Sorting:
- GLM Series Edge Models☆156Updated 7 months ago
- Auto Thinking Mode switch for Qwen3 in Open webui☆70Updated 8 months ago
- A third-party component library based on Gradio. Integrates Ant Design, Ant Design X, Monaco Editor and more advanced components to help…☆136Updated 2 months ago
- ☆193Updated last month
- A text-to-speech and speech-to-text server compatible with the OpenAI API, supporting Whisper, FunASR, Bark, and CosyVoice backends.☆192Updated last month
- Bambo is a new proxy framework. Compared with mainstream frameworks, it is more lightweight and flexible and can handle various load task…☆33Updated 11 months ago
- Its an open source LLM based on MOE Structure.☆58Updated last year
- XVERSE-MoE-A4.2B: A multilingual large language model developed by XVERSE Technology Inc.☆39Updated last year
- A Toolkit for Running On-device Large Language Models (LLMs) in APP☆80Updated last year
- ☆94Updated 6 months ago
- 我们是第一个完全可商用的角色大模型。☆39Updated last year
- Try out HallOumi, a state-of-the-art claim verification model in a simple UI!☆41Updated 9 months ago
- 如需体验textin文档解析，请点击https://cc.co/16YSIy☆22Updated last year
- App-Controller: Allow users to manipulate your App with natural language☆133Updated last year
- Library for model distillation☆160Updated 4 months ago
- Dify 1.0 Plugin Convert your Dify tools's API to MCP compatible API☆23Updated 9 months ago
- bisheng-unstructured library☆57Updated 8 months ago
- The latest graphrag interface is used, using the local ollama to provide the LLM interface.Support for using the pip installation☆156Updated last year
- XVERSE-MoE-A36B: A multilingual large language model developed by XVERSE Technology Inc.☆38Updated last year
- Implemented a script that automatically adjusts Qwen3's inference and non-inference capabilities, based on an OpenAI-like API. The infere…☆22Updated 8 months ago
- ☆114Updated last year
- LM inference server implementation based on *.cpp.☆294Updated 2 months ago
- ☆133Updated 9 months ago
- Delta-CoMe can achieve near loss-less 1-bit compressin which has been accepted by NeurIPS 2024☆58Updated last year
- DeepSearch Code-Actions Agent (DSCA). Build 🙌 with 🤗 smolagents☆132Updated 5 months ago
- 研究GOT-OCR-项目落地加速，不限语言☆62Updated last year
- Fused Qwen3 MoE layer for faster training, compatible with Transformers, LoRA, bnb 4-bit quant, Unsloth. Also possible to train LoRA over…☆229Updated this week
- Evaluation for AI apps and agent☆44Updated 2 years ago
- Jina DeepSearch UI☆127Updated 5 months ago
- Deep Reasoning Translation (DRT) Project☆240Updated 5 months ago