xorbitsai / xllamacppLinks
xllamacpp - a Python wrapper of llama.cpp
☆73Updated this week
Alternatives and similar repositories for xllamacpp
Users that are interested in xllamacpp are comparing it to the libraries listed below
Sorting:
- Its an open source LLM based on MOE Structure.☆58Updated last year
- ☆196Updated 2 months ago
- Auto Thinking Mode switch for Qwen3 in Open webui☆70Updated 9 months ago
- A text-to-speech and speech-to-text server compatible with the OpenAI API, supporting Whisper, FunASR, Bark, and CosyVoice backends.☆192Updated last month
- GLM Series Edge Models☆158Updated 8 months ago
- Bambo is a new proxy framework. Compared with mainstream frameworks, it is more lightweight and flexible and can handle various load task…☆33Updated last year
- A third-party component library based on Gradio. Integrates Ant Design, Ant Design X, Monaco Editor and more advanced components to help…☆135Updated 2 months ago
- Try out HallOumi, a state-of-the-art claim verification model in a simple UI!☆41Updated 10 months ago
- XVERSE-MoE-A4.2B: A multilingual large language model developed by XVERSE Technology Inc.☆39Updated last year
- ☆94Updated 7 months ago
- Library for model distillation☆161Updated 5 months ago
- ☆114Updated last year
- 我们是第一个完全可商用的角色大模型。☆40Updated last year
- A Toolkit for Running On-device Large Language Models (LLMs) in APP☆82Updated last year
- Delta-CoMe can achieve near loss-less 1-bit compressin which has been accepted by NeurIPS 2024☆58Updated last year
- The latest graphrag interface is used, using the local ollama to provide the LLM interface.Support for using the pip installation☆156Updated last year
- 如需体验textin文档解析，请点击https://cc.co/16YSIy☆22Updated last year
- Jina DeepSearch UI☆127Updated 5 months ago
- App-Controller: Allow users to manipulate your App with natural language☆133Updated last year
- XVERSE-MoE-A36B: A multilingual large language model developed by XVERSE Technology Inc.☆38Updated last year
- Deep Reasoning Translation (DRT) Project☆241Updated 5 months ago
- ☆113Updated last year
- ☆133Updated 10 months ago
- An open-source chat text to control actions agentic workflow framework/showcase powered by Agently AI application development framework.☆29Updated last year
- LM inference server implementation based on *.cpp.☆295Updated 2 months ago
- Data browser based on s3. 一个基于 S3 的数据（json / jsonl / parquet / html / md等）可视化工具。👇 Try online.☆79Updated 3 months ago
- 👷 ♂️High performance agent framework that can do everything. Minion is designed to execute any type of queries, offering a variety of fe…☆117Updated this week
- Mixture-of-Experts (MoE) Language Model☆195Updated last year
- Cook up amazing multimodal AI applications effortlessly with MiniCPM-o☆290Updated last week
- Implemented a script that automatically adjusts Qwen3's inference and non-inference capabilities, based on an OpenAI-like API. The infere…☆22Updated 9 months ago