xorbitsai / xllamacppLinks
xllamacpp - a Python wrapper of llama.cpp
☆59Updated 2 weeks ago
Alternatives and similar repositories for xllamacpp
Users that are interested in xllamacpp are comparing it to the libraries listed below
Sorting:
- Auto Thinking Mode switch for Qwen3 in Open webui☆68Updated 4 months ago
- A text-to-speech and speech-to-text server compatible with the OpenAI API, supporting Whisper, FunASR, Bark, and CosyVoice backends.☆162Updated 2 months ago
- A third-party component library based on Gradio. Integrates Ant Design, Ant Design X, and more advanced components to help you build appl…☆119Updated 3 weeks ago
- Library for model distillation☆152Updated 3 weeks ago
- Bambo is a new proxy framework. Compared with mainstream frameworks, it is more lightweight and flexible and can handle various load task…☆34Updated 7 months ago
- Try out HallOumi, a state-of-the-art claim verification model in a simple UI!☆40Updated 6 months ago
- GLM Series Edge Models☆149Updated 3 months ago
- Its an open source LLM based on MOE Structure.☆58Updated last year
- ☆149Updated 2 weeks ago
- 我们是第一个完全可商用的角色大模型。☆40Updated last year
- ☆293Updated 4 months ago
- Delta-CoMe can achieve near loss-less 1-bit compressin which has been accepted by NeurIPS 2024☆57Updated 10 months ago
- ☆93Updated 2 months ago
- A Toolkit for Running On-device Large Language Models (LLMs) in APP☆80Updated last year
- The latest graphrag interface is used, using the local ollama to provide the LLM interface.Support for using the pip installation☆156Updated 11 months ago
- 如需体验textin文档解析，请点击https://cc.co/16YSIy☆21Updated last year
- App-Controller: Allow users to manipulate your App with natural language☆132Updated 10 months ago
- Tablestore for Agent Memory☆39Updated 2 months ago
- XVERSE-MoE-A36B: A multilingual large language model developed by XVERSE Technology Inc.☆38Updated last year
- agentcp是一个基于ACP协议的Agent sdk，用于解决Agent间的身份认证及通信问题;用于创建AID、连接入网、构建会话，收发消息等;支持多Agent协作，异步消息处理，支持内网穿透，支持Agent访问的负载均衡☆14Updated 2 months ago
- bisheng-unstructured library☆55Updated 4 months ago
- Easy to use, High Performant Knowledge Distillation for LLMs☆93Updated 4 months ago
- XVERSE-MoE-A4.2B: A multilingual large language model developed by XVERSE Technology Inc.☆39Updated last year
- DeepSearch Code-Actions Agent (DSCA). Build 🙌 with 🤗 smolagents☆121Updated last month
- LM inference server implementation based on *.cpp.☆276Updated last month
- ☆112Updated last year
- Jina DeepSearch UI☆126Updated last month
- LLM based agents with proactive interactions, long-term memory, external tool integration, and local deployment capabilities.☆106Updated 2 months ago
- Cook up amazing multimodal AI applications effortlessly with MiniCPM-o☆197Updated this week
- Deep Reasoning Translation (DRT) Project☆233Updated last month