xorbitsai / xllamacppLinks
xllamacpp - a Python wrapper of llama.cpp
☆68Updated last week
Alternatives and similar repositories for xllamacpp
Users that are interested in xllamacpp are comparing it to the libraries listed below
Sorting:
- ☆191Updated last month
- A text-to-speech and speech-to-text server compatible with the OpenAI API, supporting Whisper, FunASR, Bark, and CosyVoice backends.☆187Updated 2 weeks ago
- A third-party component library based on Gradio. Integrates Ant Design, Ant Design X, Monaco Editor and more advanced components to help…☆133Updated last month
- Bambo is a new proxy framework. Compared with mainstream frameworks, it is more lightweight and flexible and can handle various load task…☆33Updated 11 months ago
- Its an open source LLM based on MOE Structure.☆58Updated last year
- GLM Series Edge Models☆156Updated 6 months ago
- Auto Thinking Mode switch for Qwen3 in Open webui☆70Updated 8 months ago
- Try out HallOumi, a state-of-the-art claim verification model in a simple UI!☆41Updated 9 months ago
- Library for model distillation☆158Updated 4 months ago
- ☆94Updated 6 months ago
- App-Controller: Allow users to manipulate your App with natural language☆132Updated last year
- LM inference server implementation based on *.cpp.☆295Updated last month
- 我们是第一个完全可商用的角色大模型。☆40Updated last year
- The latest graphrag interface is used, using the local ollama to provide the LLM interface.Support for using the pip installation☆155Updated last year
- XVERSE-MoE-A4.2B: A multilingual large language model developed by XVERSE Technology Inc.☆39Updated last year
- ☆114Updated last year
- Data browser based on s3. 一个基于 S3 的数据（json / jsonl / parquet / html / md等）可视化工具。👇 Try online.☆80Updated 2 months ago
- ☆133Updated 9 months ago
- 👷♂️Minion is Agent's Brain. Minion is designed to execute any type of queries, offering a variety of features that demonstrate its flex…☆92Updated last week
- The Level-Navi Agent, a framework that requires no training and utilizes large language models for deep query understanding and precise s…☆82Updated last year
- A Toolkit for Running On-device Large Language Models (LLMs) in APP☆79Updated last year
- 研究GOT-OCR-项目落地加速，不限语言☆63Updated last year
- Un-LOCC: Universal Lossy Optical Context Compression for Vision-Based Language Models Achieve nearly 3x token compression at over 93% ret…☆68Updated this week
- Qwen GRPO Graph Extraction RL Finetune☆59Updated 9 months ago
- Receipts for creating AI Applications with APIs from DashScope (and friends)!☆68Updated last year
- The framework of training large language models，support lora, full parameters fine tune etc, define yaml to start training/fine tune of y…☆31Updated last year
- XVERSE-MoE-A36B: A multilingual large language model developed by XVERSE Technology Inc.☆38Updated last year
- Deep Reasoning Translation (DRT) Project☆240Updated 4 months ago
- FlexRAG: A RAG Framework for Information Retrieval and Generation.☆229Updated last week
- bisheng-unstructured library☆57Updated 7 months ago