xorbitsai / inference
Replace OpenAI GPT with another LLM in your app by changing a single line of code. Xinference gives you the freedom to use any LLM you need. With Xinference, you're empowered to run inference with any open-source language models, speech recognition models, and multimodal models, whether in the cloud, on-premises, or even on your laptop.
☆4,793Updated this week
Related projects: ⓘ
- Agent framework and applications built upon Qwen2, featuring Function Calling, Code Interpreter, RAG, and Chrome extension.☆3,093Updated 2 weeks ago
- Qwen2 is the large language model series developed by Qwen team, Alibaba Cloud.☆7,468Updated this week
- Retrieval and Retrieval-augmented LLMs☆6,824Updated this week
- Question and Answer based on Anything.☆11,376Updated this week
- GLM-4 series: Open Multilingual Multimodal Chat LMs | 开源多语言多模态对话模型☆4,614Updated last week
- ModelScope-Agent: An agent framework connecting models in ModelScope with the world☆2,607Updated this week
- DeepSeek-V2: A Strong, Economical, and Efficient Mixture-of-Experts Language Model☆3,415Updated last month
- Official release of InternLM2.5 base and chat models. 1M context support☆6,231Updated last week
- C++ implementation of ChatGLM-6B & ChatGLM2-6B & ChatGLM3 & GLM4(V)☆2,912Updated last month
- RAGFlow is an open-source RAG (Retrieval-Augmented Generation) engine based on deep document understanding.☆17,176Updated this week
- Use PEFT or Full-parameter to finetune 300+ LLMs or 80+ MLLMs. (Qwen2, GLM4v, Internlm2.5, Yi, Llama3.1, Llava-Video, Internvl2, MiniCPM-…☆3,412Updated this week
- An efficient, flexible and full-featured toolkit for fine-tuning LLM (InternLM2, Llama3, Phi3, Qwen, Mistral, ...)☆3,730Updated 3 weeks ago
- 🔍 An LLM-based Multi-agent Framework of Web Search Engine (like Perplexity.ai Pro and SearchGPT)☆4,578Updated last week
- Openai style api for open large language models, using LLMs just as chatgpt! Support for LLaMA, LLaMA-2, BLOOM, Falcon, Baichuan, Qwen, X…☆2,309Updated last month
- LMDeploy is a toolkit for compressing, deploying, and serving LLMs.☆4,184Updated this week
- The official repo of Qwen (通义千问) chat & pretrained large language model proposed by Alibaba Cloud.☆13,305Updated 2 weeks ago
- [COLM 2024] OpenAgents: An Open Platform for Language Agents in the Wild☆3,900Updated 2 months ago
- A series of large language models developed by Baichuan Intelligent Technology☆4,069Updated 2 months ago
- [CVPR 2024 Oral] InternVL Family: A Pioneering Open-Source Alternative to GPT-4o. 接近GPT-4o表现的开源多模态对话模型☆5,491Updated last week
- OpenCompass is an LLM evaluation platform, supporting a wide range of models (Llama3, Mistral, InternLM2,GPT-4,LLaMa2, Qwen,GLM, Claude, …☆3,741Updated this week
- The official repo of Qwen-VL (通义千问-VL) chat & pretrained large vision language model proposed by Alibaba Cloud.☆4,786Updated last month
- Firefly: 大模型训练工具,支持训练Qwen2、Yi1.5、Phi-3、Llama3、Gemma、MiniCPM、Yi、Deepseek、Orion、Xverse、Mixtral-8x7B、Zephyr、Mistral、Baichuan2、Llma2、Llama、Qw…☆5,643Updated 2 months ago
- ChatOllama is an open source chatbot based on LLMs. It supports a wide range of language models, and knowledge base management.☆2,569Updated last week
- Efficiently Fine-Tune 100+ LLMs in WebUI (ACL 2024)☆30,812Updated this week
- A modular graph-based Retrieval-Augmented Generation (RAG) system☆17,179Updated this week
- Llama3、Llama3.1 中文仓库(随书籍撰写中... 各种网友及厂商微调、魔改版本有趣权重 & 训练、推理、评测、部署教程视频 & 文档)☆3,921Updated last month
- Netease Youdao's open-source embedding and reranker models for RAG products.☆1,367Updated last week
- AI Native Data App Development framework with AWEL(Agentic Workflow Expression Language) and Agents☆13,255Updated last week
- A series of large language models trained from scratch by developers @01-ai☆7,598Updated last week
- Start building LLM-empowered multi-agent applications in an easier way.☆4,809Updated last week