演示 vllm 对中文大语言模型的神奇效果
☆31Nov 4, 2023Updated 2 years ago
Alternatives and similar repositories for vllm-cn
Users that are interested in vllm-cn are comparing it to the libraries listed below. We may earn a commission when you buy through links labeled 'Ad' on this page.
Sorting:
- 2021CCFBDCI百度千言问题匹配鲁棒性评测赛题第一名代码整理☆15Feb 21, 2022Updated 4 years ago
- KiwiCutter is a simple introduction to using OpenKiwi☆13Dec 8, 2022Updated 3 years ago
- LAVIS - A One-stop Library for Language-Vision Intelligence☆10Apr 18, 2023Updated 3 years ago
- ☆15Oct 9, 2023Updated 3 years ago
- 使用Simhash对海量文本进行去重☆12Jun 2, 2018Updated 8 years ago
- Managed Database hosting by DigitalOcean • AdPostgreSQL, MySQL, MongoDB, Kafka, Valkey, and OpenSearch available. Automatically scale up storage and focus on building your apps.
- 纯c++的全平台llm加速库，支持python调用，支持baichuan, glm, llama, moss基座，手机端流畅运行chatglm-6B级模型单卡可达10000+token / s，☆42Aug 16, 2023Updated 3 years ago
- 知识图谱问答☆15Mar 11, 2021Updated 5 years ago
- ☆12Dec 22, 2024Updated last year
- 基于simhash的文本去重算法☆20Jun 18, 2021Updated 5 years ago
- [NeurIPS 2025] Bag of Tricks for Inference-time Computation of LLM Reasoning☆16Sep 20, 2025Updated last year
- The repository to keep supporting files for my blog posts.☆16Sep 20, 2025Updated last year
- ☆12Feb 20, 2021Updated 5 years ago
- The code and data for the paper "Lost-in-the-Middle in Long-Text Generation: Synthetic Dataset, Evaluation Framework, and Mitigation"☆15Oct 8, 2025Updated last year
- Reasoning by Communicating with Agents☆30Apr 29, 2025Updated last year
- Managed Kubernetes at scale on DigitalOcean • AdDigitalOcean Kubernetes includes the control plane, bandwidth allowance, container registry, automatic updates, and more for free.
- Few-Shot Text Classification with Induction Network☆18Apr 23, 2020Updated 6 years ago
- DeepSeek TUI VS Code extension☆15Jun 17, 2026Updated 4 months ago
- ☆11Sep 25, 2020Updated 6 years ago
- A mesh system for adapting multiple large language models.☆11Mar 20, 2024Updated 2 years ago
- DrFAQ is a plug-and-play question answering NLP chatbot that can be generally applied to any organisation's text corpora.☆29Mar 12, 2022Updated 4 years ago
- ☆10Apr 19, 2020Updated 6 years ago
- Prompt 工程师利器，可同时比较多个 Prompts 在多个 LLM 模型上的效果☆94Jul 21, 2023Updated 3 years ago
- Code for ACL 2018 paper 'Think Visually: Question Answering through Virtual Imagery'☆13Mar 24, 2023Updated 3 years ago
- ☆29Jul 31, 2023Updated 3 years ago
- Serverless GPU API endpoints on Runpod - Get Bonus Credits • AdSkip the infrastructure headaches. Auto-scaling, pay-as-you-go, no-ops approach lets you focus on innovating your application.
- Awesome Open-domain Dialogue Models，高质量开放域对话模型集合☆37Mar 21, 2023Updated 3 years ago
- SuperCLUE琅琊榜：中文通用大模型匿名对战评价基准☆142Jun 19, 2024Updated 2 years ago
- a cross-platform extensible big data client that helps you work efficiently.☆10Sep 20, 2018Updated 8 years ago
- A high-throughput and memory-efficient inference and serving engine for LLMs☆141Dec 6, 2024Updated last year
- Easy and Efficient Finetuning LLMs. (Supported LLama, LLama2, LLama3, Qwen, Baichuan, GLM , Falcon) 大模型高效量化训练+部署.☆623Jan 24, 2025Updated last year
- qwerty-learner idea插件☆26Oct 12, 2023Updated 3 years ago
- 仿微信发送语音☆27Jul 10, 2015Updated 11 years ago
- Easy, fast, and cheap pretrain,finetune, serving for everyone☆312Jul 16, 2025Updated last year
- ☆12Dec 14, 2024Updated last year
- GPUs on demand by Runpod - Special Offer Available • AdRun AI, ML, and HPC workloads on powerful cloud GPUs—without limits or wasted spend. Deploy GPUs in under a minute and pay by the second.
- ☆11Apr 16, 2023Updated 3 years ago
- Firefly: 大模型训练工具，支持训练Qwen2.5、Qwen2、Yi1.5、Phi-3、Llama3、Gemma、MiniCPM、Yi、Deepseek、Orion、Xverse、Mixtral-8x7B、Zephyr、Mistral、Baichuan2、Llma2、…☆6,652Oct 24, 2024Updated last year
- 打造人人都会的NLP，开源不易，记得star哦☆100Apr 28, 2023Updated 3 years ago
- A high-throughput and memory-efficient inference and serving engine for LLMs☆18Nov 24, 2023Updated 2 years ago
- Firefly中文LLaMA-2大模型，支持增量预训练Baichuan2、Llama2、Llama、Falcon、Qwen、Baichuan、InternLM、Bloom等大模型☆415Oct 21, 2023Updated 2 years ago
- ☆19Nov 25, 2022Updated 3 years ago
- Implementation of "REAR: A Relevance-Aware Retrieval-Augmented Framework for Open-Domain Question Answering"☆35Nov 21, 2024Updated last year