codefuse-ai / FasterTransformer4CodeFuse
High-performance LLM inference based on our optimized version of FastTransfomer
☆124Updated 11 months ago
Related projects ⓘ
Alternatives and complementary repositories for FasterTransformer4CodeFuse
- Index of the CodeFuse Repositories☆134Updated 2 months ago
- High Accuracy and efficiency multi-task fine-tuning framework for Code LLMs. This work has been accepted by KDD 2024.☆637Updated this week
- Industrial-level evaluation benchmarks for Coding LLMs in the full life-cycle of AI native software developing.企业级代码大模型评测体系,持续开放中☆80Updated 10 months ago
- fastertransformer for codegeex model☆64Updated last year
- XVERSE-65B: A multilingual large language model developed by XVERSE Technology Inc.☆132Updated 7 months ago
- Implement OpenAI APIs and plugin-enabled ChatGPT with open source LLM and other models.☆122Updated 5 months ago
- 360zhinao☆282Updated 2 months ago
- Mixture-of-Experts (MoE) Language Model☆180Updated 2 months ago
- A high-throughput and memory-efficient inference and serving engine for LLMs☆124Updated 11 months ago
- 首个llama2 13b 中文版模型 （Base + 中文对话SFT，实现流畅多轮人机自然语言交互)☆89Updated last year
- Easy, fast, and cheap pretrain,finetune, serving for everyone☆263Updated 2 weeks ago
- ChatGLM2-6B微调, SFT/LoRA, instruction finetune☆106Updated last year
- run chatglm3-6b in BM1684X☆39Updated 8 months ago
- The official repo of Aquila2 series proposed by BAAI, including pretrained & chat large language models.☆438Updated last month
- A high-throughput and memory-efficient inference and serving engine for LLMs☆130Updated 4 months ago
- self-host ChatGLM-6B API made with fastapi☆78Updated last year
- 使用qlora对中文大语言模型进行微调，包含ChatGLM、Chinese-LLaMA-Alpaca、BELLE☆85Updated last year
- XVERSE-13B: A multilingual large language model developed by XVERSE Technology Inc.☆649Updated 7 months ago
- llm-inference is a platform for publishing and managing llm inference, providing a wide range of out-of-the-box features for model deploy…☆70Updated 6 months ago
- 演示 vllm 对中文大语言模型的神奇效果☆31Updated last year
- 支持中文场景的的小语言模型 llama2.c-zh☆145Updated 8 months ago
- 基于chatglm快速搭建文档问答机器人☆88Updated last year
- 属于每个人的公众号”查特查特“上线啦！新问题、新方法、新发现，欢迎提PR！☆39Updated 11 months ago
- chatglm-6B for tools application using langchain☆76Updated last year
- VS Code extension for CodeGeeX☆279Updated last year
- Firefly中文LLaMA-2大模型，支持增量预训练Baichuan2、Llama2、Llama、Falcon、Qwen、Baichuan、InternLM、Bloom等大模型☆399Updated last year
- 利用LLM+敏感词库，来自动判别是否涉及敏感词。☆105Updated last year
- langchain学习笔记，包含langchain源码解读、langchain中使用中文模型、langchain实例等。☆179Updated last year
- Its an open source LLM based on MOE Structure.☆57Updated 4 months ago
- ☆347Updated 3 months ago