CodeGeeX / codegeex-fastertransformerLinks
fastertransformer for codegeex model
☆65Updated 2 years ago
Alternatives and similar repositories for codegeex-fastertransformer
Users that are interested in codegeex-fastertransformer are comparing it to the libraries listed below
Sorting:
- A high-throughput and memory-efficient inference and serving engine for LLMs☆131Updated last year
- High-performance LLM inference based on our optimized version of FastTransfomer☆122Updated last year
- Open efforts to implement ChatGPT-like models and beyond.☆107Updated last year
- ⚡ boost inference speed of GPT models in transformers by onnxruntime☆53Updated 2 years ago
- Index of the CodeFuse Repositories☆137Updated last year
- CodeAssist is an advanced code completion tool that provides high-quality code completions for Python, Java, C++ and so on. CodeAssist 是一…☆57Updated last month
- XVERSE-65B: A multilingual large language model developed by XVERSE Technology Inc.☆141Updated last year
- SuperCLUE琅琊榜：中文通用大模型匿名对战评价基准☆145Updated last year
- A high-throughput and memory-efficient inference and serving engine for LLMs☆138Updated 10 months ago
- This is a text generation method which returns a generator, streaming out each token in real-time during inference, based on Huggingface/…☆97Updated last year
- ☆106Updated 2 years ago
- An opensource ChatBot built with ExpertPrompting which achieves 96% of ChatGPT's capability.☆299Updated 2 years ago
- CodeLLaMA 中文版 - 代码生成助手，huggingface累积下载2w+次☆45Updated 2 years ago
- Mixture-of-Experts (MoE) Language Model☆189Updated last year
- ☆123Updated last year
- Leveraging large language models for text-to-SQL synthesis, this project fine-tunes WizardLM/WizardCoder-15B-V1.0 with QLoRA on a custom …☆44Updated last year
- ChatGLM-6B-Slim：裁减掉20K图片Token的ChatGLM-6B，完全一样的性能，占用更小的显存。☆127Updated 2 years ago
- Moss Vortex is a lightweight and high-performance deployment and inference backend engineered specifically for MOSS 003, providing a weal…☆37Updated 2 years ago
- llama inference for tencentpretrain☆99Updated 2 years ago
- CodeGPT: A Code-Related Dialogue Dataset Generated by GPT and for GPT☆114Updated 2 years ago
- minichatgpt - To Train ChatGPT In 5 Minutes☆169Updated 2 years ago
- Its an open source LLM based on MOE Structure.☆58Updated last year
- deep learning☆148Updated 5 months ago
- 首个llama2 13b 中文版模型 （Base + 中文对话SFT，实现流畅多轮人机自然语言交互)☆91Updated 2 years ago
- Official Pytorch Implementation for MathGLM☆327Updated last year
- Another ChatGLM2 implementation for GPTQ quantization☆53Updated 2 years ago
- CodeGen2 models for program synthesis☆269Updated 2 years ago
- 使用qlora对中文大语言模型进行微调，包含ChatGLM、Chinese-LLaMA-Alpaca、BELLE☆90Updated 2 years ago
- XVERSE-7B: A multilingual large language model developed by XVERSE Technology Inc.☆53Updated last year
- 实现一种多Lora权值集成切换+Zero-Finetune零微调增强的跨模型技术方案，LLM-Base+LLM-X+Alpaca，初期，LLM-Base为Chatglm6B底座模型，LLM-X是LLAMA增强模型。该方案简易高效，目标是使此类语言模型能够低能耗广泛部署，并最…☆116Updated 2 years ago