vtuber-plan / langport
Langport is a language model inference service
☆94Updated 4 months ago
Alternatives and similar repositories for langport:
Users that are interested in langport are comparing it to the libraries listed below
- A high-throughput and memory-efficient inference and serving engine for LLMs☆130Updated 7 months ago
- Train llama with lora on one 4090 and merge weight of lora to work as stanford alpaca.☆50Updated last year
- CodeAssist is an advanced code completion tool that provides high-quality code completions for Python, Java, C++ and so on. CodeAssist 是一…☆58Updated 11 months ago
- Imitate OpenAI with Local Models☆85Updated 5 months ago
- ☆81Updated 8 months ago
- Fast LLM Training CodeBase With dynamic strategy choosing [Deepspeed+Megatron+FlashAttention+CudaFusionKernel+Compiler];☆36Updated last year
- Evaluation for AI apps and agent☆36Updated last year
- Large language Model fintuning bloom , opt , gpt, gpt2 ,llama,llama-2,cpmant and so on☆96Updated 9 months ago
- SUS-Chat: Instruction tuning done right☆48Updated last year
- code for Scaling Laws of RoPE-based Extrapolation☆70Updated last year
- Generate multi-round conversation roleplay data based on self-instruct and evol-instruct.☆119Updated 3 weeks ago
- This is a text generation method which returns a generator, streaming out each token in real-time during inference, based on Huggingface/…☆96Updated 10 months ago
- Another ChatGLM2 implementation for GPTQ quantization☆54Updated last year
- Light local website for displaying performances from different chat models.☆85Updated last year
- Retrieves parquet files from Hugging Face, identifies and quantifies junky data, duplication, contamination, and biased content in datase…☆51Updated last year
- ☆16Updated 8 months ago
- The complete training code of the open-source high-performance Llama model, including the full process from pre-training to RLHF.☆64Updated last year
- The paddle implementation of meta's LLaMA.☆45Updated last year
- MultilingualShareGPT, the free multi-language corpus for LLM training☆73Updated last year
- Leveraging large language models for text-to-SQL synthesis, this project fine-tunes WizardLM/WizardCoder-15B-V1.0 with QLoRA on a custom …☆43Updated last year
- ☆51Updated 6 months ago
- 用于微调LLM的中文指令数据集☆27Updated last year
- Deployment a light and full OpenAI API for production with vLLM to support /v1/embeddings with all embeddings models.☆39Updated 6 months ago
- My implementation of "Algorithm of Thoughts: Enhancing Exploration of Ideas in Large Language Models"☆95Updated last year
- 基于baichuan-7b的开源多模态大语言模型☆73Updated last year
- 演示 vllm 对中文大语言模型的神奇效果☆31Updated last year
- ☆74Updated last year
- LLaMa Tuning with Stanford Alpaca Dataset using Deepspeed and Transformers☆50Updated last year
- Evaluating LLMs with Dynamic Data☆72Updated 2 months ago
- LongQLoRA: Extent Context Length of LLMs Efficiently☆163Updated last year