vtuber-plan / langport
Langport is a language model inference service
☆94Updated 8 months ago
Alternatives and similar repositories for langport
Users that are interested in langport are comparing it to the libraries listed below
Sorting:
- MultilingualShareGPT, the free multi-language corpus for LLM training☆72Updated 2 years ago
- A high-throughput and memory-efficient inference and serving engine for LLMs☆131Updated 10 months ago
- Evaluation for AI apps and agent☆41Updated last year
- Open efforts to implement ChatGPT-like models and beyond.☆107Updated 9 months ago
- The paddle implementation of meta's LLaMA.☆45Updated 2 years ago
- Leveraging large language models for text-to-SQL synthesis, this project fine-tunes WizardLM/WizardCoder-15B-V1.0 with QLoRA on a custom …☆44Updated last year
- Train llama with lora on one 4090 and merge weight of lora to work as stanford alpaca.☆51Updated last year
- Imitate OpenAI with Local Models☆87Updated 8 months ago
- ☆82Updated last year
- This is a text generation method which returns a generator, streaming out each token in real-time during inference, based on Huggingface/…☆95Updated last year
- CodeLLaMA 中文版 - 代码生成助手,huggingface累积下载2w+次☆45Updated last year
- Another ChatGLM2 implementation for GPTQ quantization☆54Updated last year
- CodeAssist is an advanced code completion tool that provides high-quality code completions for Python, Java, C++ and so on. CodeAssist 是一…☆58Updated last year
- Fast LLM Training CodeBase With dynamic strategy choosing [Deepspeed+Megatron+FlashAttention+CudaFusionKernel+Compiler];☆37Updated last year
- An Experiment on Dynamic NTK Scaling RoPE☆64Updated last year
- Inference script for Meta's LLaMA models using Hugging Face wrapper☆109Updated 2 years ago
- ☆32Updated 2 years ago
- ☆51Updated 9 months ago
- Retrieves parquet files from Hugging Face, identifies and quantifies junky data, duplication, contamination, and biased content in datase…☆53Updated last year
- ☆34Updated last year
- LLaMa Tuning with Stanford Alpaca Dataset using Deepspeed and Transformers☆51Updated 2 years ago
- The source code and dataset mentioned in the paper Seal-Tools: Self-Instruct Tool Learning Dataset for Agent Tuning and Detailed Benchmar…☆48Updated 6 months ago
- Generate multi-round conversation roleplay data based on self-instruct and evol-instruct.☆126Updated 4 months ago
- fastertransformer for codegeex model☆63Updated last year
- Data preparation code for CrystalCoder 7B LLM☆44Updated last year
- ☆40Updated last year
- Unofficial implementation of AlpaGasus☆91Updated last year
- This is a personal reimplementation of Google's Infini-transformer, utilizing a small 2b model. The project includes both model and train…☆56Updated last year
- Light local website for displaying performances from different chat models.☆86Updated last year
- ☆16Updated 11 months ago