vtuber-plan / langport
Langport is a language model inference service
☆94Updated 7 months ago
Alternatives and similar repositories for langport:
Users that are interested in langport are comparing it to the libraries listed below
- Train llama with lora on one 4090 and merge weight of lora to work as stanford alpaca.☆51Updated last year
- MultilingualShareGPT, the free multi-language corpus for LLM training☆73Updated 2 years ago
- Leveraging large language models for text-to-SQL synthesis, this project fine-tunes WizardLM/WizardCoder-15B-V1.0 with QLoRA on a custom …☆43Updated last year
- A high-throughput and memory-efficient inference and serving engine for LLMs☆131Updated 10 months ago
- Evaluation for AI apps and agent☆40Updated last year
- LLaMa Tuning with Stanford Alpaca Dataset using Deepspeed and Transformers☆51Updated 2 years ago
- ☆82Updated 11 months ago
- This is a text generation method which returns a generator, streaming out each token in real-time during inference, based on Huggingface/…☆95Updated last year
- Large language Model fintuning bloom , opt , gpt, gpt2 ,llama,llama-2,cpmant and so on☆97Updated last year
- CodeAssist is an advanced code completion tool that provides high-quality code completions for Python, Java, C++ and so on. CodeAssist 是一…☆58Updated last year
- The paddle implementation of meta's LLaMA.☆45Updated 2 years ago
- Inference script for Meta's LLaMA models using Hugging Face wrapper☆110Updated 2 years ago
- CodeLLaMA 中文版 - 代码生成助手,huggingface累积下载2w+次☆45Updated last year
- ☆16Updated 10 months ago
- ☆51Updated 9 months ago
- Open Source Text Embedding Models with OpenAI Compatible API☆152Updated 9 months ago
- Open efforts to implement ChatGPT-like models and beyond.☆107Updated 9 months ago
- This project is established for real-time training of the RWKV model.☆49Updated 11 months ago
- My implementation of "Algorithm of Thoughts: Enhancing Exploration of Ideas in Large Language Models"☆98Updated last year
- Retrieves parquet files from Hugging Face, identifies and quantifies junky data, duplication, contamination, and biased content in datase…☆54Updated last year
- Deployment a light and full OpenAI API for production with vLLM to support /v1/embeddings with all embeddings models.☆42Updated 9 months ago
- rwkv finetuning☆36Updated last year
- Implementation of Toolformer: Language Models Can Teach Themselves to Use Tools☆138Updated 2 years ago
- Evaluating LLMs with Dynamic Data☆82Updated 2 months ago
- ☆19Updated 4 months ago
- SUS-Chat: Instruction tuning done right☆48Updated last year
- An Experiment on Dynamic NTK Scaling RoPE☆63Updated last year
- Enhancing LangChain prompts to work better with RWKV models☆34Updated last year
- Official implementation for 'Extending LLMs’ Context Window with 100 Samples'☆76Updated last year
- A simple LangChain-like implementation based on Sentence Embedding+local knowledge base, with Vicuna (FastChat) serving as the LLM. Suppo…☆92Updated last year