Alternatives and similar repositories for transformers-stream-generator

Users that are interested in transformers-stream-generator are comparing it to the libraries listed below

• THUDM / icetk
  A unified tokenization tool for Images, Chinese and English.
  ☆153Updated 2 years ago
• HuangLK / transpeeder
  train llama on a single A100 80G node using 🤗 transformers and 🚀 Deepspeed Pipeline Parallelism
  ☆225Updated 2 years ago
• the-seeds / imitater
  Imitate OpenAI with Local Models
  ☆89Updated last year
• OpenLMLab / scaling-rope
  code for Scaling Laws of RoPE-based Extrapolation
  ☆73Updated 2 years ago
• bigscience-workshop / data-preparation
  Code used for sourcing and cleaning the BigScience ROOTS corpus
  ☆316Updated 2 years ago
• chu-tianxiang / vllm-gptq
  A high-throughput and memory-efficient inference and serving engine for LLMs
  ☆131Updated last year
• zsc / llama_infer
  Inference script for Meta's LLaMA models using Hugging Face wrapper
  ☆110Updated 2 years ago
• ProjectD-AI / LLaMA-Megatron-DeepSpeed
  Ongoing research training transformer language models at scale, including: BERT & GPT-2
  ☆68Updated 2 years ago
• DachengLi1 / LongChat
  Official repository for LongChat and LongEval
  ☆531Updated last year
• QwenLM / vllm-gptq
  A high-throughput and memory-efficient inference and serving engine for LLMs
  ☆138Updated 11 months ago
• hpcaitech / PaLM-colossalai
  Scalable PaLM implementation of PyTorch
  ☆188Updated 2 years ago
• liutiedong / goat
  a Fine-tuned LLaMA that is Good at Arithmetic Tasks
  ☆178Updated 2 years ago
• shjwudp / c4-dataset-script
  Inspired by google c4, here is a series of colossal clean data cleaning scripts focused on CommonCrawl data processing. Including Chinese…
  ☆131Updated 2 years ago
• Guanaco-Model / Guanaco-Model.github.io
  ☆123Updated last year
• SunLemuria / OpenGPTAndBeyond
  Open efforts to implement ChatGPT-like models and beyond.
  ☆107Updated last year
• FlagOpen / FlagInstruct
  ☆172Updated 2 years ago
• OpenLMLab / ChatZoo
  Light local website for displaying performances from different chat models.
  ☆87Updated 2 years ago
• CoinCheung / gdGPT
  Train llm (bloom, llama, baichuan2-7b, chatglm3-6b) with deepspeed pipeline mode. Faster than zero/zero++/fsdp.
  ☆98Updated last year
• beichao1314 / Open-Llama
  The complete training code of the open-source high-performance Llama model, including the full process from pre-training to RLHF.
  ☆67Updated 2 years ago
• keezen / ntk_alibi
  NTK scaled version of ALiBi position encoding in Transformer.
  ☆69Updated 2 years ago
• seanzhang-zhichen / baichuan-Dynamic-NTK-ALiBi
  百川Dynamic NTK-ALiBi的代码实现：无需微调即可推理更长文本
  ☆49Updated 2 years ago
• LAION-AI / Open-Instruction-Generalist
  Open Instruction Generalist is an assistant trained on massive synthetic instructions to perform many millions of tasks
  ☆209Updated last year
• OpenBMB / DecT
  Source code for ACL 2023 paper Decoder Tuning: Efficient Language Understanding as Decoding
  ☆51Updated 2 years ago
• alanshi / charset_mnbvc
  本项目旨在对大量文本文件进行快速编码检测和转换以辅助mnbvc语料集项目的数据清洗工作
  ☆67Updated last month
• yangjianxin1 / LongQLoRA
  LongQLoRA: Extent Context Length of LLMs Efficiently
  ☆167Updated 2 years ago
• RWKV-Wiki / MultilingualShareGPT
  MultilingualShareGPT, the free multi-language corpus for LLM training
  ☆73Updated 2 years ago
• bojone / NBCE
  Naive Bayes-based Context Extension
  ☆325Updated 11 months ago
• xverse-ai / XVERSE-65B
  XVERSE-65B: A multilingual large language model developed by XVERSE Technology Inc.
  ☆141Updated last year
• feizc / MLE-LLaMA
  Multi-language Enhanced LLaMA
  ☆303Updated 2 years ago
• icip-cas / ChatAlpaca
  A Multi-Turn Dialogue Corpus based on Alpaca Instructions
  ☆177Updated 2 years ago