Alternatives and similar repositories for language-model-agents:

Users that are interested in language-model-agents are comparing it to the libraries listed below

• kyleliang919 / Long-context-transformers
  Exploring finetuning public checkpoints on filter 8K sequences on Pile
  ☆115Updated 2 years ago
• LAION-AI / Anh
  Anh - LAION's multilingual assistant datasets and models
  ☆27Updated 2 years ago
• shayne-longpre / a-pretrainers-guide
  ☆72Updated last year
• EleutherAI / semantic-memorization
  ☆44Updated 5 months ago
• huggingface / olm-training
  Repo for training MLMs, CLMs, or T5-type models on the OLM pretraining data, but it should work with any hugging face text dataset.
  ☆93Updated 2 years ago
• google-research-datasets / QAmeleon
  QAmeleon introduces synthetic multilingual QA data using PaLM, a 540B large language model. This dataset was generated by prompt tuning P…
  ☆34Updated last year
• huggingface / olm-datasets
  Pipeline for pulling and processing online language model pretraining data from the web
  ☆177Updated last year
• gsarti / t5-flax-gcp
  Tutorial to pretrain & fine-tune a 🤗 Flax T5 model on a TPUv3-8 with GCP
  ☆58Updated 2 years ago
• huu4ontocord / MDEL
  Multi-Domain Expert Learning
  ☆67Updated last year
• kernelmachine / cbtm
  Code repository for the c-BTM paper
  ☆106Updated last year
• CarperAI / squeakily
  A library for squeakily cleaning and filtering language datasets.
  ☆47Updated last year
• zphang / minimal-opt
  ☆67Updated 2 years ago
• leehanchung / lora-instruct
  Finetune Falcon, LLaMA, MPT, and RedPajama on consumer hardware using PEFT LoRA
  ☆103Updated 9 months ago
• CarperAI / InstructGPT
  For experiments involving instruct gpt. Currently used for documenting open research questions.
  ☆71Updated 2 years ago
• LAION-AI / blade2blade
  Adversarial Training and SFT for Bot Safety Models
  ☆39Updated 2 years ago
• CarperAI / decontamination
  This repository contains code for cleaning your training data of benchmark data to help combat data snooping.
  ☆25Updated 2 years ago
• seonghyeonye / TAPP
  [AAAI 2024] Investigating the Effectiveness of Task-Agnostic Prefix Prompt for Instruction Following
  ☆79Updated 7 months ago
• microsoft / mutransformers
  some common Huggingface transformers in maximal update parametrization (µP)
  ☆80Updated 3 years ago
• kaiokendev / cutoff-len-is-context-len
  Demonstration that finetuning RoPE model on larger sequences than the pre-trained model adapts the model context limit
  ☆63Updated last year
• facebookresearch / NPM
  The original implementation of Min et al. "Nonparametric Masked Language Modeling" (paper https//arxiv.org/abs/2212.01349)
  ☆157Updated 2 years ago
• basusourya / mirostat
  Code for the paper-"Mirostat: A Perplexity-Controlled Neural Text Decoding Algorithm" (https://arxiv.org/abs/2007.14966).
  ☆58Updated 3 years ago
• google-research-datasets / presto
  A Multilingual Dataset for Parsing Realistic Task-Oriented Dialogs
  ☆114Updated 2 years ago
• babylm / evaluation-pipeline-2023
  Evaluation pipeline for the BabyLM Challenge 2023.
  ☆75Updated last year
• seonghyeonye / Flipped-Learning
  [ICLR 2023] Guess the Instruction! Flipped Learning Makes Language Models Stronger Zero-Shot Learners
  ☆115Updated 7 months ago
• huggingface / bloom-jax-inference
  ☆67Updated 2 years ago
• imoneoi / multipack_sampler
  Multipack distributed sampler for fast padding-free training of LLMs
  ☆188Updated 8 months ago
• radi-cho / RSTOD
  Auxiliary tasks for task-oriented dialogue systems. Published in ICNLSP'22 and indexed in the ACL Anthology.
  ☆17Updated 2 years ago
• deep-diver / LLM-Pref-Mark-UI
  ☆37Updated last year
• Langboat / mengzi-retrieval-lm
  An experimental implementation of the retrieval-enhanced language model
  ☆74Updated 2 years ago
• EleutherAI / stackexchange-dataset
  Python tools for processing the stackexchange data dumps into a text dataset for Language Models
  ☆81Updated last year