Alternatives and similar repositories for redpajama

Users that are interested in redpajama are comparing it to the libraries listed below

• pacman100 / peft-codegen-25
  ☆23Updated 2 years ago
• Alignment-Lab-AI / datagen
  a pipeline for using api calls to agnostically convert unstructured data into structured training data
  ☆30Updated 9 months ago
• modal-labs / ci-on-modal
  A sample pattern for running CI tests on Modal
  ☆18Updated 3 months ago
• CarperAI / squeakily
  A library for squeakily cleaning and filtering language datasets.
  ☆47Updated 2 years ago
• google-research-datasets / QAmeleon
  QAmeleon introduces synthetic multilingual QA data using PaLM, a 540B large language model. This dataset was generated by prompt tuning P…
  ☆34Updated last year
• dm4ml / motion
  Framework for building and maintaining self-updating prompts for LLMs
  ☆63Updated last year
• philschmid / optimum-static-quantization
  ☆28Updated 2 years ago
• explodinggradients / Funtuner
  Supervised instruction finetuning for LLM with HF trainer and Deepspeed
  ☆35Updated 2 years ago
• IBM / model-recycling
  Ranking of fine-tuned HF models as base models.
  ☆35Updated 2 months ago
• rwightman / genalog
  Genalog is an open source, cross-platform python package allowing generation of synthetic document images with custom degradations and te…
  ☆42Updated last year
• Upaya07 / NeurIPS-llm-efficiency-challenge
  Code for NeurIPS LLM Efficiency Challenge
  ☆59Updated last year
• krypticmouse / matryoshka-representation-learning
  PyTorch implementation for MRL
  ☆18Updated last year
• ChrisHayduk / QLoRA-for-MLM
  QLoRA for Masked Language Modeling
  ☆22Updated last year
• nateraw / lambdacloud
  An unofficial Python client library for Lambda Lab's Cloud Computing Platform
  ☆12Updated 2 years ago
• qdrant / quaterion-models
  The collection of bulding blocks building fine-tunable metric learning models
  ☆32Updated 3 months ago
• cleanlab / multiannotator-benchmarks
  Benchmarking algorithms for assessing quality of data labeled by multiple annotators
  ☆32Updated 2 years ago
• tanyuqian / cappy
  NeurIPS 2023 - Cappy: Outperforming and Boosting Large Multi-Task LMs with a Small Scorer
  ☆43Updated last year
• chainyo / tensorshare
  🤝 Trade any tensors over the network
  ☆30Updated last year
• siftly-ai / airdot-deployer
  Tool to take your ML model from local to production with one-line of code.
  ☆25Updated last year
• bhavsarpratik / semantic-search
  [WIP] Behold, semantic-search, built over sentence-transformers to make it easy for search engineers to evaluate, optimise and deploy mod…
  ☆15Updated 2 years ago
• allenai / EmbeddingRecycling
  Embedding Recycling for Language models
  ☆38Updated 2 years ago
• huggingface / disaggregators
  🤗 Disaggregators: Curated data labelers for in-depth analysis.
  ☆66Updated 2 years ago
• nbroad1881 / strideformer
  Using short models to classify long texts
  ☆21Updated 2 years ago
• rovle / gpt3-in-context-fitting
  Experiments on GPT-3's ability to fit numerical models in-context.
  ☆14Updated 2 years ago
• sayakpaul / GCP-ML-API-Demos
  Contains Colab Notebooks show cool use-cases of different GCP ML APIs.
  ☆10Updated 4 years ago
• hundredblocks / large-model-parallelism
  Functional local implementations of main model parallelism approaches
  ☆95Updated 2 years ago
• ConiferLabsWA / flan-ul2-alpaca
  ☆32Updated 2 years ago
• sgugger / hf_examples
  NLP Examples using the 🤗 libraries
  ☆41Updated 4 years ago
• shahrukhx01 / bert-probe
  BERT Probe: A python package for probing attention based robustness to character and word based adversarial evaluation. Also, with recipe…
  ☆18Updated 3 years ago
• ariG23498 / RNN_Viz
  Sequence models in Numpy
  ☆25Updated 4 years ago