Alternatives and similar repositories for redpajama:

Users that are interested in redpajama are comparing it to the libraries listed below

• Alignment-Lab-AI / datagen
  a pipeline for using api calls to agnostically convert unstructured data into structured training data
  ☆29Updated 4 months ago
• pacman100 / peft-codegen-25
  ☆24Updated last year
• explodinggradients / Funtuner
  Supervised instruction finetuning for LLM with HF trainer and Deepspeed
  ☆34Updated last year
• CarperAI / squeakily
  A library for squeakily cleaning and filtering language datasets.
  ☆45Updated last year
• google-research-datasets / QAmeleon
  QAmeleon introduces synthetic multilingual QA data using PaLM, a 540B large language model. This dataset was generated by prompt tuning P…
  ☆34Updated last year
• modal-labs / ci-on-modal
  A sample pattern for running CI tests on Modal
  ☆14Updated 4 months ago
• Scikud / AnythingButWrappers
  ☆13Updated last year
• philschmid / optimum-static-quantization
  ☆28Updated last year
• hamelsmu / ft-drift
  Check for data drift between two OpenAI multi-turn chat jsonl files.
  ☆37Updated 9 months ago
• CarperAI / treasure_trove
  ☆22Updated last year
• stephantul / unitoken
  Tokenization across languages. Useful as preprocessing for subword tokenization.
  ☆22Updated last year
• bhavsarpratik / semantic-search
  [WIP] Behold, semantic-search, built over sentence-transformers to make it easy for search engineers to evaluate, optimise and deploy mod…
  ☆15Updated last year
• kevinwu23 / StanfordFineTuneBench
  ☆27Updated 2 months ago
• deep-diver / LLM-Pref-Mark-UI
  ☆37Updated last year
• dm4ml / motion
  Framework for building and maintaining self-updating prompts for LLMs
  ☆59Updated 7 months ago
• sayakpaul / GCP-ML-API-Demos
  Contains Colab Notebooks show cool use-cases of different GCP ML APIs.
  ☆10Updated 4 years ago
• jquesnelle / sat-reading
  ☆20Updated last year
• kumar-shridhar / Screws
  SCREWS: A Modular Framework for Reasoning with Revisions
  ☆27Updated last year
• davanstrien / data-for-fine-tuning-llms
  ☆76Updated 7 months ago
• nbroad1881 / strideformer
  Using short models to classify long texts
  ☆21Updated last year
• weaviate-tutorials / Hurricane
  Writing Blog Posts with Generative Feedback Loops!
  ☆47Updated 10 months ago
• nateraw / lambdacloud
  An unofficial Python client library for Lambda Lab's Cloud Computing Platform
  ☆13Updated last year
• johnrobinsn / alpaca_lora_30b_4bit
  ☆18Updated last year
• Upaya07 / NeurIPS-llm-efficiency-challenge
  Code for NeurIPS LLM Efficiency Challenge
  ☆54Updated 9 months ago
• allenai / EmbeddingRecycling
  Embedding Recycling for Language models
  ☆38Updated last year
• catid / lllm
  Latent Large Language Models
  ☆17Updated 5 months ago
• ChrisHayduk / QLoRA-for-MLM
  QLoRA for Masked Language Modeling
  ☆21Updated last year
• tcapelle / mixtral
  Mixtral finetuning
  ☆19Updated 11 months ago
• IlyasMoutawwakil / py-txi
  A Python wrapper around HuggingFace's TGI (text-generation-inference) and TEI (text-embedding-inference) servers.
  ☆34Updated last month
• EleutherAI / semantic-memorization
  ☆45Updated 2 months ago