Alternatives and similar repositories for wikipedia-downloader

Users that are interested in wikipedia-downloader are comparing it to the libraries listed below

• EleutherAI / openwebtext2
  ☆90Updated 2 years ago
• leogao2 / lm_dataformat
  ☆78Updated last year
• CarperAI / squeakily
  A library for squeakily cleaning and filtering language datasets.
  ☆47Updated last year
• EleutherAI / stackexchange-dataset
  Python tools for processing the stackexchange data dumps into a text dataset for Language Models
  ☆81Updated last year
• facebookresearch / lss_eval
  This is a new metric that can be used to evaluate faithfulness of text generated by LLMs. The work behind this repository can be found he…
  ☆31Updated last year
• choosewhatulike / case2code
  ☆15Updated 2 months ago
• EleutherAI / github-downloader
  Script for downloading GitHub.
  ☆95Updated 11 months ago
• bigcode-project / bigcode-analysis
  Repository for analysis and experiments in the BigCode project.
  ☆119Updated last year
• xingyaoww / LeTI
  Official repo for NAACL 2024 Findings paper "LeTI: Learning to Generate from Textual Interactions."
  ☆65Updated last year
• Narsil / bloomserver
  ☆39Updated 2 years ago
• young-geng / koala_data_pipeline
  The data processing pipeline for the Koala chatbot language model
  ☆117Updated 2 years ago
• castorini / hf-spacerini
  Plug-and-play Search Interfaces with Pyserini and Hugging Face
  ☆32Updated last year
• huggingface / transformers_bloom_parallel
  Techniques used to run BLOOM at inference in parallel
  ☆37Updated 2 years ago
• arnav-gudibande / koala-test-set
  The test set for Koala
  ☆45Updated 2 years ago
• Edward-Sun / RECITE
  Code of ICLR paper: https://openreview.net/forum?id=-cqvvvb-NkI
  ☆94Updated 2 years ago
• scottlogic-alex / prm800k-denorm
  Script for processing OpenAI's PRM800K process supervision dataset into an Alpaca-style instruction-response format
  ☆27Updated last year
• CarperAI / autocrit
  A repository for transformer critique learning and generation
  ☆90Updated last year
• argilla-io / distilabel-spin-dibt
  Repository containing the SPIN experiments on the DIBT 10k ranked prompts
  ☆24Updated last year
• leogao2 / commoncrawl_downloader
  ☆33Updated 2 years ago
• xlang-ai / batch-prompting
  [EMNLP 2023 Industry Track] A simple prompting approach that enables the LLMs to run inference in batches.
  ☆74Updated last year
• CarperAI / decontamination
  This repository contains code for cleaning your training data of benchmark data to help combat data snooping.
  ☆25Updated 2 years ago
• seonghyeonye / TAPP
  [AAAI 2024] Investigating the Effectiveness of Task-Agnostic Prefix Prompt for Instruction Following
  ☆79Updated 9 months ago
• kaiokendev / cutoff-len-is-context-len
  Demonstration that finetuning RoPE model on larger sequences than the pre-trained model adapts the model context limit
  ☆63Updated 2 years ago
• AlanAnsell / peft
  ☆18Updated 11 months ago
• Raibows / Learn-to-Reason
  Code for "Democratizing Reasoning Ability: Tailored Learning from Large Language Model", EMNLP 2023
  ☆35Updated last year
• yizhongw / Tk-Instruct
  Tk-Instruct is a Transformer model that is tuned to solve many NLP tasks by following instructions.
  ☆180Updated 2 years ago
• akjindal53244 / Arithmo
  Small and Efficient Mathematical Reasoning LLMs
  ☆71Updated last year
• LLM360 / crystalcoder-train
  Pre-training code for CrystalCoder 7B LLM
  ☆54Updated last year
• EleutherAI / pile-cc
  ☆16Updated 3 years ago
• explodinggradients / nemesis
  Reward Model framework for LLM RLHF
  ☆61Updated 2 years ago