Alternatives and similar repositories for wikipedia-downloader:

Users that are interested in wikipedia-downloader are comparing it to the libraries listed below

• EleutherAI / openwebtext2
  ☆89Updated 2 years ago
• leogao2 / lm_dataformat
  ☆77Updated last year
• EleutherAI / stackexchange-dataset
  Python tools for processing the stackexchange data dumps into a text dataset for Language Models
  ☆81Updated last year
• leogao2 / commoncrawl_downloader
  ☆33Updated last year
• young-geng / koala_data_pipeline
  The data processing pipeline for the Koala chatbot language model
  ☆117Updated last year
• EleutherAI / github-downloader
  Script for downloading GitHub.
  ☆91Updated 8 months ago
• LLM360 / crystalcoder-data-prep
  Data preparation code for CrystalCoder 7B LLM
  ☆44Updated 10 months ago
• kaiokendev / cutoff-len-is-context-len
  Demonstration that finetuning RoPE model on larger sequences than the pre-trained model adapts the model context limit
  ☆63Updated last year
• jina-ai / textbook
  distill chatGPT coding ability into small model (1b)
  ☆28Updated last year
• huggingface / transformers_bloom_parallel
  Techniques used to run BLOOM at inference in parallel
  ☆37Updated 2 years ago
• facebookresearch / lss_eval
  This is a new metric that can be used to evaluate faithfulness of text generated by LLMs. The work behind this repository can be found he…
  ☆31Updated last year
• bigcode-project / bigcode-analysis
  Repository for analysis and experiments in the BigCode project.
  ☆117Updated last year
• NolanoOrg / sparse_quant_llms
  SparseGPT + GPTQ Compression of LLMs like LLaMa, OPT, Pythia
  ☆41Updated 2 years ago
• seonghyeonye / Flipped-Learning
  [ICLR 2023] Guess the Instruction! Flipped Learning Makes Language Models Stronger Zero-Shot Learners
  ☆113Updated 6 months ago
• xingyaoww / LeTI
  Official repo for NAACL 2024 Findings paper "LeTI: Learning to Generate from Textual Interactions."
  ☆63Updated last year
• GAIR-NLP / Entropy-ABF
  Official implementation for 'Extending LLMs’ Context Window with 100 Samples'
  ☆75Updated last year
• akjindal53244 / Arithmo
  Small and Efficient Mathematical Reasoning LLMs
  ☆71Updated last year
• lxe / llama-tune
  LLaMa Tuning with Stanford Alpaca Dataset using Deepspeed and Transformers
  ☆51Updated 2 years ago
• thunlp / Ouroboros
  Ouroboros: Speculative Decoding with Large Model Enhanced Drafting (EMNLP 2024 main)
  ☆87Updated this week
• yizhongw / Tk-Instruct
  Tk-Instruct is a Transformer model that is tuned to solve many NLP tasks by following instructions.
  ☆179Updated 2 years ago
• facebookresearch / concurrentqa
  This repo contains data and code for the paper "Reasoning over Public and Private Data in Retrieval-Based Systems."
  ☆46Updated 8 months ago
• thoppe / The-Pile-FreeLaw
  Download, parse, and filter data from Court Listener, part of the FreeLaw projects. Data-ready for The-Pile.
  ☆11Updated last year
• jina-ai / jerboa
  LLM finetuning
  ☆42Updated last year
• hpcaitech / Titans
  A collection of models built with ColossalAI
  ☆32Updated 2 years ago
• Agora-Lab-AI / Orca
  An Implementation of "Orca: Progressive Learning from Complex Explanation Traces of GPT-4"
  ☆44Updated 5 months ago
• EleutherAI / best-download
  URL downloader supporting checkpointing and continuous checksumming.
  ☆19Updated last year
• orionw / FollowIR
  FollowIR: Evaluating and Teaching Information Retrieval Models to Follow Instructions
  ☆42Updated 8 months ago
• togethercomputer / Llama-2-7B-32K-Instruct
  ☆84Updated last year