Alternatives and similar repositories for wikipedia-downloader:

Users that are interested in wikipedia-downloader are comparing it to the libraries listed below

• EleutherAI / openwebtext2
  ☆89Updated 2 years ago
• leogao2 / lm_dataformat
  ☆77Updated last year
• EleutherAI / stackexchange-dataset
  Python tools for processing the stackexchange data dumps into a text dataset for Language Models
  ☆81Updated last year
• EleutherAI / github-downloader
  Script for downloading GitHub.
  ☆91Updated 9 months ago
• Narsil / bloomserver
  ☆39Updated 2 years ago
• CarperAI / squeakily
  A library for squeakily cleaning and filtering language datasets.
  ☆47Updated last year
• LLM360 / crystalcoder-train
  Pre-training code for CrystalCoder 7B LLM
  ☆54Updated 11 months ago
• kaiokendev / cutoff-len-is-context-len
  Demonstration that finetuning RoPE model on larger sequences than the pre-trained model adapts the model context limit
  ☆63Updated last year
• bigcode-project / bigcode-analysis
  Repository for analysis and experiments in the BigCode project.
  ☆117Updated last year
• finetunej / transformers
  🤗Transformers: State-of-the-art Natural Language Processing for Pytorch and TensorFlow 2.0.
  ☆56Updated 3 years ago
• qwopqwop200 / gptqlora
  GPTQLoRA: Efficient Finetuning of Quantized LLMs with GPTQ
  ☆102Updated last year
• jina-ai / textbook
  distill chatGPT coding ability into small model (1b)
  ☆28Updated last year
• hpcaitech / Titans
  A collection of models built with ColossalAI
  ☆32Updated 2 years ago
• huggingface / transformers_bloom_parallel
  Techniques used to run BLOOM at inference in parallel
  ☆37Updated 2 years ago
• Agora-Lab-AI / Orca
  An Implementation of "Orca: Progressive Learning from Complex Explanation Traces of GPT-4"
  ☆43Updated 6 months ago
• facebookresearch / lss_eval
  This is a new metric that can be used to evaluate faithfulness of text generated by LLMs. The work behind this repository can be found he…
  ☆31Updated last year
• LLM360 / crystalcoder-data-prep
  Data preparation code for CrystalCoder 7B LLM
  ☆44Updated 11 months ago
• GAIR-NLP / Entropy-ABF
  Official implementation for 'Extending LLMs’ Context Window with 100 Samples'
  ☆76Updated last year
• leogao2 / commoncrawl_downloader
  ☆33Updated last year
• chu-tianxiang / QuIP-for-all
  QuIP quantization
  ☆52Updated last year
• xingyaoww / LeTI
  Official repo for NAACL 2024 Findings paper "LeTI: Learning to Generate from Textual Interactions."
  ☆63Updated last year
• EleutherAI / lm_perplexity
  ☆148Updated 4 years ago
• ChrisHayduk / qlora-multi-gpu
  QLoRA with Enhanced Multi GPU Support
  ☆37Updated last year
• choosewhatulike / case2code
  ☆15Updated last week
• LLM360 / Analysis360
  Open Implementations of LLM Analyses
  ☆102Updated 6 months ago
• IST-DASLab / QIGen
  Repository for CPU Kernel Generation for LLM Inference
  ☆25Updated last year
• daniel-furman / sft-demos
  Lightweight demos for finetuning LLMs. Powered by 🤗 transformers and open-source datasets.
  ☆73Updated 5 months ago
• LLM360 / amber-data-prep
  Data preparation code for Amber 7B LLM
  ☆87Updated 11 months ago
• umass-ml4ed / mathGPT
  A GPT-based generative LM for combined text and math formulas, leveraging tree-based formula encoding.
  ☆35Updated last year
• swj0419 / detect-pretrain-code-contamination
  ☆74Updated last year