noanabeshima / wikipedia-downloader

Related projects ⓘ

Alternatives and complementary repositories for wikipedia-downloader

• EleutherAI / openwebtext2
  ☆86Updated 2 years ago
• EleutherAI / github-downloader
  Script for downloading GitHub.
  ☆88Updated 4 months ago
• leogao2 / lm_dataformat
  ☆76Updated 11 months ago
• EleutherAI / stackexchange-dataset
  Python tools for processing the stackexchange data dumps into a text dataset for Language Models
  ☆76Updated 11 months ago
• kaiokendev / cutoff-len-is-context-len
  Demonstration that finetuning RoPE model on larger sequences than the pre-trained model adapts the model context limit
  ☆63Updated last year
• daniel-furman / sft-demos
  Lightweight demos for finetuning LLMs. Powered by 🤗 transformers and open-source datasets.
  ☆64Updated 3 weeks ago
• bigcode-project / bigcode-analysis
  Repository for analysis and experiments in the BigCode project.
  ☆115Updated 7 months ago
• NolanoOrg / sparse_quant_llms
  SparseGPT + GPTQ Compression of LLMs like LLaMa, OPT, Pythia
  ☆41Updated last year
• jina-ai / textbook
  distill chatGPT coding ability into small model (1b)
  ☆24Updated last year
• CarperAI / squeakily
  A library for squeakily cleaning and filtering language datasets.
  ☆45Updated last year
• huggingface / bloom-jax-inference
  ☆64Updated 2 years ago
• huggingface / transformers_bloom_parallel
  Techniques used to run BLOOM at inference in parallel
  ☆37Updated 2 years ago
• explodinggradients / nemesis
  Reward Model framework for LLM RLHF
  ☆58Updated last year
• young-geng / koala_data_pipeline
  The data processing pipeline for the Koala chatbot language model
  ☆117Updated last year
• nyu-mll / ILF-for-code-generation
  ☆75Updated last year
• dust-tt / llama-ssp
  Experiments on speculative sampling with Llama models
  ☆117Updated last year
• LAION-AI / Open-Instruction-Generalist
  Open Instruction Generalist is an assistant trained on massive synthetic instructions to perform many millions of tasks
  ☆206Updated 10 months ago
• gpt4life / alpagasus
  Unofficial implementation of AlpaGasus
  ☆84Updated last year
• togethercomputer / Llama-2-7B-32K-Instruct
  ☆83Updated last year
• ChrisHayduk / qlora-multi-gpu
  QLoRA with Enhanced Multi GPU Support
  ☆36Updated last year
• gustavecortal / gpt-j-fine-tuning-example
  Fine-tuning 6-Billion GPT-J (& other models) with LoRA and 8-bit compression
  ☆65Updated 2 years ago
• kernelmachine / cbtm
  Code repository for the c-BTM paper
  ☆105Updated last year
• facebookresearch / lss_eval
  This is a new metric that can be used to evaluate faithfulness of text generated by LLMs. The work behind this repository can be found he…
  ☆31Updated last year
• xingyaoww / LeTI
  Official repo for NAACL 2024 Findings paper "LeTI: Learning to Generate from Textual Interactions."
  ☆62Updated last year
• seonghyeonye / Flipped-Learning
  [ICLR 2023] Guess the Instruction! Flipped Learning Makes Language Models Stronger Zero-Shot Learners
  ☆111Updated 2 months ago
• LLM360 / crystalcoder-train
  Pre-training code for CrystalCoder 7B LLM
  ☆53Updated 6 months ago
• CarperAI / treasure_trove
  ☆22Updated last year
• Lightning-Universe / lightning-ColossalAI
  Large Scale Distributed Model Training strategy with Colossal AI and Lightning AI
  ☆58Updated last year
• chu-tianxiang / QuIP-for-all
  QuIP quantization
  ☆46Updated 7 months ago