☆33May 23, 2023Updated 3 years ago
Alternatives and similar repositories for commoncrawl_downloader
Users that are interested in commoncrawl_downloader are comparing it to the libraries listed below. We may earn a commission when you buy through links labeled 'Ad' on this page.
Sorting:
- ☆18Dec 11, 2024Updated last year
- Downloads 2020 English Wikipedia articles as plaintext☆27Mar 25, 2023Updated 3 years ago
- ☆94Jul 16, 2022Updated 4 years ago
- ☆27Aug 18, 2023Updated 3 years ago
- Script for downloading GitHub.☆13Sep 24, 2020Updated 5 years ago
- Managed Database hosting by DigitalOcean • AdPostgreSQL, MySQL, MongoDB, Kafka, Valkey, and OpenSearch available. Automatically scale up storage and focus on building your apps.
- OpenAI Codex for Sublime Text☆11Sep 25, 2021Updated 4 years ago
- Python Research Framework☆107Nov 3, 2022Updated 3 years ago
- ☆26Mar 13, 2021Updated 5 years ago
- Useful prompts for interacting with an AI.☆14Jul 14, 2020Updated 6 years ago
- Scripts for building a geo-located web corpus using Common Crawl data☆11Jan 18, 2026Updated 7 months ago
- website for MS Marco☆37Mar 26, 2025Updated last year
- ☆13Feb 5, 2022Updated 4 years ago
- A TinyStories LM with SAEs and transcoders☆16Aug 19, 2026Updated 2 weeks ago
- This repo contains the code for Late Prompt Tuning.☆12Dec 22, 2025Updated 8 months ago
- End-to-end encrypted email - Proton Mail • AdSpecial offer: 40% Off Yearly / 80% Off First Month. All Proton services are open source and independently audited for security.
- ☆1,674Apr 27, 2023Updated 3 years ago
- "FiD-ICL: A Fusion-in-Decoder Approach for Efficient In-Context Learning" (ACL 2023)☆15Jul 24, 2023Updated 3 years ago
- A GPT-powered AI auto scraper for websites. AI Web Scraping made easy.☆13Jun 26, 2023Updated 3 years ago
- Remove generated stories with stray unicode characters☆12Jan 3, 2024Updated 2 years ago
- Scripts to parse arxiv documents for NLP tasks☆20Jun 12, 2023Updated 3 years ago
- A PyTorch toolbox for domain adaptation, domain generalization, federated learning DA/DG, active learning DA/DG, ALDG and semi-supervised…☆11Jan 10, 2022Updated 4 years ago
- Convert powerpoint (pptx) files into raw text org or LaTeX files☆15Aug 28, 2018Updated 8 years ago
- ☆12May 17, 2022Updated 4 years ago
- Implementation of Marge, Pre-training via Paraphrasing, in Pytorch☆76Jan 14, 2021Updated 5 years ago
- Managed hosting for WordPress and PHP on Cloudways • AdManaged hosting for WordPress, Magento, Laravel, or PHP apps, on multiple cloud providers. Deploy in minutes on Cloudways by DigitalOcean.
- ZYN: Zero-Shot Reward Models with Yes-No Questions☆34Aug 15, 2023Updated 3 years ago
- A pytorch implementation of spiral++☆11Mar 8, 2022Updated 4 years ago
- Script for downloading GitHub.☆99Jul 1, 2024Updated 2 years ago
- Babysit your preemptible TPUs☆87Dec 3, 2022Updated 3 years ago
- Tools for compiling corpora from Common Crawl☆14Nov 24, 2024Updated last year
- ## Step 1 - Scraping Complete your initial scraping using Jupyter Notebook, BeautifulSoup, Pandas, and Requests/Splinter. * Create a Ju…☆11Dec 22, 2021Updated 4 years ago
- repository for multishot system builder prototype☆17Jul 21, 2022Updated 4 years ago
- A robust web archive analytics toolkit☆146Aug 18, 2026Updated 3 weeks ago
- Web archiving utility library☆11Aug 2, 2026Updated last month
- Proton VPN Special Offer - Get 70% off • AdSpecial partner offer. Trusted by over 100 million users worldwide. Tested, Approved and Recommended by Experts.
- ☆13Jan 20, 2023Updated 3 years ago
- Evaluation tools shared across anserini, pyserini, and pygaggle☆36Aug 24, 2026Updated 2 weeks ago
- This is the implementation of CounterCurate, the data curation pipeline of both physical and semantic counterfactual image-caption pairs.☆19Jun 27, 2024Updated 2 years ago
- Helper to use Plotly in SvelteKit☆18Jul 12, 2022Updated 4 years ago
- Work-in-progress implementation of a mobile device management server☆17May 20, 2026Updated 3 months ago
- 深度学习可解释性论文汇总☆15Mar 3, 2021Updated 5 years ago
- Ongoing research training transformer models at scale☆18Jul 27, 2023Updated 3 years ago