Python tools for processing the stackexchange data dumps into a text dataset for Language Models
☆86Dec 6, 2023Updated 2 years ago
Alternatives and similar repositories for stackexchange-dataset
Users that are interested in stackexchange-dataset are comparing it to the libraries listed below
Sorting:
- C4RepSet: Representative Subset from C4 data for Training Pre-trained LMs☆11Jan 13, 2023Updated 3 years ago
- Load, build and explore Patstat using the Google Cloud Platform☆10Jan 19, 2019Updated 7 years ago
- benchmarks for evaluating MT models☆11Jun 26, 2024Updated last year
- Analytic platform for the HAL research archive (in development)☆13Oct 2, 2020Updated 5 years ago
- This repository contains all the code for collecting large scale amounts of code from GitHub.☆110Feb 17, 2023Updated 3 years ago
- Specification of a stand-off element for the TEI guidelines☆12Apr 29, 2021Updated 4 years ago
- 中文原生等级化代码能力测试基准☆15Apr 11, 2024Updated last year
- Web UI & Backend for Data Annotations in Aya☆30Mar 16, 2024Updated last year
- ☆13Sep 6, 2022Updated 3 years ago
- Bouton ISTEX : extension web capable d'insérer dynamiquement sur la page web consultée un lien vers le fulltext d'un document si ce dern…☆11May 30, 2023Updated 2 years ago
- The official implementation for ACL 2021 "Challenges in Information Seeking QA: Unanswerable Questions and Paragraph Retrieval".☆28Jun 19, 2021Updated 4 years ago
- DeepSearchRelevanceRanking-KDD2022-Tutorial☆15Aug 23, 2022Updated 3 years ago
- Dataset of personal narratives with Advice Seeking Questions☆15May 10, 2019Updated 6 years ago
- Repository for Multilingual-VQA task created during HuggingFace JAX/Flax community week.☆34Jul 27, 2021Updated 4 years ago
- Hugging Face and Pyserini interoperability☆19May 18, 2023Updated 2 years ago
- Code & data for EMNLP 2020 paper "MOCHA: A Dataset for Training and Evaluating Reading Comprehension Metrics".☆16May 3, 2022Updated 3 years ago
- The official code and dataset for EMNLP 2022 paper "COPEN: Probing Conceptual Knowledge in Pre-trained Language Models".☆21Mar 9, 2023Updated 3 years ago
- Package and scripts used to build a dataset of Wikipedia articles in Markdown.☆20Sep 11, 2023Updated 2 years ago
- Mining tool and large-scale datasets of single statement bug fixes in Python☆19Nov 29, 2023Updated 2 years ago
- Minimum Description Length probing for neural network representations☆20Jan 28, 2025Updated last year
- SuperCLUE高考作文机器自动阅卷系统☆17Jun 8, 2023Updated 2 years ago
- ☆1,636Apr 27, 2023Updated 2 years ago
- ☆44Nov 17, 2024Updated last year
- ☆44Jun 2, 2024Updated last year
- ☆23Jan 27, 2025Updated last year
- SciKnowEval: Evaluating Multi-level Scientific Knowledge of Large Language Models☆26Jul 13, 2025Updated 7 months ago
- ☆27Aug 27, 2025Updated 6 months ago
- Code for "[COLM'25] RepoST: Scalable Repository-Level Coding Environment Construction with Sandbox Testing"☆23Mar 18, 2025Updated 11 months ago
- A library for bridging Python and HTML/Javascript (via Svelte) for creating interactive visualizations☆15Apr 15, 2024Updated last year
- ☆45Dec 12, 2024Updated last year
- ☆17Nov 7, 2024Updated last year
- Scripts for downloading and pre-processing the `proof-pile`, a high quality dataset of mathematical text and code.☆22Nov 26, 2022Updated 3 years ago
- CD4Py: Code De-Duplication for Python☆23Dec 13, 2020Updated 5 years ago
- YT_subtitles - extracts subtitles from YouTube videos to raw text for Language Model training☆47Sep 22, 2020Updated 5 years ago
- [ACL 2024 Findings] The official repo for "ConceptMath: A Bilingual Concept-wise Benchmark for Measuring Mathematical Reasoning of Large …☆24May 29, 2024Updated last year
- Repo for "Smart Word Suggestions" (SWS) task and benchmark☆20Dec 4, 2023Updated 2 years ago
- Extracts a single frame from a video.☆16Dec 7, 2022Updated 3 years ago
- Practical Natural Language Processing Tools for Humans is build on the top of Senna Natural Language Processing (NLP) predictions: part-…☆22Jun 11, 2021Updated 4 years ago
- [ACL 2024 Findings] CriticBench: Benchmarking LLMs for Critique-Correct Reasoning☆30Mar 5, 2024Updated 2 years ago