Python tools for processing the stackexchange data dumps into a text dataset for Language Models
☆86Dec 6, 2023Updated 2 years ago
Alternatives and similar repositories for stackexchange-dataset
Users that are interested in stackexchange-dataset are comparing it to the libraries listed below. We may earn a commission when you buy through links labeled 'Ad' on this page.
Sorting:
- Load, build and explore Patstat using the Google Cloud Platform☆10Jan 19, 2019Updated 7 years ago
- Bouton ISTEX : extension web capable d'insérer dynamiquement sur la page web consultée un lien vers le fulltext d'un document si ce dern…☆11May 30, 2023Updated 3 years ago
- Specification of a stand-off element for the TEI guidelines☆12Apr 29, 2021Updated 5 years ago
- Mining tool and large-scale datasets of single statement bug fixes in Python☆19Nov 29, 2023Updated 2 years ago
- Inter-annotator agreement for Doccano☆28May 3, 2020Updated 6 years ago
- AI Agents on DigitalOcean Gradient AI Platform • AdBuild production-ready AI agents using customizable tools or access multiple LLMs through a single endpoint. Create custom knowledge bases or connect external data.
- Anh - LAION's multilingual assistant datasets and models☆28Apr 5, 2023Updated 3 years ago
- This repository contains all the code for collecting large scale amounts of code from GitHub.☆110Feb 17, 2023Updated 3 years ago
- Knowledge Base stuff☆23Mar 1, 2026Updated 7 months ago
- Binary format parsing made easier☆13Dec 31, 2018Updated 7 years ago
- ☆44Jun 2, 2024Updated 2 years ago
- ☆1,679Apr 27, 2023Updated 3 years ago
- [ACL 2024] Novel reranking method to select the best solutions for code generation☆16Jun 9, 2024Updated 2 years ago
- A collection of recent papers, benchmarks and datasets of AI4Code domain.☆61Apr 23, 2024Updated 2 years ago
- Scripts for downloading and pre-processing the `proof-pile`, a high quality dataset of mathematical text and code.☆23Nov 26, 2022Updated 3 years ago
- Proton VPN Special Offer - Get 70% off • AdSpecial partner offer. Trusted by over 100 million users worldwide. Tested, Approved and Recommended by Experts.
- Source code and data for the paper "Towards String-to-Tree Neural Machine Translation"☆16Dec 31, 2017Updated 8 years ago
- Standalone pre-training recipe with JAX+Flax☆35Apr 3, 2023Updated 3 years ago
- Trigger an LLM in your CI/CD to auto-complete your work☆11Apr 5, 2023Updated 3 years ago
- CD4Py: Code De-Duplication for Python☆24Dec 13, 2020Updated 5 years ago
- A command line tool that helps use the "Zero Ressource Challenge" benchmarks☆12Jul 8, 2024Updated 2 years ago
- Open Access PDF harvester☆42May 3, 2024Updated 2 years ago
- Downloads 2020 English Wikipedia articles as plaintext☆27Mar 25, 2023Updated 3 years ago
- A Keras version of Google's BERT model☆35Nov 4, 2019Updated 6 years ago
- Sisyphe is a modulable NodeJS BIG-DATA analyser & transformer☆12Oct 16, 2023Updated 3 years ago
- Deploy to Railway using AI coding agents - Free Credits Offer • AdUse Claude Code, Codex, OpenCode, and more. Autonomous software development now has the infrastructure to match with Railway.
- Fast and memory-efficient exact attention ported to rocm☆13Dec 1, 2023Updated 2 years ago
- Simplified version of a common crawl fetcher☆17Oct 12, 2026Updated last week
- Terminal tool that converts files encoding to UTF-8☆10Oct 5, 2019Updated 7 years ago
- ☆13Sep 6, 2022Updated 4 years ago
- A simple REPL for Lean 4, returning information about errors and sorries.☆12Jun 19, 2023Updated 3 years ago
- Continuous Meme Delivery☆12Dec 7, 2022Updated 3 years ago
- Techniques used to run BLOOM at inference in parallel☆36Oct 21, 2022Updated 4 years ago
- Type4Py: Deep Similarity Learning-Based Type Inference for Python☆67Sep 6, 2023Updated 3 years ago
- Open-source Self-Instruction Tuning Code LLM☆174Apr 26, 2023Updated 3 years ago
- Deploy to Railway using AI coding agents - Free Credits Offer • AdUse Claude Code, Codex, OpenCode, and more. Autonomous software development now has the infrastructure to match with Railway.
- Download, parse, and filter data from Court Listener, part of the FreeLaw projects. Data-ready for The-Pile.☆16Jun 3, 2023Updated 3 years ago
- Task Compass: Scaling Multi-task Pre-training with Task Prefix (EMNLP 2022: Findings) (stay tuned & more will be updated)☆22Oct 17, 2022Updated 4 years ago
- The code implementation of the EMNLP2022 paper: DisCup: Discriminator Cooperative Unlikelihood Prompt-tuning for Controllable Text Gene…☆27Nov 13, 2023Updated 2 years ago
- A lightweight, user-friendly data-plane for LLM training.☆43Sep 10, 2025Updated last year
- Bilingual sentence similarity classifier using Tensorflow☆24Sep 26, 2019Updated 7 years ago
- Example implemention of the Proximal Policy Optimization algorithm☆18Jul 25, 2024Updated 2 years ago
- Material parsers and other tools, scripts Initially developed for Grobid Superconductor☆14Feb 21, 2025Updated last year