arXiv / zzzArchived_arxiv-fulltext
arXiv plain text extraction
☆41Updated 2 years ago
Alternatives and similar repositories for zzzArchived_arxiv-fulltext:
Users that are interested in zzzArchived_arxiv-fulltext are comparing it to the libraries listed below
- ☆86Updated 2 years ago
- Documentation effort for the BookCorpus dataset☆33Updated 3 years ago
- A file utility for accessing both local and remote files through a unified interface.☆35Updated this week
- SMASHED is a toolkit designed to apply transformations to samples in datasets, such as fields extraction, tokenization, prompting, batchi…☆31Updated 7 months ago
- 💫 A spaCy package for Yohei Tamura's Rust tokenizations library☆27Updated last year
- SWIM-IR is a Synthetic Wikipedia-based Multilingual Information Retrieval training set with 28 million query-passage pairs spanning 33 la…☆45Updated last year
- ☆77Updated last year
- Datasets collection and preprocessings framework for NLP extreme multitask learning☆171Updated last week
- ☆46Updated 2 months ago
- Scripts supporting the development and serving the Roots Search Tool - https://hf.co/spaces/bigscience-data/roots-search☆10Updated last year
- A python tool for building large scale Wikipedia-based Information Retrieval datasets☆45Updated 3 years ago
- Bayesian Assessment of Hypotheses☆24Updated last year
- A highly sophisticated sequence-to-sequence model for code generation☆40Updated 3 years ago
- Python tools for processing the stackexchange data dumps into a text dataset for Language Models☆80Updated last year
- A library to create and manage configuration files, especially for machine learning projects.☆76Updated 2 years ago
- Repo for training MLMs, CLMs, or T5-type models on the OLM pretraining data, but it should work with any hugging face text dataset.☆93Updated last year
- One-stop shop for running and fine-tuning transformer-based language models for retrieval☆43Updated this week
- ☆16Updated last year
- Apps built using Inspired Cognition's Critique.☆58Updated last year
- Source code and data for Like a Good Nearest Neighbor☆28Updated last week
- URL downloader supporting checkpointing and continuous checksumming.☆19Updated last year
- Probabilistic LLM evaluations. [CogSci2023; ACL2023]☆72Updated 5 months ago
- Search through Facebook Research's PyTorch BigGraph Wikidata-dataset with the Weaviate vector search engine☆31Updated 3 years ago
- Detecting gibberish as a type of sentiment analysis with GPT2☆24Updated 4 years ago
- ☆13Updated 4 years ago
- ☆11Updated last year
- A library for squeakily cleaning and filtering language datasets.☆45Updated last year
- As good as new. How to successfully recycle English GPT-2 to make models for other languages (ACL Findings 2021)☆48Updated 3 years ago
- This repository contains the code for the paper 'PARM: Paragraph Aggregation Retrieval Model for Dense Document-to-Document Retrieval' pu…☆40Updated 3 years ago
- Code for SaGe subword tokenizer (EACL 2023)☆22Updated last month