microsoft / ARXGENLinks
Scripts to parse arxiv documents for NLP tasks
☆18Updated 2 years ago
Alternatives and similar repositories for ARXGEN
Users that are interested in ARXGEN are comparing it to the libraries listed below
Sorting:
- A simple semantic search engine for scientific papers.☆28Updated last year
- MozoLM: A language model (LM) serving library☆45Updated this week
- ☆90Updated 3 years ago
- SMASHED is a toolkit designed to apply transformations to samples in datasets, such as fields extraction, tokenization, prompting, batchi…☆33Updated last year
- Agents that build knowledge graphs and explore textual worlds by asking questions☆79Updated 2 years ago
- Code for Relevance-guided Supervision for OpenQA with ColBERT (TACL'21)☆41Updated 4 years ago
- Stuff related to scraping the Code Review StackExchange☆11Updated 2 years ago
- ☆14Updated 10 months ago
- [WIP] Behold, semantic-search, built over sentence-transformers to make it easy for search engineers to evaluate, optimise and deploy mod…☆15Updated 2 years ago
- URL downloader supporting checkpointing and continuous checksumming.☆19Updated last year
- Evaluation suite for large-scale language models.☆127Updated 3 years ago
- T5Patches is a set of tools for fast and targeted editing of generative language models built with T5X.☆12Updated last year
- Mapping natural language commands to web elements☆37Updated 3 years ago
- SWIM-IR is a Synthetic Wikipedia-based Multilingual Information Retrieval training set with 28 million query-passage pairs spanning 33 la…☆49Updated last year
- Tokenization across languages. Useful as preprocessing for subword tokenization.☆22Updated 2 years ago
- FAMIE: A Fast Active Learning Framework for Multilingual Information Extraction☆24Updated 3 years ago
- ☆79Updated last year
- PyTorch library for synthesizing programs from natural language☆18Updated last year
- Helper scripts and notes that were used while porting various nlp models☆46Updated 3 years ago
- 📰 Computing the information content of trained neural networks☆21Updated 3 years ago
- Code for our paper Resources and Evaluations for Multi-Distribution Dense Information Retrieval☆15Updated last year
- Documentation effort for the BookCorpus dataset☆34Updated 4 years ago
- A Python implementation of Toolformer using Huggingface Transformers☆14Updated 2 years ago
- An Implementation of "Orca: Progressive Learning from Complex Explanation Traces of GPT-4"☆43Updated 9 months ago
- Open source library for few shot NLP☆78Updated 2 years ago
- Evaluating Machines by their Real-World Language Use☆33Updated 2 years ago
- Keras Implementation of Flair's Contextualized Embeddings☆26Updated 4 years ago
- Code for the paper "LASER: LLM Agent with State-Space Exploration for Web Navigation"☆33Updated last year
- An open-source NLP library: fast text cleaning and preprocessing☆23Updated 3 years ago
- This project shows how to derive the total number of training tokens from a large text dataset from 🤗 datasets with Apache Beam and Data…☆27Updated 2 years ago