microsoft / ARXGENLinks
Scripts to parse arxiv documents for NLP tasks
☆19Updated 2 years ago
Alternatives and similar repositories for ARXGEN
Users that are interested in ARXGEN are comparing it to the libraries listed below
Sorting:
- SMASHED is a toolkit designed to apply transformations to samples in datasets, such as fields extraction, tokenization, prompting, batchi…☆35Updated last year
- MozoLM: A language model (LM) serving library☆47Updated this week
- Agents that build knowledge graphs and explore textual worlds by asking questions☆79Updated 2 years ago
- A simple semantic search engine for scientific papers.☆28Updated 2 years ago
- An Implementation of "Orca: Progressive Learning from Complex Explanation Traces of GPT-4"☆43Updated last year
- ☆94Updated 3 years ago
- Code for Relevance-guided Supervision for OpenQA with ColBERT (TACL'21)☆40Updated 4 years ago
- Documentation effort for the BookCorpus dataset☆34Updated 4 years ago
- SWIM-IR is a Synthetic Wikipedia-based Multilingual Information Retrieval training set with 28 million query-passage pairs spanning 33 la…☆49Updated 2 years ago
- FAMIE: A Fast Active Learning Framework for Multilingual Information Extraction☆24Updated 3 years ago
- Code for the paper "Code-Mixing on Sesame Street: Dawn of the Adversarial Polyglots" (NAACL-HLT 2021)☆10Updated 9 months ago
- Stuff related to scraping the Code Review StackExchange☆12Updated 3 years ago
- Implementation of Z-BERT-A: a zero-shot pipeline for unknown intent detection.☆44Updated 2 years ago
- Code, datasets and results of the ChatGPT evaluation presented in paper "ChatGPT: Jack of all trades, master of none"☆29Updated 2 years ago
- Implementation of the model: "Reka Core, Flash, and Edge: A Series of Powerful Multimodal Language Models" in PyTorch☆28Updated last week
- Helper scripts and notes that were used while porting various nlp models☆49Updated 3 years ago
- YT_subtitles - extracts subtitles from YouTube videos to raw text for Language Model training☆46Updated 5 years ago
- Code for running the experiments in Deep Subjecthood: Higher Order Grammatical Features in Multilingual BERT☆17Updated 2 years ago
- GenieNLP: A versatile codebase for any NLP task☆89Updated last year
- An open-source NLP library: fast text cleaning and preprocessing☆23Updated 4 years ago
- Tokenization across languages. Useful as preprocessing for subword tokenization.☆21Updated 3 years ago
- ☆14Updated last year
- arXiv plain text extraction☆41Updated 3 years ago
- code for paper "Accessing higher dimensions for unsupervised word translation"☆22Updated 2 years ago
- Developing tools to automatically analyze datasets☆75Updated last year
- ☆26Updated 6 years ago
- Evaluation suite for large-scale language models.☆129Updated 4 years ago
- [WIP] Behold, semantic-search, built over sentence-transformers to make it easy for search engineers to evaluate, optimise and deploy mod…☆15Updated 2 years ago
- Mapping natural language commands to web elements☆38Updated 3 years ago
- A library for computing diverse text characteristics and using them to analyze data sets and models with ease.☆41Updated 3 years ago