explosion / spacy-alignments
π« A spaCy package for Yohei Tamura's Rust tokenizations library
β27Updated last year
Alternatives and similar repositories for spacy-alignments:
Users that are interested in spacy-alignments are comparing it to the libraries listed below
- SMASHED is a toolkit designed to apply transformations to samples in datasets, such as fields extraction, tokenization, prompting, batchiβ¦β31Updated 7 months ago
- allennlp-light is a port of AllenNLP's core modules and nn portions into a standalone package with minimum dependenciesβ55Updated 2 years ago
- Code for SaGe subword tokenizer (EACL 2023)β22Updated last month
- Summary Explorer is a tool to visually explore the state-of-the-art in text summarization.β44Updated 8 months ago
- A highly sophisticated sequence-to-sequence model for code generationβ40Updated 3 years ago
- Bayesian Assessment of Hypothesesβ24Updated last year
- Data Programming by Demonstration (DPBD) for Document Classificationβ35Updated 3 years ago
- β―οΈ AllenNLP training configurations for promising models on Named Entity Recognition. (BiLSTM-CRF, BiLSTM-CNN-CRF, BERT, BERT-CRF)β15Updated 4 years ago
- πΎ Universal, customizable and deployable fine-grained evaluation for text generation.β22Updated last year
- Multidocument Summarization for Literature Review Shared Task 2022β28Updated 2 years ago
- Semantically Structured Sentence Embeddingsβ66Updated 3 months ago
- One-stop shop for running and fine-tuning transformer-based language models for retrievalβ43Updated this week
- Generate BERT vocabularies and pretraining examples from Wikipediasβ18Updated 4 years ago
- Pre-train Static Word Embeddingsβ32Updated this week
- ZS4IE: A Toolkit for Zero-Shot Information Extraction with Simple Verbalizationsβ26Updated 2 years ago
- β10Updated 4 years ago
- β17Updated last year
- Embedding Recycling for Language modelsβ38Updated last year
- SWIM-IR is a Synthetic Wikipedia-based Multilingual Information Retrieval training set with 28 million query-passage pairs spanning 33 laβ¦β45Updated last year
- Starbucks: Improved Training for 2D Matryoshka Embeddingsβ17Updated 3 months ago
- β‘οΈ AllenNLP plugin for adding subcommands to use Optuna, making hyperparameter optimization easyβ33Updated 3 years ago
- Examples for aligning, padding and batching sequence labeling data (NER) for use with pre-trained transformer modelsβ65Updated 2 years ago
- This repository contains the code for the paper 'PARM: Paragraph Aggregation Retrieval Model for Dense Document-to-Document Retrieval' puβ¦β40Updated 3 years ago
- MultiCite code and data. Models are available on Huggingface.β29Updated 2 years ago
- π§ͺ Cutting-edge experimental spaCy components and featuresβ96Updated 8 months ago
- Repo for training MLMs, CLMs, or T5-type models on the OLM pretraining data, but it should work with any hugging face text dataset.β93Updated last year
- β11Updated 2 years ago
- Converter from UD-trees to BART representationβ36Updated 10 months ago
- FAMIE: A Fast Active Learning Framework for Multilingual Information Extractionβ24Updated 2 years ago
- Shared code for training sentence embeddings with Flax / JAXβ27Updated 3 years ago