SapienzaNLP / ita-benchLinks
A collection of Italian benchmarks for LLM evaluation
☆35Updated last month
Alternatives and similar repositories for ita-bench
Users that are interested in ita-bench are comparing it to the libraries listed below
Sorting:
- A python package to run inference with HuggingFace language and vision-language checkpoints wrapping many convenient features.☆28Updated last year
- The robust European language model benchmark.☆156Updated this week
- UmBERTo: an Italian Language Model trained with Whole Word Masking.☆110Updated 3 years ago
- A python package for benchmarking interpretability techniques on Transformers.☆215Updated last year
- A Python package to compute HONEST, a score to measure hurtful sentence completions in language models. Published at NAACL 2021.☆20Updated 9 months ago
- Repo for Aspire - A scientific document similarity model based on matching fine-grained aspects of scientific papers.☆54Updated 2 years ago
- BERT and ELECTRA models trained on Europeana Newspapers☆38Updated 4 years ago
- The CleanCoNLL dataset from our EMNLP 2023 paper where we corrected annotation errors and inconsistencies in CoNLL-03.☆25Updated last year
- ☆15Updated 4 years ago
- DaCy: The State of the Art Danish NLP pipeline using SpaCy☆99Updated last year
- A multi-lingual approach to AllenNLP CoReference Resolution along with a wrapper for spaCy.☆110Updated last year
- ☆39Updated 2 years ago
- Full named-entity (i.e., not tag/token) evaluation metrics based on SemEval’13☆202Updated 4 months ago
- SciRepEval benchmark training and evaluation scripts☆79Updated last week
- This repository hosts materials from the CLiC-IT 2023 tutorial☆30Updated last year
- Compass-aligned Distributional Embeddings. Align embeddings from different corpora☆42Updated 3 years ago
- Camoscio: An Italian instruction-tuned language model based on LLaMA☆126Updated 2 years ago
- A spaCy custom component that extracts and normalizes temporal expressions☆56Updated 2 years ago
- ☆182Updated last year
- AlBERTo the first italian BERT model for Twitter languange understanding☆72Updated 5 years ago
- ☆53Updated last year
- SpanMarker for Named Entity Recognition☆465Updated last year
- Data for the HIPE 2022 shared task.☆21Updated 2 years ago
- A Python library aimed at dissecting and augmenting NER training data.☆60Updated 2 years ago
- Utility for behavioral and representational analyses of Language Models☆173Updated 3 weeks ago
- A large scale dataset for Question Answering in Italian☆27Updated 7 years ago
- Neighborhood Contrastive Learning for Scientific Document Representations with Citation Embeddings (EMNLP 2022 paper)☆74Updated last month
- A module to compute textual lexical richness (aka lexical diversity).☆112Updated 2 years ago
- Word Sense Linking model is designed to identify and disambiguate spans of text to their most suitable senses from a reference inventory.☆13Updated last year
- Interpretability for sequence generation models 🐛 🔍☆454Updated 3 weeks ago