SapienzaNLP / ita-benchLinks
A collection of Italian benchmarks for LLM evaluation
☆31Updated 5 months ago
Alternatives and similar repositories for ita-bench
Users that are interested in ita-bench are comparing it to the libraries listed below
Sorting:
- A python package to run inference with HuggingFace language and vision-language checkpoints wrapping many convenient features.☆28Updated last year
- The robust European language model benchmark.☆133Updated this week
- A python package for benchmarking interpretability techniques on Transformers.☆212Updated last year
- UmBERTo: an Italian Language Model trained with Whole Word Masking.☆109Updated 2 years ago
- This repository hosts materials from the CLiC-IT 2023 tutorial☆30Updated last year
- Sentiment analysis and emotion classification for Italian using BERT (fine-tuning). Published at the WASSA workshop (EACL2021).☆27Updated last year
- ☆39Updated last year
- Package to extract connotation frames☆90Updated last year
- Compass-aligned Distributional Embeddings. Align embeddings from different corpora☆41Updated 2 years ago
- Repo for Aspire - A scientific document similarity model based on matching fine-grained aspects of scientific papers.☆54Updated 2 years ago
- A Python package to compute HONEST, a score to measure hurtful sentence completions in language models. Published at NAACL 2021.☆20Updated 6 months ago
- Interpretability for sequence generation models 🐛 🔍☆444Updated this week
- Full named-entity (i.e., not tag/token) evaluation metrics based on SemEval’13☆196Updated last month
- ☆53Updated last year
- DaCy: The State of the Art Danish NLP pipeline using SpaCy☆98Updated 10 months ago
- ☆15Updated 4 years ago
- The CleanCoNLL dataset from our EMNLP 2023 paper where we corrected annotation errors and inconsistencies in CoNLL-03.☆24Updated last year
- Utility for behavioral and representational analyses of Language Models☆165Updated last month
- A multi-lingual approach to AllenNLP CoReference Resolution along with a wrapper for spaCy.☆107Updated last year
- ☆169Updated last year
- Data for the HIPE 2022 shared task.☆21Updated last year
- Lbl2Vec learns jointly embedded label, document and word vectors to retrieve documents with predefined topics from an unlabeled document …☆186Updated last year
- Code to reproduce data for Bias in Bios☆47Updated 2 years ago
- 💫 SpaCy wrapper for ConceptNet 💫☆95Updated 2 years ago
- A large scale dataset for Question Answering in Italian☆27Updated 6 years ago
- The 🌟ANITA project🌟 *(Advanced Natural-based interaction for the ITAlian language)* wants to provide Italian NLP researchers with an im…☆22Updated last year
- AlBERTo the first italian BERT model for Twitter languange understanding☆72Updated 5 years ago
- Word Sense Linking model is designed to identify and disambiguate spans of text to their most suitable senses from a reference inventory.☆13Updated last year
- TextComplexityDE dataset consists of 1000 sentences in the German language with subjective complexity rating, collected from German learn…☆13Updated 3 years ago
- Find informative examples to efficiently (human)-evaluate NLG models.☆16Updated 3 weeks ago