SapienzaNLP / ita-benchLinks
A collection of Italian benchmarks for LLM evaluation
☆35Updated last month
Alternatives and similar repositories for ita-bench
Users that are interested in ita-bench are comparing it to the libraries listed below
Sorting:
- A python package to run inference with HuggingFace language and vision-language checkpoints wrapping many convenient features.☆28Updated last year
- UmBERTo: an Italian Language Model trained with Whole Word Masking.☆110Updated 3 years ago
- Package to extract connotation frames☆91Updated 2 years ago
- This repository hosts materials from the CLiC-IT 2023 tutorial☆30Updated last year
- Compass-aligned Distributional Embeddings. Align embeddings from different corpora☆42Updated 3 years ago
- A Python package to compute HONEST, a score to measure hurtful sentence completions in language models. Published at NAACL 2021.☆20Updated 9 months ago
- Repo for Aspire - A scientific document similarity model based on matching fine-grained aspects of scientific papers.☆54Updated 2 years ago
- SciRepEval benchmark training and evaluation scripts☆80Updated this week
- A large scale dataset for Question Answering in Italian☆27Updated 7 years ago
- ☆39Updated 2 years ago
- Data for the HIPE 2022 shared task.☆21Updated 2 years ago
- The robust European language model benchmark.☆156Updated this week
- Sentiment analysis and emotion classification for Italian using BERT (fine-tuning). Published at the WASSA workshop (EACL2021).☆27Updated last year
- ☆53Updated last year
- BERT and ELECTRA models trained on Europeana Newspapers☆38Updated 4 years ago
- Utility for behavioral and representational analyses of Language Models☆173Updated 3 weeks ago
- DaCy: The State of the Art Danish NLP pipeline using SpaCy☆99Updated last year
- ☆43Updated 2 weeks ago
- A python package for benchmarking interpretability techniques on Transformers.☆215Updated last year
- ☆15Updated 4 years ago
- Camoscio: An Italian instruction-tuned language model based on LLaMA☆126Updated 2 years ago
- A python module for evaluating NERC and NEL system performances as defined in the HIPE shared tasks (formerly CLEF-HIPE-2020-scorer).☆15Updated last year
- The 🌟ANITA project🌟 *(Advanced Natural-based interaction for the ITAlian language)* wants to provide Italian NLP researchers with an im…☆24Updated last year
- Full named-entity (i.e., not tag/token) evaluation metrics based on SemEval’13☆202Updated 4 months ago
- Multi-Annotator Competence Estimation tool☆124Updated last week
- CD20200004 from 01/01/2021 to 31/12/2023 - LIG UGA - Python Notebook and Models for the MT Lab @ ALPS 2022☆13Updated last year
- ☆116Updated 3 months ago
- A multi-lingual approach to AllenNLP CoReference Resolution along with a wrapper for spaCy.☆110Updated last year
- Robust and fast topic models with sentence-transformers.☆88Updated last week
- A module to compute textual lexical richness (aka lexical diversity).☆112Updated 2 years ago