Statistics on multilingual datasets
☆17Jul 12, 2022Updated 4 years ago
Alternatives and similar repositories for multilingual-data-stats
Users that are interested in multilingual-data-stats are comparing it to the libraries listed below. We may earn a commission when you buy through links labeled 'Ad' on this page.
Sorting:
- Official repository for "DYPLOC: Dynamic Planning of Content Using Mixed Language Models for Opinion Text Generation"☆10May 20, 2022Updated 4 years ago
- COMET for African languages☆11Jan 24, 2025Updated last year
- Source code for paper "Evaluating Bilingual Word Embeddings on the Long Tail" (Braune et al. NAACL 2018)☆11Jul 6, 2023Updated 3 years ago
- In-context Example Selection with Influences☆15May 12, 2023Updated 3 years ago
- ☆18Feb 4, 2025Updated last year
- Deploy to Railway using AI coding agents - Free Credits Offer • AdUse Claude Code, Codex, OpenCode, and more. Autonomous software development now has the infrastructure to match with Railway.
- NTREX -- News Test References for MT Evaluation☆88Jun 5, 2024Updated 2 years ago
- Library for fast text representation and classification.☆31Jan 9, 2024Updated 2 years ago
- [Kauf & Ivanova, ACL 2023] A Better Way to Do Masked Language Model Scoring☆13Dec 1, 2023Updated 2 years ago
- A collection of Pythonic subword tokenisers and text preprocessing tools.☆15Updated this week
- Finds snippets in iambic pentameter in English-language text and tries to combine them to a rhyming sonnet.☆13Jan 5, 2023Updated 3 years ago
- PANiC - PAraphrasing Noun-Compounds☆15Apr 6, 2018Updated 8 years ago
- ☆16Jan 12, 2023Updated 3 years ago
- Code for the ILNewsDiff Twitter account☆10May 23, 2023Updated 3 years ago
- Scraper☆13Dec 21, 2018Updated 7 years ago
- 1-Click AI Models by DigitalOcean Gradient • AdDeploy popular AI models on DigitalOcean Gradient GPU virtual machines with just a single click. Zero configuration with optimized deployments.
- Collection of academic works in natural language processing, computational linguistics, and computational cognitive science that study th…☆24Mar 20, 2024Updated 2 years ago
- Helpful WebUI for Senior Area Chair of ACL Rolling Review (ARR)☆16Aug 11, 2026Updated 2 months ago
- Neural Network based models for Aspect-Based Sentiment Analysis☆23Apr 30, 2018Updated 8 years ago
- Open Vietnamese NLP Resources☆20May 3, 2021Updated 5 years ago
- Code for the paper "Getting the most out of your tokenizer for pre-training and domain adaptation"☆22Feb 14, 2024Updated 2 years ago
- Code for the paper "Greed is All You Need: An Evaluation of Tokenizer Inference Methods"☆15Sep 2, 2026Updated 2 months ago
- As good as new. How to successfully recycle English GPT-2 to make models for other languages (ACL Findings 2021)☆48Aug 2, 2021Updated 5 years ago
- Exploring implementing a simple tagger using neural network frameworks☆20Oct 24, 2022Updated 4 years ago
- A parallel evaluation data set of SAP software documentation with document structure annotation☆15Jun 12, 2026Updated 4 months ago
- Open source password manager - Proton Pass • AdSecurely store, share, and autofill your credentials with Proton Pass, the end-to-end encrypted password manager trusted by millions.
- Platform for Evaluating and Reviewing of Multilingual Tasks☆35Oct 10, 2026Updated 3 weeks ago
- TokEval: intrinsic quality metrics for tokenizers across natural language, code, and math☆58Aug 31, 2026Updated 2 months ago
- Three little Python scripts for data preparation: remove commas, add commas, concatenate files☆16Jul 26, 2017Updated 9 years ago
- BPE modification that implements removing of the intermediate tokens during tokenizer training.☆27Nov 25, 2024Updated last year
- A simple semi-supervised approach for creating huggingface data script loaders and upload to the hub.☆11Jun 23, 2024Updated 2 years ago
- Verb∋Net, a French translation of VerbNet☆11Sep 30, 2026Updated last month
- All code and content for my blog.☆15Sep 23, 2018Updated 8 years ago
- Code for SaGe subword tokenizer (EACL 2023)☆28Nov 30, 2024Updated last year
- Source code for the paper "Multilingual Neural Machine Translation with Soft Decoupled Encoding"☆29Jun 2, 2021Updated 5 years ago
- 1-Click AI Models by DigitalOcean Gradient • AdDeploy popular AI models on DigitalOcean Gradient GPU virtual machines with just a single click. Zero configuration with optimized deployments.
- Formulaire en ligne qui génère une attestation de déplacement dérogatoire☆10Mar 18, 2020Updated 6 years ago
- ☆46Apr 13, 2022Updated 4 years ago
- Benchmarking framework for evaluating vLLM serving performance across different configurations, models, and system settings. Includes too…☆12May 23, 2025Updated last year
- Code and experiments for the COLING2020 paper "Conception: Multilingually-Enhanced, Human-Readable Concept Vector Representations".☆11Dec 9, 2020Updated 5 years ago
- Transformer Implementation for NMT using PyTorch Lightning (Korean to English)☆10Oct 19, 2020Updated 6 years ago
- BabelNet (and WordNet) sense embedding trained with Word2Vec and FastText☆10Sep 3, 2019Updated 7 years ago
- Variational Walkback, NIPS'17☆28Oct 18, 2017Updated 9 years ago