Remove duplicates and near-duplicates from text corpora, no matter the scale.
☆13Nov 24, 2023Updated 2 years ago
Alternatives and similar repositories for NLPDedup
Users that are interested in NLPDedup are comparing it to the libraries listed below. We may earn a commission when you buy through links labeled 'Ad' on this page.
Sorting:
- This repository contains resources pertaining to the Danish Foundation Models workshop on Danish LLMs at the D3A conference, which was he…☆10Feb 2, 2024Updated 2 years ago
- Converting irregularly spaced time series, such as eletronic health records, into dataframes for tabular classification.☆20Jun 17, 2025Updated last year
- spaCy-wrap is a wrapper library for spaCy for including fine-tuned transformers from Huggingface in your spaCy pipeline allowing you to i…☆46Apr 15, 2024Updated 2 years ago
- A Scandinavian Benchmark for sentence embeddings☆46Dec 5, 2025Updated 11 months ago
- Fine-tuning of transformers for Sentiment Analysis☆18May 25, 2021Updated 5 years ago
- 1-Click AI Models by DigitalOcean Gradient • AdDeploy popular AI models on DigitalOcean Gradient GPU virtual machines with just a single click. Zero configuration with optimized deployments.
- ☆15Aug 8, 2017Updated 9 years ago
- The website for Danish Foundation Models, a project for training foundational Danish language model.☆81Updated this week
- The Argilla API python SDK☆11Sep 30, 2024Updated 2 years ago
- The robust European language model benchmark.☆204Updated this week
- ☆13Mar 25, 2026Updated 7 months ago
- A flexible Monte Carlo Tree Search framework with PyTorch for decision-making in language models.☆12Feb 23, 2025Updated last year
- Easy to deploy your LLM(large language model) server with no public address GPU machine.☆15Apr 30, 2024Updated 2 years ago
- A simple one file python script that executes AI processes defined in YML.☆15Mar 26, 2023Updated 3 years ago
- Blazing fast topic modelling for short texts.☆37Oct 5, 2026Updated last month
- Deploy to Railway using AI coding agents - Free Credits Offer • AdUse Claude Code, Codex, OpenCode, and more. Autonomous software development now has the infrastructure to match with Railway.
- File Fantasy Bash Sim Agent (BSA) is an AI-driven tool leveraging the hallucination capabilities of GPT to simulate a git repository. It …☆11May 16, 2023Updated 3 years ago
- Augmenty is an augmentation library based on spaCy for augmenting texts.☆155May 24, 2024Updated 2 years ago
- Tools for interactive visual exploration of semantic embeddings.☆51Sep 6, 2024Updated 2 years ago
- A repository containing the materials required to complete the "AAAI Lab for Innovative Uses of Synthetic Data". This includes tutorials …☆12Sep 4, 2024Updated 2 years ago
- DaCy: The State of the Art Danish NLP pipeline using SpaCy☆105Oct 28, 2026Updated 2 weeks ago
- ☆10Jun 23, 2023Updated 3 years ago
- Local emulator for Hugging Face Inference Endpoints customer handlers☆25Sep 23, 2026Updated last month
- ☆16Nov 16, 2025Updated 11 months ago
- Simple customizable pipeline tool for anonymizing Danish text.☆11Apr 2, 2026Updated 7 months ago
- 1-Click AI Models by DigitalOcean Gradient • AdDeploy popular AI models on DigitalOcean Gradient GPU virtual machines with just a single click. Zero configuration with optimized deployments.
- Confection: the sweetest config system for Python☆193Oct 26, 2026Updated 2 weeks ago
- Starbucks: Improved Training for 2D Matryoshka Embeddings☆26Jun 30, 2025Updated last year
- TechOps - Technical Documentation Templates, Guidelines, and Examples for Responsible AI/ML Systems and Compliance with the EU AI Act☆15Oct 22, 2025Updated last year
- The Danish Gigaword project☆16Jan 25, 2021Updated 5 years ago
- Build html documentation by Sphinx, and push to branch gh-pages.☆11Nov 13, 2021Updated 4 years ago
- Gumbo - A pure-C HTML5 parser, adapted to be installable via clib.☆12Jun 8, 2021Updated 5 years ago
- Visegrad+ Parliament API. Access to parliament data of Visegrad+ countries in a common data standard.☆11May 17, 2016Updated 10 years ago
- ☆25Oct 10, 2025Updated last year
- chatGPT 'Autonomous Agent' in Node.js, written/runs in Termux. Sandboxed REPL access, Termux:API interface, chain-of-thought Question-Obs…☆18May 12, 2023Updated 3 years ago
- End-to-end encrypted cloud storage - Proton Drive • AdSpecial offer: 40% Off Yearly / 80% Off First Month. Protect your most important files, photos, and documents from prying eyes.
- Quantification of Uncertainty with Adversarial Models☆29Jul 11, 2023Updated 3 years ago
- Transcribe podcasts and YouTube videos with Whisper on Apple sillicon☆11Nov 5, 2025Updated last year
- Primary repository for the NLP course as part of the CogSci masters program at Aarhus University.☆24Sep 16, 2025Updated last year
- Norwegian Speech Transformer Models☆19Oct 19, 2026Updated 3 weeks ago
- Repo with election data☆12Nov 12, 2022Updated 3 years ago
- ☆13Mar 10, 2025Updated last year
- R-package: Methods for dividing data into groups. Create balanced partitions and cross-validation folds. Perform time series windowing an…☆25Dec 18, 2024Updated last year
Are these results useful?