SparkER: an Entity Resolution framework for Apache Spark
☆67Mar 29, 2024Updated 2 years ago
Alternatives and similar repositories for sparker
Users that are interested in sparker are comparing it to the libraries listed below. We may earn a commission when you buy through links labeled 'Ad' on this page.
Sorting:
- Collection of some algorithms for entity resolution☆28Sep 7, 2015Updated 11 years ago
- Distributed Bayesian Entity Resolution in Apache Spark☆59Jun 10, 2021Updated 5 years ago
- Stanford Entity-Resolution Framework☆25Jun 23, 2018Updated 8 years ago
- Entity resolution using zero labeled examples☆34Jun 29, 2024Updated 2 years ago
- Implementation of the paper "Deep Indexed Active Learning for Matching Heterogeneous Entity Representations"☆17Dec 20, 2021Updated 4 years ago
- Deploy to Railway using AI coding agents - Free Credits Offer • AdUse Claude Code, Codex, OpenCode, and more. Autonomous software development now has the infrastructure to match with Railway.
- Repository for performing Blocking using Deep Learning based on the paper "Deep Learning for Blocking in Entity Matching: A Design Space …☆30Apr 5, 2023Updated 3 years ago
- The dataset for the paper "Machamp: A Generalized Entity Matching Benchmark" published in CIKM 2021☆22Oct 18, 2021Updated 4 years ago
- End-to-End Deep Entity Resolution☆33Jul 14, 2021Updated 5 years ago
- ☆15May 19, 2019Updated 7 years ago
- Python package for performing Entity and Text Matching using Deep Learning.☆623Jun 18, 2024Updated 2 years ago
- A Python package for efficient evaluation based on OASIS (Optimal Asymptotic Sequential Importance Sampling).☆14Jun 4, 2021Updated 5 years ago
- A powerful and modular toolkit for record linkage and duplicate detection in Python☆1,063Feb 21, 2024Updated 2 years ago
- Curated list of awesome software and resources for Senzing, The First Real-Time AI for Entity Resolution.☆67Oct 1, 2026Updated last week
- Code for the paper "Deep Entity Matching with Pre-trained Language Models"☆319Apr 17, 2024Updated 2 years ago
- Managed hosting for WordPress and PHP on Cloudways • AdManaged hosting for WordPress, Magento, Laravel, or PHP apps, on multiple cloud providers. Deploy in minutes on Cloudways by DigitalOcean.
- the implementation of "Entity Resolution via Hierarchical Graph Attention Network"☆24Aug 29, 2023Updated 3 years ago
- This repository contains the code and data download links to reproduce building the WDC Products Benchmark.☆15Jul 13, 2023Updated 3 years ago
- Distributed similarity search☆10Mar 7, 2020Updated 6 years ago
- Fuzzy matching function in spark (https://spark-packages.org/package/itspawanbhardwaj/spark-fuzzy-matching)☆24Dec 30, 2019Updated 6 years ago
- A list of free data matching and record linkage software.☆407Feb 21, 2024Updated 2 years ago
- This project focuses on DeepER, a deep learning framework for entity resolution (record deduplication). It examines how DeepER performs o…☆47May 11, 2018Updated 8 years ago
- Record matching and entity resolution at scale in Spark☆37Oct 31, 2023Updated 2 years ago
- Code for Packt Publishing's Spark for Data Science Cookbook.☆22Jun 19, 2017Updated 9 years ago
- Example files used in the DuckDB - Unity Catalog blog☆10Dec 6, 2024Updated last year
- Managed Database hosting by DigitalOcean • AdPostgreSQL, MySQL, MongoDB, Kafka, Valkey, and OpenSearch available. Automatically scale up storage and focus on building your apps.
- ☆32Sep 3, 2021Updated 5 years ago
- A python library for accurate and scalable fuzzy matching, record deduplication and entity-resolution.☆4,514Jul 29, 2025Updated last year
- Fast fuzzy text search☆12May 16, 2023Updated 3 years ago
- To reproduce experiments of the paper "Entity Matching with Transformer Architectures"☆27Nov 4, 2019Updated 6 years ago
- ☆195May 29, 2024Updated 2 years ago
- python package for performing deduplication using flexible text matching and cleaning in pandas dataframe☆24Nov 30, 2020Updated 5 years ago
- variations of the record linkage model of Steorts et al. AISTATS 2014's "SMERED: A Bayesian Approach to Graphical Record Linkage and De-d…☆26Mar 13, 2017Updated 9 years ago
- An open-source library that leverages Python’s data science ecosystem to build powerful end-to-end Entity Resolution workflows.☆100Mar 22, 2026Updated 6 months ago
- Task based code snippet examples for Senzing V3.☆16Aug 11, 2026Updated last month
- Deploy on Railway without the complexity - Free Credits Offer • AdConnect your repo and Railway handles the rest with instant previews. Quickly provision container image services, databases, and storage volumes.
- Resources for PVLDB 2023 submission☆29Aug 28, 2024Updated 2 years ago
- Export data from Redshift to BigQuery☆11Mar 16, 2018Updated 8 years ago
- Fast and generic implementation of the minhash algorithm☆14Jul 8, 2025Updated last year
- Entity resolution, also known as Data Matching or Record linkage is the task of finding a data set that refer to the same or similar real…☆36Apr 8, 2025Updated last year
- Cucumber-based framework for defining and executing SQL unit, integration and acceptance tests (for AWS Redshift, PostgreSQL)☆13Sep 30, 2020Updated 6 years ago
- Source code for the paper "Probabilistic Bag-Of-Hyperlinks Model for Entity Linking" , http://dl.acm.org/citation.cfm?id=2882988☆58Oct 28, 2018Updated 7 years ago
- Code for 'Geospatial Entity Resolution' paper (WWW 2022)☆21Apr 27, 2023Updated 3 years ago