david-siqi-liu / sparklycleanLinks
Optimal distributed data deduplication and supervised learning pipeline using Apache Spark
☆10Updated 4 years ago
Alternatives and similar repositories for sparklyclean
Users that are interested in sparklyclean are comparing it to the libraries listed below
Sorting:
- ☆15Updated 2 years ago
- SparkER: an Entity Resolution framework for Apache Spark☆65Updated last year
- An open source, high scalability toolkit in Java for Entity Resolution.☆218Updated this week
- WInte.r is a Java framework for end-to-end data integration. The WInte.r framework implements well-known methods for data pre-processing,…☆110Updated 3 years ago
- An example of Spark and GraphX with Twitter as sample☆19Updated 8 years ago
- deep entity resolution lite version☆11Updated 5 years ago
- Real-time query spark and visualise it as graph.☆24Updated 7 years ago
- JedAI-WebApp is a GUI that facilitates the execution of JedAI. JedAI is an open source, high scalability toolkit that offers out-of-the-b…☆23Updated 2 years ago
- ☆77Updated 2 years ago
- A tool facilitating matching for any dataset discovery method. Also, an extensible experiment suite for state-of-the-art schema matching …☆89Updated last month
- UI for JedAI Toolkit☆17Updated 3 years ago
- Explaining Inference Queries with Bayesian Optimization☆10Updated 4 years ago
- Apache NiFi NLP Processor☆18Updated last year
- Entity resolution for Elasticsearch.☆160Updated 6 months ago
- Condor allows for the specification of synopsis-based streaming jobs on top of general dataflow systems. Condor provides a collection of …☆13Updated last year
- A curated list of awesome PrestoDB / Trino software, libraries, tools and resources☆17Updated 4 years ago
- Collection of some algorithms for entity resolution☆28Updated 9 years ago
- Data Lineage Tracing Library☆23Updated 3 years ago
- Record Linkage ToolKit (Find and link entities)☆110Updated last year
- ☆191Updated last year
- Data Catalog for Databases and Data Warehouses☆35Updated last year
- the database manager for Apache Hive☆21Updated 7 years ago
- Sketch and LSH Index library for Java, including OPH methods as well as the Lazo method☆13Updated last year
- A Generalized Data Cleaning System☆50Updated 9 years ago
- The sane way of building a data layer in Airflow☆24Updated 5 years ago
- Dremio Flight connector. Access Dremio using Arrow flight☆40Updated 4 years ago
- Fuzzy matching function in spark (https://spark-packages.org/package/itspawanbhardwaj/spark-fuzzy-matching)☆24Updated 5 years ago
- FlexMatcher is a schema matching package in Python which handles the problem of matching multiple schemas to a single mediated schema.☆29Updated 7 months ago
- Panoramix is a data exploration platform designed to be visual, intuitive and interactive☆17Updated 9 years ago
- A collection of tools for accessing Neo4j graph databases from Apache NiFi.☆23Updated 6 years ago