CI-Research / KeywordAnalysis
Word analysis, by domain, on the Common Crawl data set for the purpose of finding industry trends
☆56Updated 11 months ago
Alternatives and similar repositories for KeywordAnalysis:
Users that are interested in KeywordAnalysis are comparing it to the libraries listed below
- API - extract a list of keywords from a text.☆18Updated 7 years ago
- Site Hound (previously THH) is a Domain Discovery Tool☆23Updated 3 years ago
- Python/Django based webapps and web user interfaces for search, structure (meta data management like thesaurus, ontologies, annotations a…☆95Updated 2 years ago
- A library to extract a publication date from a web page, along with a measure of the accuracy.☆42Updated 5 years ago
- Source real estate prices from the Common Crawl.☆27Updated 6 years ago
- Virtual patent marking crawler at iproduct.epfl.ch☆14Updated 7 years ago
- Automatic tagging and analysis of documents in an Apache Solr index for faceted search by RDF(S) Ontologies & SKOS thesauri☆46Updated 3 years ago
- extract difference between two html pages☆32Updated 6 years ago
- Scrapes sites. Gets news. Eventually events.☆83Updated 8 years ago
- Make it easier to compare and cross-reference the names of companies and people by applying strong normalisation.☆147Updated last week
- WebAnnotator is a tool for annotating Web pages. WebAnnotator is implemented as a Firefox extension (https://addons.mozilla.org/en-US/fi…☆48Updated 3 years ago
- A component that tries to avoid downloading duplicate content☆27Updated 6 years ago
- A distributed system for mining common crawl using SQS, AWS-EC2 and S3☆16Updated 10 years ago
- Traptor -- A distributed Twitter feed☆26Updated 2 years ago
- Easy extraction of keywords and engines from search engine results pages (SERPs).☆90Updated 3 years ago
- General Architecture for Text Engineering☆46Updated 8 years ago
- Keyword Extraction system using Brown Clustering - (This version is trained to extract keywords from job listings)☆18Updated 10 years ago
- Scrapy pipeline which allows you to store scrapy items in a solr server.☆19Updated 8 years ago
- Text analysis for automatic bookmarking/keyword extraction☆18Updated 8 years ago
- This is the facade for installation and access to the individual components☆16Updated 6 years ago
- Exploring Common-Crawl using Python and DynamoDB☆33Updated 7 years ago
- Parsing resumes in a PDF format from linkedIn☆68Updated 8 years ago
- Watchman: An open-source social-media event-detection system☆20Updated 6 years ago
- Information extraction and interactive visualization of textual datasets for investigative data-driven journalism and eDiscovery☆53Updated 6 months ago
- LinkRun - Data Engineering project done in 3 weeks during the Insight fellowship☆38Updated 4 years ago
- Pipeline for distributed Natural Language Processing, made in Python☆65Updated 7 years ago
- Take streaming tweets, extract hashtags & usernames, create graph, export graphml for Gephi visualisation☆34Updated 11 years ago
- Paginating the web☆37Updated 10 years ago
- REST API for Text Summarization and Keywords Extraction☆16Updated 2 years ago