commonsearch / cosr-back
Backend of Common Search. Analyses webpages and sends them to the index.
☆122Updated 7 years ago
Alternatives and similar repositories for cosr-back:
Users that are interested in cosr-back are comparing it to the libraries listed below
- Tools for managing deployment & operations of Common Search.☆12Updated 8 years ago
- Modularly extensible semantic metadata validator☆83Updated 9 years ago
- Visualization of GitHub Ecosystems and Repo Relationships☆41Updated 8 years ago
- Index URLs in Common Crawl☆193Updated 7 years ago
- Automatic keyword extraction - no alchemy required!☆168Updated 9 years ago
- A collection of tools for mining government data☆140Updated 8 years ago
- The development of PeARS has been moved to https://github.com/PeARSearch/PeARS-orchard☆56Updated 7 years ago
- online natural language processing with word vectors☆309Updated 8 months ago
- ☆172Updated 10 years ago
- Document processing for investigations☆250Updated 8 years ago
- Demonstration of using Python to process the Common Crawl dataset with the mrjob framework☆166Updated 2 years ago
- A javascript tool to visualize the diff's in wikipedia☆35Updated 2 years ago
- A cross between Hacker News and the Wayback Machine☆47Updated last year
- [UNMAINTAINED] Deploy, run and monitor your Scrapy spiders.☆11Updated 9 years ago
- Supervised learning for novelty detection in text☆78Updated 8 years ago
- Code to transform Hillary's emails from raw PDF documents to a SQLite database☆161Updated 9 years ago
- Extract data from websites using basic statistical magic☆505Updated 4 years ago
- Analyze the structure and dynamics of an open source project's developer community, using graph algorithms, etc.☆58Updated 4 years ago
- Standard evaluations for binary classifiers so you don't have to☆315Updated 6 years ago
- Remote client for distributed automated HTTP(s) content fetching.☆77Updated this week
- Language Lego☆141Updated 5 years ago
- Find the essence☆109Updated 9 years ago
- ☆92Updated 7 years ago
- Launch AWS Elastic MapReduce jobs that process Common Crawl data.☆49Updated 8 years ago
- ☆59Updated 7 years ago
- Refinery - A locally deployable open-source web platform for analysis of large document collections☆101Updated 8 years ago
- python library for extracting html microdata☆166Updated last year
- Live at http://extractdata.club☆167Updated 7 years ago
- Create simple APIs from CSV files☆193Updated 4 years ago
- A platform to study browser fingerprinting☆72Updated 2 years ago