commonsearch / cosr-backLinks
Backend of Common Search. Analyses webpages and sends them to the index.
☆122Updated 8 years ago
Alternatives and similar repositories for cosr-back
Users that are interested in cosr-back are comparing it to the libraries listed below
Sorting:
- Frontend of Common Search. Go server for fetching and rendering results + HTML5 UI to browse them.☆59Updated 8 years ago
- Tools for managing deployment & operations of Common Search.☆12Updated 9 years ago
- Index URLs in Common Crawl☆195Updated 8 years ago
- Modularly extensible semantic metadata validator☆84Updated 9 years ago
- Remote client for distributed automated HTTP(s) content fetching.☆77Updated last week
- Python library for reading and writing warc files☆243Updated 3 years ago
- [UNMAINTAINED] Deploy, run and monitor your Scrapy spiders.☆11Updated 10 years ago
- Launch AWS Elastic MapReduce jobs that process Common Crawl data.☆49Updated 8 years ago
- Analyze the structure and dynamics of an open source project's developer community, using graph algorithms, etc.☆58Updated 4 years ago
- ☆59Updated 7 years ago
- Automatic keyword extraction - no alchemy required!☆169Updated 9 years ago
- An interactive map of Stack Exchange tags for all sites.☆126Updated 2 years ago
- Code to transform Hillary's emails from raw PDF documents to a SQLite database☆161Updated 9 years ago
- A fast python scikit-learn text sentiment API server.☆89Updated 9 years ago
- A collection of tools for mining government data☆141Updated 9 years ago
- Readability/Boilerpipe extraction in Python☆55Updated 9 years ago
- Document processing for investigations☆249Updated 8 years ago
- The development of PeARS has been moved to https://github.com/PeARSearch/PeARS-orchard☆56Updated 8 years ago
- *** This is not the current AdNauseam repository: please find the current repo here:☆384Updated 8 years ago
- python library for extracting html microdata☆166Updated 2 years ago
- Extract data from websites using basic statistical magic☆505Updated 5 years ago
- An attempt at creating a silver/gold standard dataset for backtesting yesterday & today's content-extractors☆35Updated 10 years ago
- Demonstration of using Python to process the Common Crawl dataset with the mrjob framework☆166Updated 3 years ago
- Automatic scraper that tracks changes in news articles over time.☆499Updated 5 years ago
- A microservice for archiving the news.☆165Updated 9 years ago
- Adhocracy 3 with customizations for various projects☆50Updated 6 years ago
- Visualization of GitHub Ecosystems and Repo Relationships☆41Updated 9 years ago
- A javascript tool to visualize the diff's in wikipedia☆35Updated 2 years ago
- A toolbox and web application for working with and presenting textual material from Shakespeare to Schopenhauer, and letters to literatur…☆149Updated 10 years ago
- Rewriting web proxy and archival tool. At this point, it just tries to download all the things.☆202Updated this week