CenterForOpenScience / scrapiLinks
A data processing pipeline that schedules and runs content harvesters, normalizes their data, and outputs that normalized data to a variety of output streams. This is part of the SHARE project, and will be used to create a free and open dataset of research (meta)data. Data collected can be explored at https://osf.io/share/, and viewed at https:/…
☆42Updated 9 years ago
Alternatives and similar repositories for scrapi
Users that are interested in scrapi are comparing it to the libraries listed below
Sorting:
- Python client library for controlling Google Refine☆42Updated 12 years ago
- Dat python client☆45Updated 9 years ago
- Transform flat data structures into nested object graphs matching JSON schema definitions.☆28Updated 9 years ago
- Python library and command line tool for converting data from one format to another☆99Updated 5 years ago
- ArchiveKit manages data and documents during ETL processes, either on a local file system or on S3.☆15Updated 10 years ago
- Data Pipes for CSV☆115Updated 3 years ago
- Tools for text tokenization and encoding☆84Updated 4 years ago
- Definitions of Pardon jargon to help Python beginners understand Pythonista gobbletigook☆55Updated 5 years ago
- Open Knowledge coding standards and style guide.☆35Updated 6 years ago
- "Old SFM" -- manage rules and streams from social data sources, starting with twitter.☆86Updated 2 years ago
- Topic modeling web application☆40Updated 10 years ago
- WaterButler is a Python web application for interacting with various file storage services via a single RESTful API, developed at Center …☆63Updated 3 weeks ago
- A contextual news development environment.☆49Updated 11 years ago
- CSV inspection☆10Updated 3 years ago
- Code, data, and paper for Academia.edu citation advantage analysis☆31Updated 10 years ago
- Plots various graphs for a series of plaintext files in a directory☆19Updated 9 years ago
- Parser and standardizer for politician, individual and organization names.☆128Updated 8 years ago
- Free-for-all repository of TEI and plain text files for you (to do cool stuff) provided by the Digital Collections Services group at the …☆27Updated 8 years ago
- Manage and load dataprotocols.org Data Packages☆27Updated 10 years ago
- extensible Web Retrieval Toolkit☆17Updated 3 years ago
- ☆48Updated 11 years ago
- A set of utilities for accessing and processing MediaWiki data.☆55Updated 7 years ago
- Repository for the DMPTool Project☆36Updated 7 years ago
- Using social media to steer web archiving and curation.☆18Updated 10 years ago
- A framework (comand line tool + libraries) for creating flexible compute pipelines☆56Updated 5 years ago
- Open Research Data do-a-thon in London & Virtual - March 4th & 5th☆37Updated 8 years ago
- Scientific analysis of collaborative communities☆157Updated 9 months ago
- a framework and language for exploring and analyzing feeds of social media data.☆23Updated 14 years ago
- (DEPRECATED) Parser for U.S. federal regulations and other regulatory information☆55Updated 7 years ago
- A protovis visualization of the linked open data cloud.☆26Updated 14 years ago