CitizensFoundation / pace-keyword-scanner
CommonCrawl keyword scanner. Time for month of CC data on EC2 c5.18xlarge instance for hundreds of keywords takes about 3 hours. LLM (BERT) based 2nd level filtering. Developed with support from the EU and the Populism & Civic Engagement H2020 project.
☆14Updated 2 years ago
Alternatives and similar repositories for pace-keyword-scanner:
Users that are interested in pace-keyword-scanner are comparing it to the libraries listed below
- Real-Time Proxy & Web Scraping API☆24Updated 5 years ago
- Datasette enrichment for analyzing row data using OpenAI's GPT models☆19Updated 10 months ago
- ☆14Updated 3 years ago
- Dead simple cron service for making HTTP calls on a regular schedule.☆14Updated 4 years ago
- ☆12Updated last year
- Datasette showing global power plant data from https://github.com/wri/global-power-plant-database☆17Updated 2 years ago
- Backend, IA-specific tools for crawling and processing the scholarly web. Content ends up in https://fatcat.wiki☆25Updated 8 months ago
- A Command line interface that allows you to manage the back end of your self hosted typesense server. Builds on top of the typesense js l…☆16Updated last year
- Matomo plugin for Docusaurus v2/v3☆14Updated last year
- Track changes to GraphQL APIs by git scraping their schemas☆28Updated this week
- Everyting you need to know about Aquila Network Neural Search Ecosystem. Official repositories, client libraries, ecosystem projects, boi…☆32Updated 3 years ago
- 🗳️ Monitor your country, your city council or your organization promises and objectives☆14Updated 3 years ago
- List of privacy-friendly analytics solutions☆19Updated last year
- A tool for creating a repository of transcribed videos☆53Updated last year
- Stackbit Medium Importer☆15Updated 2 years ago
- A demonstration transnational register of beneficial ownership data from the UK, Denmark, Slovakia and Armenia☆17Updated 5 months ago
- Helps you to visualize the site structure☆9Updated last year
- Datasette plugin that renders binary blob images using data-uris☆23Updated last year
- etl pipeline, graphical explorer and general toolbox for investigations with follow the money data☆16Updated last year
- Use SQL to instantly query customers, products, invoices and more from Stripe. Open source CLI. No DB required.☆20Updated this week
- Matrix-based News Aggregation to Explore Media Bias☆20Updated 6 years ago
- A minimal client-side library to convert your vanilla URLs to deep links.☆20Updated 4 years ago
- A git scraper recording the CDC's Covid Data Tracker numbers on number of vaccinations per state.☆24Updated last year
- Fully customizable open source voice experience that can be hosted on any website.☆33Updated 2 years ago
- A Python scraping module, that extracts text from articles found in RSS feeds. Uses SQLite as database.☆19Updated 8 months ago
- H2O is a web app for creating and reading open educational resources, primarily in the legal field☆38Updated last month
- ☆12Updated 2 weeks ago
- DocumentCloud's back end source code - Please report bugs, issues and feature requests to info@documentcloud.org☆37Updated last week
- Open Access PDF harvester☆39Updated 11 months ago
- 📧 Reacher dashboard.☆29Updated last week