ChrisCates / CommonCrawler
🕸 A simple way to extract data from Common Crawl
☆33Updated 4 years ago
Related projects ⓘ
Alternatives and complementary repositories for CommonCrawler
- 🍱 bento is an English-based automation language designed to be used by non-technical people.☆32Updated 5 years ago
- runs go generate recursively on a specified path or environment variable and can filter by regex☆30Updated 7 years ago
- Summarizes text☆38Updated 9 years ago
- package lingo provides the data structures and algorithms required for natural language processing☆153Updated last year
- Natural Language Processing Toolkit in Golang☆63Updated 4 years ago
- Go package that helps write to files atomically☆10Updated 2 years ago
- Simple Go library for executing lots of operations spread over any number of threads☆73Updated last year
- Advanced declarative web scraping☆30Updated last year
- Reads zip files from io.Reader☆55Updated last week
- a tiny package that implements SMTP server for Go projects☆106Updated 11 months ago
- web-based UI editor for bleve index mappings☆24Updated 2 weeks ago
- Tagify produces a set of tags from a given source. Source can be either an HTML page, a Markdown document or a plain text. Supports Engli…☆38Updated 4 months ago
- doc2vec , word2vec, implemented by golang. word embedding representation☆41Updated 6 years ago
- An easy-to-use, lightweight embedded on-disk database built on Badger for use in your Go programs.☆52Updated 4 years ago
- A generic patricia trie (also called radix tree) implemented in Go (Golang)☆28Updated 5 years ago
- Simple Email Parser☆47Updated 8 years ago
- Go client for newsapi (https://newsapi.org/)☆37Updated 4 years ago
- A Go package for n-gram based text categorization, with support for utf-8 and raw text☆72Updated 3 years ago
- Instagram power tool☆57Updated 5 years ago
- Read and use word2vec vectors in Go☆56Updated 6 years ago
- Redis style logger for Go☆28Updated 3 years ago
- Start Go command line apps with ease☆16Updated last year
- Go implementation of different backoff strategies useful for retrying operations and heartbeating.☆85Updated 4 years ago
- Go Stanford NLP POS Tagger wrapper☆38Updated 7 years ago
- 📟 Tiny utility Go client for HackerNews API.☆17Updated 7 years ago
- A distributed forward caching proxy for Go's http.Client supporting TLS☆31Updated 6 years ago
- Miscellaneous tools for processing WARC files from the CommonCrawl☆22Updated 10 years ago
- Structured scraper for Go☆25Updated 6 years ago
- A simple tool to collect and process quite a few web news from multiple sources☆34Updated 2 years ago
- Go package for abstracting local, in-memory, and remote (Google Cloud Storage/S3) filesystems☆52Updated 6 years ago