wolfgangmeyers / go-warc
A golang library to work with WARC files from the common crawl
☆14Updated 6 years ago
Related projects ⓘ
Alternatives and complementary repositories for go-warc
- Read and write WARC files in Go☆41Updated 6 years ago
- The speed of a native map, the safety of sync.RWMutex and the durability of bbolt☆24Updated 4 years ago
- golang readers for ARC and WARC webarchive formats☆20Updated last year
- Serve millions of JSON documents via HTTP.☆66Updated 2 weeks ago
- pure golang spelling based on hunspell dictionaries☆41Updated 8 years ago
- EU VAT number validation in Go using VIES SOAP service☆26Updated 4 years ago
- A pure Go implementation of the smaz compression library for short strings.☆20Updated 8 years ago
- Parser for HTML microdata, schema.org☆34Updated 8 years ago
- dmmclust is a package for clustering short texts, based on Yin and Wang (2014)☆25Updated 6 years ago
- dirscanner is a recursive file lister which uses channels for go.☆25Updated 5 years ago
- Miscellaneous tools for processing WARC files from the CommonCrawl☆22Updated 10 years ago
- A Reader/ReaderAt for Go that uses Range requests to get files over HTTP☆27Updated 2 years ago
- Package ara provides a dialer with customizable resolver.☆15Updated 4 years ago
- Go package for text annotation.☆72Updated 4 years ago
- Convert a nested map to a flat map of sql-friendly columns☆17Updated last year
- Create graphics with a hand-drawn, sketchy, appearance. Based on Rough.js☆29Updated 2 months ago
- A simple natural sorter for Go Strings☆28Updated 9 years ago
- Go package for abstracting local, in-memory, and remote (Google Cloud Storage/S3) filesystems☆52Updated 6 years ago
- Easy file permissions for golang. Easily get and set file permission bits.☆53Updated 3 years ago
- A library for abstracting away from the literal Go time library, for testing and time control.☆57Updated last year
- Increasing bleve indexing performance with sharding☆20Updated 6 years ago
- notify the specified webhook when a device is connected/disconnected☆31Updated 7 years ago
- A reader and writer per https://www.imperialviolet.org/2014/06/27/streamingencryption.html☆14Updated 4 years ago
- Webpage summary extractor using Facebook Open Graph and arc90's readability☆69Updated 5 years ago
- ☆14Updated 4 months ago
- web-based UI editor for bleve index mappings☆24Updated 2 weeks ago
- This package helps to work with huge amount of data, which cannot be stored in RAM☆43Updated 2 years ago
- Package valuegraph produces a graph representation of any Go value.☆32Updated 6 years ago
- A permissions system for Go structs☆15Updated 6 years ago
- singlefile implements a host wide locking mechanism.☆34Updated 9 years ago