What is grab-site?
grab-site is a crawler that archives websites to WARC files. It provides a dashboard for monitoring multiple crawls, and allows users to modify URL ignore patterns during the crawl process
Highlights
- Archiving websites to WARC format
- Dashboard for monitoring multiple crawls
- Ability to change URL ignore patterns during crawling
Platforms
- Mac
- Linux
Languages
- English
Features
Command line interface
Website Downloader