wpull logo

wpull

Allows web content to be downloaded and crawled, with support for archiving in WARC format and custom scripting using Python or Lua.

Made by Christopher Foo

  • offline-website

  • web-crawler

  • website-copier

What is wpull?

Wpull is a versatile web downloader and crawler tool that offers compatibility with the widely-used wget utility, as well as support for WARC file format and integration with Python/Lua scripting. It provides a robust set of features for users to efficiently retrieve web content and automate content crawling tasks

Highlights

  • WARC file format support for archiving web content
  • Compatibility with wget commands and functionality
  • Integration with Python and Lua scripting languages for customization

Platforms

  • Linux
  • Mac

Languages

  • English

Features

    • Command line interface

    • Website Downloader