FFFF GitHub - JakeSidSmith/krawala: Simple javascript web-crawler with command line interface · GitHub
[go: up one dir, main page]

Skip to content
JakeSidSmithPublic

About

Simple javascript web-crawler with command line interface

Resources

Stars

0 stars

Watchers

1 watching

Forks

Repository files navigation

Krawala

Simple javascript web-crawler with command line interface

Install

Run the following to install as a global CLI

npm i krawala -g

Usage

  Usage: krawala crawl [options]

  Options:
    --help, -h      Display help and usage info
    --depth, -d     Depth to crawl                                      [number]
    --format, -f    Format to return                                    [string]
    --interval, -i  Interval between requests (millis)                  [number]
    --timeout, -t   Maximum time to wait for a request (millis)         [number]
    --url, -u       URL to crawl                                        [string]

  Examples:
    krawala crawl -u http://domain.com -d 100

About

Simple javascript web-crawler with command line interface

Resources

Stars

0 stars

Watchers

1 watching

Forks

Releases

Packages

Used by

Contributors

Languages

0