# Install simplecrawler with npm

Very straightforward, event driven web crawler. Features a flexible queue interface and a basic cache mechanism with extensible backend. Version 1.1.9 via npm; verified 2020-04-12.

## Install

```sh
sudo av install npm:simplecrawler
```

Additional install commands:

### Portable and language managers

- npm (100%):

```sh
npm install -g simplecrawler
```

  Evidence: local npm package metadata

## Package facts

- **Package key:** npm:simplecrawler
- **Package manager:** npm
- **Package manager page:** <https://www.npmjs.com/package/simplecrawler>
- **Version:** 1.1.9
- **Source summary:** Very straightforward, event driven web crawler. Features a flexible queue interface and a basic cache mechanism with extensible backend.
- **Homepage:** <https://github.com/simplecrawler/simplecrawler>
- **Repository:** <https://github.com/simplecrawler/simplecrawler>
- **Upstream docs:** <https://github.com/simplecrawler/simplecrawler>
- **License:** BSD-2-Clause
- **Source archive:** <https://registry.npmjs.org/simplecrawler/-/simplecrawler-1.1.9.tgz>
- **Issue tracker:** <https://github.com/simplecrawler/simplecrawler/issues>
- **Published:** 2020-04-12T08:01:36.655Z
- **Last updated:** 2020-04-12T08:01:36.655Z
- **Generated:** 2026-07-08T18:08:21+00:00

## Executables

- crawl (cli)
- crawl (alias)

## Dependencies

- async
- iconv-lite
- robots-parser
- urijs

## Build dependencies

- chai
- eslint
- jsdoc-to-markdown
- mocha

## Install behavior

- Post-install hook: not defined
- Bottle: not available

## Freshness

- Page generated: 2026-07-08
- Package-manager version: 1.1.9
- Package-manager updated: 2020-04-12
- Local data: ok
- Upstream repository: https://github.com/simplecrawler/simplecrawler
- warning: The package-manager record has not been updated in over a year.
- info: No cached GitHub release or tag data was available.

## Security Notes

No matching local secret-handling manifest was found for simplecrawler. Nucleus package metadata is still published here so future coverage has a stable package URL.


## Source Database Details

- **Source Database:** npm registry
- **Dist Tags:** Latest: 1.1.9
- **Version Count:** 70
- **Maintainers:** cgiffard, fredrikekelund, kbychkov
- **Author:** Christopher Giffard
- **Publisher:** kbychkov
- **Engines:** Node: >=8
- **Integrity:** sha512-IY5YmeJWvfc1zpy9so1p/EknCqNum3Y9tmnzuLWZqKEwbntGXPGvN0SOtr+XqT4BHjfek2C12g3Tg1yK7Hoh8g==
- **Shasum:** 6e2a7a22b44c207584c30185b4f99a5224f403cc
- **Unpacked Size:** 175,237
- **File Count:** 0
- **Created At:** 2012-05-15T01:50:05.008Z
- **Latest Published At:** 2020-04-12T08:01:36.655Z
- **Modified At:** 2022-06-26T20:00:43.091Z

## Other Package-Manager Records

- Debian apt - crawl - 2:0.28.0-1.1: installed executable or alias match | Debian stable package indexes: crawl from https://deb.debian.org/debian/dists/stable/main/binary-amd64/Packages.xz | Dungeon Crawl, a text-based roguelike game | http://crawl.develz.org/
- Debian apt - crawl-common - 2:0.28.0-1.1: installed executable or alias match | Debian stable package indexes: crawl-common from https://deb.debian.org/debian/dists/stable/main/binary-amd64/Packages.xz | Dungeon Crawl, a text-based roguelike game (data files) | http://crawl.develz.org/
- Debian apt - crawl-tiles - 2:0.28.0-1.1: installed executable or alias match | Debian stable package indexes: crawl-tiles from https://deb.debian.org/debian/dists/stable/main/binary-amd64/Packages.xz | Dungeon Crawl, a roguelike game, tiles version | http://crawl.develz.org/
- Debian apt - crawl-tiles-data - 2:0.28.0-1.1: installed executable or alias match | Debian stable package indexes: crawl-tiles-data from https://deb.debian.org/debian/dists/stable/main/binary-amd64/Packages.xz | Dungeon Crawl, a text-based roguelike game (tile data files) | http://crawl.develz.org/
- Nix - crawl: installed executable or alias match | nixpkgs package indexes: pkgs/by-name/cr/crawl/package.nix from https://api.github.com/repos/NixOS/nixpkgs/git/trees/master?recursive=1
- Ubuntu apt - crawl - 2:0.28.0-1.1: installed executable or alias match | Ubuntu 24.04 LTS package indexes: crawl from https://archive.ubuntu.com/ubuntu/dists/noble/universe/binary-amd64/Packages.gz | Dungeon Crawl, a text-based roguelike game | http://crawl.develz.org/
- Ubuntu apt - crawl-common - 2:0.28.0-1.1: installed executable or alias match | Ubuntu 24.04 LTS package indexes: crawl-common from https://archive.ubuntu.com/ubuntu/dists/noble/universe/binary-amd64/Packages.gz | Dungeon Crawl, a text-based roguelike game (data files) | http://crawl.develz.org/
- Ubuntu apt - crawl-tiles - 2:0.28.0-1.1: installed executable or alias match | Ubuntu 24.04 LTS package indexes: crawl-tiles from https://archive.ubuntu.com/ubuntu/dists/noble/universe/binary-amd64/Packages.gz | Dungeon Crawl, a roguelike game, tiles version | http://crawl.develz.org/
- Ubuntu apt - crawl-tiles-data - 2:0.28.0-1.1: installed executable or alias match | Ubuntu 24.04 LTS package indexes: crawl-tiles-data from https://archive.ubuntu.com/ubuntu/dists/noble/universe/binary-amd64/Packages.gz | Dungeon Crawl, a text-based roguelike game (tile data files) | http://crawl.develz.org/
- dnf - crawl - 0.34.1-3.fc45: installed executable or alias match | Fedora Rawhide package metadata: crawl from https://dl.fedoraproject.org/pub/fedora/linux/development/rawhide/Everything/x86_64/os/repodata/e5ca8ce900cd68f5419e1c39ae517343100b306336cbaeb70a3c153121d95094-primary.xml.zst | Roguelike dungeon exploration game | https://crawl.develz.org/
- dnf - crawl-common-data - 0.34.1-3.fc45: installed executable or alias match | Fedora Rawhide package metadata: crawl-common-data from https://dl.fedoraproject.org/pub/fedora/linux/development/rawhide/Everything/x86_64/os/repodata/e5ca8ce900cd68f5419e1c39ae517343100b306336cbaeb70a3c153121d95094-primary.xml.zst | Common data files of crawl | https://crawl.develz.org/
- dnf - crawl-tiles - 0.34.1-3.fc45: installed executable or alias match | Fedora Rawhide package metadata: crawl-tiles from https://dl.fedoraproject.org/pub/fedora/linux/development/rawhide/Everything/x86_64/os/repodata/e5ca8ce900cd68f5419e1c39ae517343100b306336cbaeb70a3c153121d95094-primary.xml.zst | Roguelike dungeon exploration game with tiles | https://crawl.develz.org/


## Related links

- [Developer build packages](https://www.automicvault.com/pkg/developer-build-tools/) - Matched curated package taxonomy and local package facts.
- [ts-web-scraper](https://www.automicvault.com/pkg/npm/ts-web-scraper/) - Local package facts share a topical domain. Shared terms: cli, code, code-generation, crawler, developer.
- [release-please](https://www.automicvault.com/pkg/npm/release-please/) - Local package facts share a topical domain. Shared terms: async, cli, code, code-generation, developer.
- [sdp-transform](https://www.automicvault.com/pkg/npm/sdp-transform/) - Local package facts share a topical domain. Shared terms: cli, code, code-generation, developer, developer-tools.

## Sources

- Nucleus package database
- package-page enrichment
- package version freshness
- av.db category and tag curation
- package relationship graph
- external package-manager database matches
- cross-ecosystem install command graph