# Install scrapy with Homebrew, pacman

Web crawling & scraping framework. Version 2.17.0 via Homebrew; verified 2026-07-08.

## Install

```sh
sudo av install brew:scrapy
```

Additional install commands:

### macOS

- Homebrew (100%):

```sh
brew install scrapy
```

  Evidence: local Homebrew formula metadata

### Linux

- pacman (92%):

```sh
sudo pacman -S scrapy
```

  Evidence: Arch Linux sync databases: scrapy from https://geo.mirror.pkgbuild.com/extra/os/x86_64/extra.db.tar.gz

## Package facts

- **Package key:** brew:scrapy
- **Package manager:** Homebrew
- **Package manager page:** <https://formulae.brew.sh/formula/scrapy>
- **Version:** 2.17.0
- **Source summary:** Web crawling & scraping framework
- **Homepage:** <https://scrapy.org>
- **Repository:** <https://github.com/scrapy/scrapy>
- **Upstream docs:** <https://docs.scrapy.org/en/latest>
- **License:** BSD-3-Clause
- **Source archive:** <https://files.pythonhosted.org/packages/35/9f/9800513193aacb44825f0b9a75e4e6d4a0c416e9ed23ca3aac7374d03d17/scrapy-2.17.0.tar.gz>
- **Last updated:** 2026-07-08T14:27:19Z
- **Generated:** 2026-07-08T18:08:21+00:00

## Executables

- scrapy (cli)
- scrapy (alias)

## Dependencies

- certifi
- cryptography
- python@3.14

## Uses from macOS

- libxml2
- libxslt

## Install behavior

- Post-install hook: not defined
- Bottle: available on arm64_linux, arm64_sequoia, arm64_sonoma, arm64_tahoe, sonoma, x86_64_linux

## Freshness

- Page generated: 2026-07-08
- Package-manager version: 2.17.0
- Package-manager updated: 2026-07-08
- Local data: ok
- Upstream repository: https://scrapy.org
- info: Release/tag comparison is only available for GitHub repositories.

## Security Notes

No matching local secret-handling manifest was found for scrapy. Nucleus package metadata is still published here so future coverage has a stable package URL.



## Configuration and credential file locations

These source-backed paths show where this package keeps local settings or durable credentials. Automic Vault can use them as review targets for secret scanning, migration, and command approval.


## Configuration files

- Unix: /etc/scrapy.cfg, ~/.config/scrapy.cfg, ~/.scrapy.cfg, scrapy.cfg
- Windows: c:\scrapy\scrapy.cfg, scrapy.cfg
## Source Database Details

- **Source Database:** Homebrew formula API
- **Tap:** homebrew/core
- **Full Name:** scrapy
- **Version Scheme:** 0
- **Revision:** 0
- **Head Version:** HEAD
- **Bottle Stable Root URL:** <https://ghcr.io/v2/homebrew/core>
- **Deprecated:** no
- **Disabled:** no
- **Keg Only:** no
- **URL Keys:** head, stable

## Other Package-Manager Records

- pacman - scrapy - 2.14.2-1: normalized package name match | Arch Linux sync databases: scrapy from https://geo.mirror.pkgbuild.com/extra/os/x86_64/extra.db.tar.gz | A fast high-level scraping and web crawling framework. | https://scrapy.org


## Related links

- [Terminal utility packages](https://www.automicvault.com/pkg/terminal-utilities/) - Matched terminal and command-line workflow metadata.
- [Text processing packages](https://www.automicvault.com/pkg/text-processing-tools/) - Matched text, document, or structured-data processing metadata.
- [Language runtime packages](https://www.automicvault.com/pkg/language-runtime-packages/) - Matched language runtime, compiler, or interpreter metadata.
- [Networking and protocol packages](https://www.automicvault.com/pkg/networking-protocol-tools/) - Matched network, protocol, or remote-service metadata.
- [python@3.14](https://www.automicvault.com/pkg/brew/python-3-14/) - Runtime dependency declared by Homebrew.
- [trafilatura](https://www.automicvault.com/pkg/brew/trafilatura/) - Shares av.db curated category or tags: cli, data, python, web-crawling, web-scraping.
- [xidel](https://www.automicvault.com/pkg/brew/xidel/) - Shares av.db curated category or tags: cli, data, web-scraping.
- [bagit](https://www.automicvault.com/pkg/brew/bagit/) - Shares av.db curated category or tags: cli, data, python.
- [csvkit](https://www.automicvault.com/pkg/brew/csvkit/) - Shares av.db curated category or tags: cli, data, python.
- [fred](https://www.automicvault.com/pkg/brew/fred/) - Shares av.db curated category or tags: cli, data, python.
- [glom](https://www.automicvault.com/pkg/brew/glom/) - Shares av.db curated category or tags: cli, data, python.
- [iredis](https://www.automicvault.com/pkg/brew/iredis/) - Shares av.db curated category or tags: cli, data, python.
- [kaskade](https://www.automicvault.com/pkg/brew/kaskade/) - Shares av.db curated category or tags: cli, data, python.
- [firecrawl-cli](https://www.automicvault.com/pkg/npm/firecrawl-cli/) - Local package facts share a topical domain. Shared terms: cli, data, data-extraction, extraction, scraping.

## Combined YAML source

View the package source record on GitHub. [combined/scrapy.yml](https://github.com/automic-vault/db/blob/main/combined/scrapy.yml)


## Sources

- Nucleus package database
- Geiger risk classifier
- package-page enrichment
- curated configuration and credential file locations
- package version freshness
- av.db category and tag curation
- package relationship graph
- external package-manager database matches
- cross-ecosystem install command graph