# Install trafilatura with Homebrew Discovery, extraction and processing for Web text. Version 2.1.0 via Homebrew; verified 2026-06-08. ## Install ```sh sudo av install brew:trafilatura ``` Additional install commands: ### macOS - Homebrew (100%): ```sh brew install trafilatura ``` Evidence: local Homebrew formula metadata ## Package facts - **Package key:** brew:trafilatura - **Package manager:** Homebrew - **Package manager page:** - **Version:** 2.1.0 - **Source summary:** Discovery, extraction and processing for Web text - **Homepage:** - **Repository:** - **Upstream docs:** - **License:** GPL-3.0-or-later - **Source archive:** - **Last updated:** 2026-06-08T19:27:24Z - **Generated:** 2026-07-08T18:08:21+00:00 ## Executables - trafilatura (cli) - trafilatura (alias) ## Dependencies - certifi - python@3.14 ## Uses from macOS - libxml2 - libxslt ## Install behavior - Post-install hook: not defined - Bottle: available on arm64_linux, arm64_sequoia, arm64_sonoma, arm64_tahoe, sonoma, x86_64_linux ## Freshness - Page generated: 2026-07-08 - Package-manager version: 2.1.0 - Package-manager updated: 2026-06-08 - Local data: ok - Upstream repository: https://trafilatura.readthedocs.io/en/latest/ - info: Release/tag comparison is only available for GitHub repositories. ## Project history and usage Trafilatura is a Python package and command-line tool for discovering, downloading, extracting, and processing web text. It grew from academic web-corpus work into a widely used open-source extraction tool for NLP, data acquisition, and scraping workflows. ### Project history The official README says the work started as a PhD project at the crossroads of linguistics and NLP, initially launched to create text databases for research at the Berlin-Brandenburg Academy of Sciences, specifically the DWDS and ZDL units. The repository was created on April 8, 2019. The project name comes from the Italian word trafilatura, referring to wire drawing and used by the author as a metaphor for refinement and conversion. Official citations connect the project to earlier research on metadata-enhanced web corpora in 2016, generic web content extraction in 2019, and the 2021 ACL/IJCNLP system demonstration paper. Official GitHub release metadata shows v0.1.0 published on September 25, 2019 and v1.0.0 on November 30, 2021. The README notes that versions prior to v1.8.0 were GPLv3+ and that current versions are distributed under Apache 2.0. ### Adoption history The official README says Trafilatura is widely used and integrated into thousands of projects, naming companies and institutions including Hugging Face, IBM, Microsoft Research, the Allen Institute, Stanford, Tokyo Institute of Technology, and the University of Munich. The official documentation has a uses and citations page, and the README emphasizes academic citation, benchmarks, and integration into the web data extraction ecosystem. Its adoption is therefore both software-package adoption and research-method adoption. ### How it is used Trafilatura can be used as a Python library or as the trafilatura command-line tool. Official docs describe crawling, downloads, scraping, main-text extraction, metadata extraction, comment extraction, language detection, and output as TXT, Markdown, CSV, JSON, HTML, XML, and XML-TEI. For package-manager users, the CLI is useful for quick extraction from live URLs or stored HTML without writing code, while Python users can embed the same extraction functions in data pipelines. ### Why package nerds care Trafilatura matters to package nerds because it packages a research-grade text extraction stack behind one CLI and Python module. It is useful for building local corpora, testing scraping pipelines, and comparing extraction quality without assembling many separate tools. Its packaging also reflects a common modern pattern: a Python data/NLP library that is simultaneously a CLI, a research artifact with citations, and an operational dependency for downstream software. ### Timeline - 2016: Author's related work on metadata-enhanced web corpora appears in the official citation list. - 2019: Repository created and v0.1.0 released. - 2021: Trafilatura ACL/IJCNLP system demonstration paper published; v1.0.0 released. - 2022: v1.2.x releases appear in official GitHub release metadata. - Current docs: Trafilatura 2.1.0 documentation is published on Read the Docs. ### Related projects - The official README lists jusText and readability as generic algorithms used in the extractor. - The official README points to htmldate and related web data extraction packages in the author's software ecosystem. ### Sources - - - - - ## Security Notes No matching local secret-handling manifest was found for trafilatura. Nucleus package metadata is still published here so future coverage has a stable package URL. ## Source Database Details - **Source Database:** Homebrew formula API - **Tap:** homebrew/core - **Full Name:** trafilatura - **Version Scheme:** 0 - **Revision:** 0 - **Bottle Stable Root URL:** - **Deprecated:** no - **Disabled:** no - **Keg Only:** no - **URL Keys:** stable ## Related links - [Terminal utility packages](https://www.automicvault.com/pkg/terminal-utilities/) - Matched terminal and command-line workflow metadata. - [Text processing packages](https://www.automicvault.com/pkg/text-processing-tools/) - Matched text, document, or structured-data processing metadata. - [Language runtime packages](https://www.automicvault.com/pkg/language-runtime-packages/) - Matched language runtime, compiler, or interpreter metadata. - [Networking and protocol packages](https://www.automicvault.com/pkg/networking-protocol-tools/) - Matched network, protocol, or remote-service metadata. - [python@3.14](https://www.automicvault.com/pkg/brew/python-3-14/) - Runtime dependency declared by Homebrew. - [scrapy](https://www.automicvault.com/pkg/brew/scrapy/) - Shares av.db curated category or tags: cli, data, python, web-crawling, web-scraping. - [bagit](https://www.automicvault.com/pkg/brew/bagit/) - Shares av.db curated category or tags: cli, data, python. - [csvkit](https://www.automicvault.com/pkg/brew/csvkit/) - Shares av.db curated category or tags: cli, data, python. - [fred](https://www.automicvault.com/pkg/brew/fred/) - Shares av.db curated category or tags: cli, data, python. - [glom](https://www.automicvault.com/pkg/brew/glom/) - Shares av.db curated category or tags: cli, data, python. - [iredis](https://www.automicvault.com/pkg/brew/iredis/) - Shares av.db curated category or tags: cli, data, python. - [kaskade](https://www.automicvault.com/pkg/brew/kaskade/) - Shares av.db curated category or tags: cli, data, python. - [mysql-to-sqlite3](https://www.automicvault.com/pkg/brew/mysql-to-sqlite3/) - Shares av.db curated category or tags: cli, data, python. - [datasette](https://www.automicvault.com/pkg/brew/datasette/) - Both packages touch the same language runtime or ecosystem. Shared terms: certifi, cli, data, python, python-3-14. ## Combined YAML source View the package source record on GitHub. [combined/trafilatura.yml](https://github.com/automic-vault/db/blob/main/combined/trafilatura.yml) ## Sources - Nucleus package database - Geiger risk classifier - package-page enrichment - curated package history - package version freshness - av.db category and tag curation - package relationship graph - cross-ecosystem install command graph