Install xapian with Homebrew, Nix

Project links

• Homepage
• Repository
• Upstream docs
• Package manager page

Commands and aliases

• copydatabase
• simpleexpand
• simpleindex
• simplesearch
• xapian-check
• xapian-compact
• xapian-config
• xapian-delve
• xapian-metadata
• xapian-pos
• xapian-progsrv
• xapian-quest
• xapian-replicate
• xapian-replicate-server
• xapian-tcpsrv

Project history

Xapian descends from more than 30 years of commercial and academic information-retrieval work. The project is partly derived from Open Muscat, a GPL release from BrightStation PLC that replaced the older proprietary Muscat 3.6 system written largely in BCPL.

Muscat was originally written by Dr. Martin Porter at the University of Cambridge. In 1984 Porter and John Snyder founded Cambridge CD Publishing to commercialize the technology; the company became Muscat Ltd, was acquired by Maid PLC, and later became part of the Dialog Corporation and BrightStation story.

After BrightStation, former employees and Open Muscat community developers continued from the last GPLed version. The project was first called OmSeek, but a naming complaint over similarity to Omsee led the developers to choose the name Xapian.

Adoption history

Xapian's adoption came from being embeddable, portable, and mature: it exposes search as a programmer library rather than requiring every application to run a separate search service. The project lists bindings for languages including Perl, Python, PHP, Java, Tcl, C#, Ruby, Lua, Erlang, Node.js, and R.

Known users include the University of Cologne library OPAC through OpenBib, Die Zeit search, Debian website and mailing-list search, TheyWorkForYou, WhatDoTheyKnow, Recoll desktop search, Notmuch email search, MoinMoin, Roundup, Doxygen searchable documentation, and Kiwix. Those examples show Xapian's range from web search to mail, desktop, documentation, and offline content.

How it is used

Developers use Xapian by creating or updating databases of documents, adding terms and values, and querying through the library's query parser and ranking models. The command-line tools in the package support checking, compacting, copying, probing, replicating, and serving Xapian databases.

Omega covers the ready-made website-search use case: omindex or scriptindex creates databases, omega serves searches through CGI, and templates define presentation. Xapian itself covers lower-level application search where callers want control over indexing, weighting, filtering, and query construction.

Why package nerds care

Xapian is a quietly important package because many users meet it indirectly through search features in mail clients, desktop search, wikis, issue trackers, documentation generators, and web archives. It is the kind of library package that makes a system's search boxes work without being the visible application.

Timeline

• 1984: Martin Porter and John Snyder found Cambridge CD Publishing around the Muscat technology.
• 1990s: Muscat evolves commercially through Muscat Ltd, Maid PLC, Dialog Corporation, and BrightStation PLC.
• Early 2000s: Developers continue from the GPLed Open Muscat code, initially as OmSeek and then as Xapian.
• 2002-09-20: Xapian 0.5.0 is identified by secondary sources as the first official Xapian release.
• 2026-03-16: Xapian 2.0.0 is released as the current stable branch according to the project homepage.

Related projects

• Open Muscat is Xapian's direct open-source ancestor.
• Omega is the packaged web and intranet search application supplied by the Xapian project.
• Recoll, Notmuch, MoinMoin, Doxygen, and Kiwix are notable downstream or integrating projects.

Sources

• https://en.wikipedia.org/wiki/Xapian
• https://xapian.org/
• https://xapian.org/docs/omega/overview.html
• https://xapian.org/features
• https://xapian.org/history
• https://xapian.org/users