This is the primary repository for the Archivindex Builder project, which has been supported by Prototype Fund.
aib-core
: Representations of entries, snapshots, etc.aib-cdx
: Client for accessing CDX index APIsaib-cdx-store
: Local store for CDX index dataaib-store
: Local store for archive snapshotsaib-downloader
: Client for downloading archive snapshotsaib-downloader-cli
: Minimal command-line interface for downloading archive snapshots (for use in environments where compiling the entire project is undesirable)aib-extractor
: Library for extracting indexable documents from snapshotsaib-indexer
: Full-text index for snapshots, built on Tantivyaib-manager
: Pipelines for operations involving multiple data sourcesaib-cli
: Command-line interfaces for management operationsaib-auth
: Interfaces for managing user authenticationaib-auth-sqlx
: SQLx implementation for managing user authenticationaib-service
: JSON web service providing search API, built on Rocketredirects
: Miscellaneous tools for working with Wayback Machine redirects