Skip to main content

Cookbook

metawarc covers indexing, query, extraction, analysis, and replay. This page is a task-oriented index: find the row that sounds like you, then follow the linked reference. If you are completely new, do the quick start first.

You are a…You want to…Start with
Web archivistBuild a resumable index of a WARC collection without copying payloadsindex, ingest, catalog, doctor
Researcher / journalistFind PDFs, hosts, or date ranges and export selected payloadsstats, list-files, dump, get
Preservation engineerExtract document metadata, hashes, duplicates, and integrity evidenceindex-content, analyze
Replay operatorBrowse archived sites locally or feed pywbserve, replay, export-cdxj
Application developerExpose a read-only typed API over an indexserve, REST /records/list
AI / automation builderGive agents controlled metadata toolsmcp

Detailed walkthroughs