metadata-crawler
Crawl, extract and push climate metadata for indexing.
Crawl, extract and push climate metadata for indexing.
To install this package, run one of the following:
Harvest, normalise, and index climate / earth-system metadata from POSIX, S3/MinIO, and OpenStack Swift using configurable DRS dialects (CMIP6, CMIP5, CORDEX, …). Output to a temporary catalogue (JSONLines) and then index into systems such as Solr or MongoDB. Configuration is TOML with inheritance, templating, and computed rules.
Summary
Crawl, extract and push climate metadata for indexing.
Last Updated
Jul 3, 2026 at 11:37
License
BSD-3-Clause
Supported Platforms
Unsupported Platforms
GitHub Repository
https://github.com/freva-org/metadata-crawler