metadata-crawler
Crawl, extract and push climate metadata for indexing.
Crawl, extract and push climate metadata for indexing.
To install this package, run one of the following:
Harvest, normalise, and index climate / earth-system metadata from POSIX, S3/MinIO, and OpenStack Swift using configurable DRS dialects (CMIP6, CMIP5, CORDEX, …). Output to a temporary catalogue (JSONLines) and then index into systems such as Solr or MongoDB. Configuration is TOML with inheritance, templating, and computed rules.
Summary
Crawl, extract and push climate metadata for indexing.
Last Updated
Dec 15, 2025 at 10:29
License
BSD-3-Clause
Total Downloads
2.6K
Supported Platforms
Unsupported Platforms
GitHub Repository
https://github.com/freva-org/metadata-crawler