Configuration

This chapter describes how to configure metadata‑crawler via a drs_config.toml file. The configuration is divided into different layers:

• Schema and field options: definitions for canonical facets and their data types.

• Dialects: definitions for each DRS standard (e.g. CMIP6, CORDEX) describing how to parse directory and file names and which sources of metadata to use.

• Datasets: entries that specify where to find data (root paths, storage backends, authentication) and how to inherit from a dialect.

• Path and data specs: instructions on how to extract metadata.

• Special rules: instructions on how to apply additional retrieval rules.

Sections

• Datasets
• Storage options
• Dialects
• Path and data specs
• Special rules
• Schema and field options
• Jinja2 templating
• Inheritance