flow.yaml. You're encouraged to follow this convention by using prefixes to differentiate separate catalog specs you may have, as in
flowctl discoverto auto-generate a catalog spec.
flowctl discoverto generate a catalog spec with a capture and a collection. Then, you can add additional sections and make changes manually.
importsection is a list of partial or absolute URLs that are always evaluated relative to the base directory of the current source. For example, these are possible imports within a collection:
flowctlcan even directly build remote sources:
$refkeyword, by which local and external schema URLs may be referenced. Flow uses these same import rules for resolving JSON schemas, and it’s recommended to directly reference the authoritative source of an external schema. Using a hypothetical Citi-bike schema URL, this would look like the following:
flowctlfetches and resolves all catalog and JSON Schema sources at build time, resulting in a self-contained snapshot of these resources as they were at the time the catalog was built.
collectionssection is a list of collection definitions within a catalog source. A collection must be defined before it may be used as a source within another collection.