astro.files.locations.http

Module Contents

Classes

HTTPLocation

Handler http location operations

class astro.files.locations.http.HTTPLocation(path, conn_id=None, load_options=None)

Bases: astro.files.locations.base.BaseFileLocation

Handler http location operations

Parameters:

• path (str) –

• conn_id (str | None) –

• load_options (LoadOptions | None) –

property paths: list[str]

Resolve patterns in path

Return type:

list[str]

property size: int

Return file size for HTTP location

Return type:

int

property openlineage_dataset_namespace: str

Returns the open lineage dataset namespace as per https://github.com/OpenLineage/OpenLineage/blob/main/spec/Naming.md

Return type:

str

property openlineage_dataset_name: str

Returns the open lineage dataset name as per https://github.com/OpenLineage/OpenLineage/blob/main/spec/Naming.md

Return type:

str

location_type

validate_conn()

Override as conn_id is not always required for http location.