astro.files.locations.ftp

Module Contents

Classes

FTPLocation

Handler FTP object store operations

class astro.files.locations.ftp.FTPLocation(path, conn_id=None, load_options=None)

Bases: astro.files.locations.base.BaseFileLocation

Handler FTP object store operations

Parameters:

• path (str) –

• conn_id (str | None) –

• load_options (astro.options.LoadOptions | None) –

property hook: airflow.providers.ftp.hooks.ftp.FTPHook

Return type:

airflow.providers.ftp.hooks.ftp.FTPHook

property transport_params: dict

get FTP credentials for remote file system

Return type:

dict

property paths: list[str]

Resolve FTP file paths with prefix

Return type:

list[str]

property size: int

Return file size for FTP location

Return type:

int

property openlineage_dataset_namespace: str

Returns the open lineage dataset namespace as per https://github.com/OpenLineage/OpenLineage/blob/main/spec/Naming.md

Return type:

str

property openlineage_dataset_name: str

Returns the open lineage dataset name as per https://github.com/OpenLineage/OpenLineage/blob/main/spec/Naming.md

Return type:

str

location_type

supported_conn_type

get_uri()

Gets the URI of the connection

get_stream()

Create a file in the desired location using the smart_open.

Parameters:

df – pandas dataframe