astro.files.locations.ftp
Module Contents
Classes
Handler FTP object store operations |
- class astro.files.locations.ftp.FTPLocation(path, conn_id=None, load_options=None)
Bases:
astro.files.locations.base.BaseFileLocationHandler FTP object store operations
- Parameters:
path (str) –
conn_id (str | None) –
load_options (LoadOptions | None) –
- property hook: airflow.providers.ftp.hooks.ftp.FTPHook
- Return type:
airflow.providers.ftp.hooks.ftp.FTPHook
- property transport_params: dict
get FTP credentials for remote file system
- Return type:
dict
- property paths: list[str]
Resolve FTP file paths with prefix
- Return type:
list[str]
- property size: int
Return file size for FTP location
- Return type:
int
- property openlineage_dataset_namespace: str
Returns the open lineage dataset namespace as per https://github.com/OpenLineage/OpenLineage/blob/main/spec/Naming.md
- Return type:
str
- property openlineage_dataset_name: str
Returns the open lineage dataset name as per https://github.com/OpenLineage/OpenLineage/blob/main/spec/Naming.md
- Return type:
str
- location_type
- supported_conn_type
- get_uri()
Gets the URI of the connection
- get_stream()
Create a file in the desired location using the smart_open.
- Parameters:
df – pandas dataframe