astro.files.locations.amazon.s3

Module Contents

Classes

S3Location

Handler S3 object store operations

class astro.files.locations.amazon.s3.S3Location(path, conn_id=None)

Bases: astro.files.locations.base.BaseFileLocation

Handler S3 object store operations

Parameters
  • path (str) –

  • conn_id (Optional[str]) –

location_type
static _parse_s3_env_var()

Return S3 ID/KEY pair from environment vars

Return type

Tuple[str, str]

property transport_params

Structure s3fs credentials from Airflow connection. s3fs enables pandas to write to s3

Return type

Dict

property paths

Resolve S3 file paths with prefix

Return type

List[str]

property size

Return the size in bytes of the given file

Return type

int