astro.files.operators.files

Module Contents

Classes

ListFileOperator

List the file available at path and storage

class astro.files.operators.files.ListFileOperator(path, conn_id, task_id='', **kwargs)

Bases: airflow.models.BaseOperator

List the file available at path and storage

Parameters
  • task_id (str) – The task id for uniquely identify a task in a DAG

  • path (str) – A path pattern for which you want to get a list of file

  • conn_id (str) – Airflow connection id. This will be used to identify the right Airflow hook at runtime to connect with storage services

template_fields = ['path', 'conn_id']
execute(context)

This is the main method to derive when creating an operator. Context is the same dictionary used as when rendering jinja templates.

Refer to get_template_context for more context.

Parameters

context (astro.utils.typing_compat.Context) –

Return type

Any