astro.sql
Subpackages
astro.sql.operators
astro.sql.operators.append
astro.sql.operators.base_decorator
astro.sql.operators.base_operator
astro.sql.operators.cleanup
astro.sql.operators.dataframe
astro.sql.operators.drop
astro.sql.operators.export_file
astro.sql.operators.load_file
astro.sql.operators.merge
astro.sql.operators.raw_sql
astro.sql.operators.transform
astro.sql.operators.upstream_task_mixin
Submodules
Package Contents
Classes
|
Append the source table rows into a destination table. |
|
Clean up temporary tables at the end of a DAG run. Temporary tables are the ones that are |
|
Converts a SQL table into a dataframe. Users can then give a python function that takes a dataframe as |
|
Airflow Operator for dropping SQL tables. |
|
Write SQL table to csv/parquet on local/S3/GCS. |
|
Load S3/local file into either a database or a pandas dataframe |
|
Merge the source table rows into a destination table. |
|
Given a SQL statement and (optional) tables, execute the SQL statement and output |
|
Contains additional information to access a SQL Table, which is very likely optional and, in some cases, may |
|
User-facing class that has information necessary to access a SQL Table. It is agnostic to the database type. |
Functions
|
Append the source table rows into a destination table. |
|
Clean up temporary tables once either the DAG or upstream tasks are done |
|
This decorator will allow users to write python functions while treating SQL tables as dataframes |
|
Drops a table. |
|
Convert ExportFileOperator into a function. Returns XComArg. |
|
Load a file or bucket into either a SQL table or a pandas dataframe. |
|
Merge the source table rows into a destination table. |
|
Given a python function that returns a SQL statement and (optional) tables, execute the SQL statement and output |
|
Given a python function that returns a SQL statement and (optional) tables, execute the SQL statement and output |
|
This function returns a |