astro.files.types.parquet

Module Contents

Classes

ParquetFileType

Concrete implementation to handle Parquet file type

class astro.files.types.parquet.ParquetFileType(path, normalize_config=None)

Bases: astro.files.types.base.FileType

Concrete implementation to handle Parquet file type

Parameters

• path (str) –

• normalize_config (Optional[dict]) –

export_to_dataframe(stream, **kwargs)

read parquet file from one of the supported locations and return dataframe

Parameters

stream – file stream object

create_from_dataframe(df, stream)

Write parquet file to one of the supported locations

Parameters

• df (pandas.DataFrame) – pandas dataframe

• stream (io.TextIOWrapper) – file stream object

Return type

None

property name

get file type