astro.files.types.parquet
Module Contents
Classes
Concrete implementation to handle Parquet file type |
- class astro.files.types.parquet.ParquetFileType(path, normalize_config=None)
Bases:
astro.files.types.base.FileType
Concrete implementation to handle Parquet file type
- Parameters
path (str) –
normalize_config (dict | None) –
- export_to_dataframe(stream, columns_names_capitalization='original', **kwargs)
read parquet file from one of the supported locations and return dataframe
- Parameters
stream – file stream object
columns_names_capitalization – determines whether to convert all columns to lowercase/uppercase in the resulting dataframe
- create_from_dataframe(df, stream)
Write parquet file to one of the supported locations
- Parameters
df (pandas.DataFrame) – pandas dataframe
stream (io.TextIOWrapper) – file stream object
- Return type
None
- property name
get file type