Construct Hive partitioning

Hive partitioning embeds field names and values in path segments, such as"/year=2019/month=2/data.parquet".

Usage

hive_partition(..., null_fallback=NULL, segment_encoding="uri")

Arguments

...

named list ofdata types, passed toschema()

null_fallback

character to be used in place of missing values (NA orNULL)in partition columns. Default is"__HIVE_DEFAULT_PARTITION__",which is what Hive uses.

segment_encoding

Decode partition segments after splitting paths.Default is"uri" (URI-decode segments). May also be"none" (leave as-is).

Value

AHivePartitioning, or aHivePartitioningFactory ifcallinghive_partition() with no arguments.

Details

Because fields are named in the path segments, order of fields passed tohive_partition() does not matter.

Examples

hive_partition(year=int16(), month=int8())#> HivePartitioning