Write partitioning properties#

use-preferred-write-partitioning#

  • Type: boolean

  • Default value: true

  • Session property: use_preferred_write_partitioning

Enable preferred write partitioning. When set to true, each partition is written by a separate writer. For some connectors such as the Hive connector, only a single new file is written per partition, instead of multiple files. Partition writer assignments are distributed across worker nodes for parallel processing.