Release 459 (25 Sep 2024)

General

• Fix possible query failure when retry_policy is set to TASK and when adaptive join reordering is enabled. (#23407)

Docker image

• Update Java runtime to Java 23. (#23482)

CLI

• Display data sizes and rates with binary (1024-based) abbreviations such as KiB and MiB. Add flag --decimal-data-size to use decimal (1000-based) values and abbreviations such as KB and MB. (#13054)

BigQuery connector

• Improve performance of queries that access only a subset of fields from nested data. (#23443)

• Fix query failure when the bigquery.service-cache-ttl property isn’t 0ms and case insensitive name matching is enabled. (#23481)

ClickHouse connector

• Improve performance for queries involving conditions with varchar data. (#23516)

Delta Lake connector

• Allow configuring maximum concurrent HTTP requests to Azure on every node in Azure Storage file system support with azure.max-http-requests. (#22915)

• Add support for WASB to Azure Storage file system support. (#23511)

• Allow disabling caching of Delta Lake transaction logs when file system caching is enabled with the delta.fs.cache.disable-transaction-log-caching property. (#21451)

• Improve cache hit ratio for the File system cache. (#23172)

• Fix incorrect results when writing deletion vectors. (#23229)

• Fix failures for queries with containing aggregations with a DISTINCT clause on metadata tables. (#23529)

Elasticsearch connector

• Fix failures for count(*) queries with predicates containing non-ASCII strings. (#23425)

Hive connector

• Allow configuring maximum concurrent HTTP requests to Azure on every node in Azure Storage file system support with azure.max-http-requests. (#22915)

• Add support for WASB to Azure Storage file system support. (#23511)

• Improve cache hit ratio for the File system cache. (#23172)

• Fix failures for queries with containing aggregations with a DISTINCT clause on metadata tables. (#23529)

Hudi connector

• Allow configuring maximum concurrent HTTP requests to Azure on every node in Azure Storage file system support with azure.max-http-requests. (#22915)

• Add support for WASB to Azure Storage file system support. (#23511)

• Fix failures for queries with containing aggregations with a DISTINCT clause on metadata tables. (#23529)

Iceberg connector

• Allow configuring maximum concurrent HTTP requests to Azure on every node in Azure Storage file system support with azure.max-http-requests. (#22915)

• Add support for WASB to Azure Storage file system support. (#23511)

• Improve cache hit ratio for the File system cache. (#23172)

• Fix failures for queries with containing aggregations with a DISTINCT clause on metadata tables. (#23529)

Local file connector

• ⚠️ Breaking change: Remove the local file connector. (#23556)

OpenSearch connector

• Fix failures for count(*) queries with predicates containing non-ASCII strings. (#23425)

SPI

• Add ConnectorAccessControl argument to the ConnectorMetadata.getTableHandleForExecute method. (#23524)