Release 471 (19 Feb 2025)#

General#

  • Add AI functions for textual tasks on data using OpenAI, Anthropic, or other LLMs using Ollama as backend. (#25028)

  • Include split count and total split distribution time in the EXPLAIN ANALYZE output. (#25028)

  • Add support for JSON logging format to console with log.console-format=JSON. (#25081)

  • Support additional Python libraries for use with Python user-defined functions. (#25058)

  • Improve performance for Python user-defined functions. (#25058)

  • Improve performance for queries involving ORDER BY ... LIMIT. (#24937)

  • Prevent failures when fault-tolerant execution is configured with an exchange manager that uses Azure storage with workload identity. (#25063)

Server RPM#

Security#

  • Ensure that custom XML configuration files specified in the access-control.properties file are used during Ranger access control plugin initialization. (#24887)

Delta Lake connector#

Hive connector#

  • Add Local file system support. (#25006)

  • Add support for configuring s3.storage-class when writing objects to S3. (#24698)

  • Fix reading restored S3 glacier objects when the configuration property hive.s3.storage-class-filter is set to READ_NON_GLACIER_AND_RESTORED. (#24947)

Hudi connector#

Iceberg connector#

  • Add Local file system support. (#25006)

  • Add support for S3 Tables. (#24815)

  • Add support for configuring s3.storage-class when writing objects to S3. (#24698)

  • Improve conflict detection to avoid failures from concurrent MERGE queries on Iceberg tables. (#24470)

  • Ensure that the task.max-writer-count configuration is respected for write operations on partitioned tables. (#25068)

MongoDB connector#

  • Fix failures caused by tables with case-sensitive name conflicts. (#24998)

SPI#

  • Remove Connector.getInitialMemoryRequirement(). (#25055)