65: Performance boosts

Introduction

Manfred and Cole dive into the details of some changes in recent and upcoming Trino releases. They cover file compression and decompression improvements, the updated file system support, and other performance boosters.

Video

• Introduction (0.0s)
• Releases 455, 456, and 457 (107.0s)
• JDBC driver JAR (404.0s)
• Concurrent write improvement with Delta Lake (473.0s)
• Adaptive plan optimization and join ordering (604.0s)
• Aircompressor and Airlift (850.0s)
• Java 23 (1304.0s)
• More Airlift and HTTP/2 (1483.0s)
• File system support changes (1770.0s)
• Client protocol improvements (2138.0s)
• Slack channel clean up (2445.0s)
• Closing issues (2590.0s)
• Rounding out with Trino Summit (2839.0s)

Audio

Hosts

• Manfred Moser, Director of Trino Community Leadership at Starburst, (@simpligility)
• Cole Bowden, Developer Advocate at Starburst

Releases and news

Trino 455

• Add query starting time in QueryStatistics in all event listeners, including the new Kafka event listener.
• Allow configuring endpoint for the native Azure filesystem.

Trino 456

Invalid - release process errors resulted in invalid artifacts.

Trino 457

• Improve performance of queries involving joins when fault-tolerant execution is enabled.
• Improve performance for LZ4, Snappy and ZSTD compression and decompression.
• Publish a JDBC driver JAR without bundled, third-party dependencies.
• Improve performance for concurrent write operations on S3 by using lock-less Delta Lake write reconciliation, made possible with the release of the AWS SDK with S3 conditional write support.

As usual, numerous performance improvements, bug fixes, and other features have been added as well.

Performance boosters

We chat about some of the following aspects and projects and their impact on Trino:

• Role and history of Aircompressor.
• Foundation from Airlift.
• Relation to Java 22, and soon 23.
• Status and next steps for improved and modernized file system support.
• A quick glance at client protocol improvements.

Resources

• Aircompressor
• Airlift
• Object storage and file system documentation
• Project Hummingbird
• Project Swift

Rounding out

• We chat about the recent cleanup of unused Slack channels.
• A call out to help us clean up and close old issues.
• Check out our new video call background images.
• Trino Summit 2024 is coming on the 11th and 12th of December, and registration, call for speakers, and sponsorship opportunities are open.
• Join us for the next Trino Community Broadcast 66 about Wren AI and Trino.

If you want to learn more about Trino, check out the definitive guide from O’Reilly. You can get the free PDF from Starburst or buy the English, Polish, Chinese, or Japanese edition.