73: Wrapping Trino packages with a bow

Introduction

Manfred Moser talks about his recent work to improve Trino packaging and demos how to create your own RPM, tarball, and container image.

Video

• Introduction with Cole and Manfred (0.0s)
• Release 473 and 474 (109.0s)
• Other news (437.0s)
• New Trino book (483.0s)
• Trino Query UI introduction (668.0s)
• Trino packaging history and overview (1015.0s)
• Improvements project (1335.0s)
• Plugin documentation and overview (1385.0s)
• trino-packages repository and RPM module (1660.0s)
• custom tarball module (1920.0s)
• custom docker container (2533.0s)
• Upcoming events (3267.0s)

Hosts

• Manfred Moser, Dev Rel Engineer at Chainguard @simpligility
• Cole Bowden, Developer Advocate at Firebolt

Releases

Following are some highlights of the recent releases:

Trino 473

• Add support for array literals.
• Add LDAP-based group provider.
• Remove the deprecated glue-v1 metastore type.
• Remove the deprecated Databricks Unity catalog integration.
• Remove the Kudu connector.
• Remove the Phoenix connector.

But don’t use 473 since there were some breaking changes, fixed in…

Trino 474

• Fix a correctness bug in GROUP BY or DISTINCT queries with a large number of unique groups.
• Add originalUser and authenticatedUser as resource group selectors.
• Use JDK 24 as the runtime in the Docker container.

As always, numerous performance improvements, bug fixes, and other features were added as well. Java 24 is coming as requirement soon - test the container!

Releases continue to be slower. Trino needs your help.

Other releases and announcements:

• Trino Gateway 16 delayed, but Trino Gateway Helm chart 1.15.1
• Trino Helm chart with 474 -> 1.38.0
• New book: Core Principles and Design Practices of OLAP Engines from Yiteng Xu and Gary Gao
• Massive new contribution looking for helpers - trino-query-ui

Let’s explore the query ui repo a bit more…

Application packaging and Trino

Manfred and Cole muse about the package artifacts from Trino, their history, scope and pain points:

• RPM
• tarball
• Docker container

All of them have and had issues, and everyone knew about them. Manfred documented a lot the usage in Trino: The Definitive Guide. Finally some time in 2024 Manfred put some ideas down and in the last months implemented a lot of it.

We discuss a few aspects such as the following:

• Plugin architecture of Trino
• What plugins are core or optional?
• Are artifacts ready to use or not?
• How painful is configuration?

Demo time

In our demo session we look at some of the changes and the new trino-packages repository:

• RPM removal from Trino, and replacement module
• trino-server-core tarball in Trino and plugin selection
• trino-server-custom module
• trinodb/trino-core:latest Docker container in Trino
• custom-docker module

Manfred runs a build, shows the results, and walks through the packages repository structure and instruction. To finish of we talk about next steps such as removing plugins from the default binaries and therefore making them optional.

Resources

• trino-packages repository
• Packaging improvement issue
• Trino plugin documentation

Rounding out

Quick update on where to see Cole or Manfred next, and then join us for the upcoming Trino events:

• Trino Contributor Call - 23rd of April
• Trino Community Broadcast 74: One tool to proxy them all (aws-proxy)
• Trino Community Broadcast 75: Insights from a Norse god (Loki connector)
• Trino Community Broadcast 76: Visualizing with Logi Symphony and ODBC

Let us know if you want to be a guest in a future broadcast.