Do you ❤️ Trino? Give us a 🌟 on GitHub

Trino Community Broadcast

Episodes

50: Celebrating 50 episodes of Trino Community Broadcast

Jul 6, 2023

Intro: Episode 50!
Trino releases: 421-422
Introducing our guests: Brian Olsen and Dain Sundstrom
Storytime with Brian: The incoming Snowflake connector
Questions for Dain: Setting an open source project up for success
An engine that does both: Brian and Cole insist that Trino can do ETL
Our favorite features in Trino: The Ignite connector, generic type support, and the SPI
Trino Fest wrap-up, and a peek at the Trino roadmap: Decoupling from Hive and Hadoop, and introducing dynamic catalogs

Listen, watch, or read the show notes...

49: Trino, Ibis, and wrangling Python in the SQL ecosystem

Jul 6, 2023

Intro: Trino, Ibis, and wrangling Python in the SQL ecosystem
Trino releases: 419-420
Concept of the episode: Introducing Philip Cloud and Ibis
Concept of the episode: Why use Ibis?
Concept of the episode: Scale vs. convenience
Concept of the episode: Federating while you federate, for accessing everything
Concept of the episode: Leveraging Arrow... and explaining what Arrow is
Concept of the episode: Ibis in practice and how much of a workload it can handle
Concept of the episode: Roadmap and future plans for Ibis + Trino
Pull request of the episode: #15026: Support INSERT in Google Sheets connector
Trino community update: New maintainer! Welcome Mateusz Gajewski

Listen, watch, or read the show notes...

48: What is Trino?

May 31, 2023

Trino releases: 417-418
Question of the episode: What is Trino?
Question of the episode: How do you run Trino?
Demo of the episode: Trino in the Docker container
Demo of the episode: The Trino tarball
Concept of the episode: Other Trino clients
Question of the episode: How can you contribute to Trino?
PR of the episode: #11701: Support Nessie Catalog in Iceberg connector
Trino Fest: Full speaker lineup preview

Listen, watch, or read the show notes...

47: Meet the new Trino maintainers

May 5, 2023

Trino releases: 411-416
Concept of the episode: Meet the new maintainers!
Concept of the episode: What is a maintainer?
Concept of the episode: The path to becoming a maintainer
PR of the episode: Improve TopN row number / rank performance
Outro: Upcoming events and Trino Fest

Listen, watch, or read the show notes...

46: Trino heats up with Ignite

Mar 15, 2023

Trino releases: 408-410
Concept of the episode: Introducing the Ignite connector to Trino
Concept of the episode: What is Ignite?
Concept of the episode: Contributing the Ignite connector
PR of the episode: Add support for `migrate` procedure in Iceberg

Listen, watch, or read the show notes...

45: Trino swimming with the DolphinScheduler

Feb 23, 2023

Trino Release: 407
Concept of the episode: What is workflow orchestration?
Concept of the episode: Why do we need a workflow orchestration tool for building a data lake?
Concept of the episode: What is Apache DolphinScheduler?
Concept of the episode: Does DolphinScheduler have any computing engine or storage layer?
Concept of the episode: What are the differences to other workflow orchestration systems
Demo of the episode: Creating a simple Trino workflow in DolphinScheduler
PR of the episode: Improve performance of Parquet files

Listen, watch, or read the show notes...

44: Seeing clearly with Metabase

Jan 26, 2023

Introduction: Manfred and guests
Recap of Trino in 2022: A summary of highlights from a recent blog post
Trino Summit recap: Our fun video from Brian
Release update: Trino releases from 2022 and the new 405 and 406 releases
Concept: What is Metabase
Concept: Clojure and more architecture details
Topic: History of Metabase and Trino
Concept: Core advantages of using Metabase with Trino
Demo: Metabase and Trino
Real world use cases: Trino, Metabase, and more at Meesho
Join us: Datanova from Starburst
PR of the episode: Starburst Metabase driver source code
Conclusion: Trino and Metabase are a great combination

Listen, watch, or read the show notes...

43: Trino saves trips with Alluxio

Dec 15, 2022

Release update: 404 Not Found
Concept of the episode: Data caching and orchestration
Concept of the episode: Trino without caching
Concept of the episode: What is Alluxio?
Concept of the episode: How does Alluxio work with table formats other than Hive?
Concept of the episode: Trino and Alluxio
PR of the episode: Alluxio/alluxio PR 13000 Add a doc for Trino
Demo of the episode: Running Trino on Alluxio

Listen, watch, or read the show notes...

42: Trino Summit 2022 recap

Nov 17, 2022

Trino Summit intro: 1:46
Why the Pokémon theme?: 3:56
Overview of Trino Summit and what stood out: 10:58
Bringing Trino to the masses: 33:57
Trino Contributor Congregation recap: 43:52
Releases: 402 to 403: 1:00:01
Backlog grooming: 1:03:51

Listen, watch, or read the show notes...

41: Trino puts on its Hudi

Oct 27, 2022

Releases: 396 to 401
Concept of the episode: Intro to Hudi and the Hudi connector
Concept of the episode: Merge on read and copy on write tables
Concept of the episode: Hudi metadata table
Concept of the episode: Hudi data layout
Concept of the episode: Robinhood Trino and Hudi use cases
Concept of the episode: Current state and roadmap for the Hudi connector
PR of the episode: PR 14445: Fault-tolerant execution for PostgreSQL and MySQL connectors
Demo: Using the Hudi Connector

Listen, watch, or read the show notes...

40: Trino's cold as Iceberg!

Sep 8, 2022

Releases: 394 to 395
Concept of the episode: What is Iceberg?
Concept: Why Iceberg over other formats?
Concept: Metadata catalogs
Concept: Branching, tagging, and auditing, oh my!
Concept: The Puffin file format
Concept: Trino Iceberg connector updates
PR of the episode: PR 13111: Scale table writers per task based on throughput
Demo: DML operations on Iceberg using Trino

Listen, watch, or read the show notes...

39: Raft floats on Trino to federate silos

Aug 18, 2022

Releases 392 and 393: Details about features and fixes in the new releases
Concept of the episode: Trino at Raft
Concept of the episode: Software factory
Concept of the episode: Standards and anatomy of a stack
Concept of the episode: Data Fabric at Raft
Concept of the episode: Security concerns around Trino
Concept of the episode: Iron bank container repository
Concept of the episode: Data Fabric user perspective
Concept of the episode: Challenges for adoption
Pull requests of the episode: PR 13354: Add S3 Select pushdown for JSON files
Demo of the episode: Running Great Expectations on a Trino Data Lakehouse Tutorial
Question of the episode: How can I deploy Trino on Kubernetes without using Helm chart?

Listen, watch, or read the show notes...

38: Trino tacks on polymorphic table functions

Jul 21, 2022

Trino is turning 10: Space Quest League and t-shirt giveaways
Releases 387 to 391: Details about features and fixes in the new releases
Concept of the episode: Polymorphic table functions
Demo of the episode: The many ways you can use polymorphic table functions
Pull request of the episode: PR 12325: Support query pass-through for JDBC-based connectors
Demo of the episode: How to leverage query pass-through

Listen, watch, or read the show notes...

37: Trino powers up the community support

Jun 16, 2022

Releases 382 to 386: Details about features and fixes in the new releases
Concept of the episode: How to strengthen the Trino community
Concept of the episode: Pull request releases
Concept of the episode: Impact of community and developer experience
Concept of the episode: Community metrics for better decision making
Pull requests of the episode: PR 12259: Support updating Iceberg table partitioning
Demo of the episode: Iceberg table partition migrations
Question of the episode: Can I force a pushdown join into a connected data source?

Listen, watch, or read the show notes...

36: Trino plans to jump to Java 17

May 19, 2022

Releases 379 to 381: Details about features and fixes in the new releases
Question of the episode: Will Trino be making a vectorized C++ version of Trino workers?
Concept of the episode: Java 17 and rearchitecting Trino
Java 17 updates: Performance
Java 17 updates: Garbage collectors
Java 17 updates: Java auto-vectorization
Java 17 updates: Performance
Java 17 updates: Language features
Rearchitecting Trino: Update to Java 17
Rearchitecting Trino: Revamping Trino
Rearchitecting Trino: Project Hummingbird
Pull requests of the episode: PR 4649: Disable JIT byte code recompilation cutoffs in default jvm.config
Demo of the episode: FizzBuzz - SIMD style!

Listen, watch, or read the show notes...

35: Packaging and modernizing Trino

Apr 21, 2022

Releases 375 to 378: Details about features and fixes in the new releases
Concept of the episode: Packaging Trino
Additional topic of the episode: Modernizing Trino with Java 17
Pull requests of the episode: Worker stats in the Web UI
Demo of the episode: Tarball installation and new Web UI feature
Question of the episode: HDFS supported by Delta Lake connector?

Listen, watch, or read the show notes...

34: A big delta for Trino

Mar 17, 2022

Releases 372, 373, and 374: Details about features and fixes in the new releases.
Project Tardigrade update: Learn about our progress for fault-tolerant query processing.
Concept of the episode: A new connector for Delta Lake object storage.
Pull requests of the episode: Add Delta Lake connector and documentation.
Demo of the episode: Delta Lake connector in action.
Question of the episode: How do I secure the connection from a Trino cluster to the data source?

Listen, watch, or read the show notes...

33: Trino becomes highly available for high demand

Feb 17, 2022

Concept of the month: High availability with Trino
PR of the month: PR 8956 Add support for external db for schema management in MongoDB connector
Bonus PR of the month: PR 8202 Metadata for alias in elasticsearch connector only uses the first mapping
Demo of the month: Trino Fiddle: A tool for easy online testing and sharing of Trino SQL problems and their solutions
Question of the month: Does Trino support CarbonData?

Listen, watch, or read the show notes...

32: Trino Tardigrade: Try, try, and never die

Jan 20, 2022

Concept of the month: Introducing Project Tardigrade
Concept of the month: Why ETL in Trino?
Concept of the month: Why are people reluctant to do their ETL in Trino?
Concept of the month: What are the limitations of the current architecture?
Concept of the month: Trino engine improvements with Project Tardigrade
Demo of the month: Task retries with Project Tardigrade
PR of the month: PR of the month: PR 10319 Trino lineage fails for AliasedRelation
Question of the month: How do you cast JSON to varchar with Trino?

Listen, watch, or read the show notes...

31: Trinites II: Trino on AWS Kubernetes Service

Dec 16, 2021

Concept of the month: ReplicaSets, Deployments, and Services
Demo of the month: Deploy Trino k8s to Amazon EKS
PR of the month: PR 8921: Support TRUNCATE TABLE statement
Question of the month: How do I run `system.sync_partition_metadata` with different catalogs?

Listen, watch, or read the show notes...

30: Trino and dbt, a hot data mesh

Nov 17, 2021

Concept of the week: Trino and dbt, a hot data mesh
PR of the week: Partitioned table tests and fixed PR 9757
Question of the week: What’s the difference between location and external_location?

Listen, watch, or read the show notes...

29: What is Trino and the Hive connector

Oct 28, 2021

Concept of the week: What is Trino?
PR of the week: PR 8821 Add HTTP/S query event logger
Question of the week: Does the Hive connector depend on the Hive runtime?

Listen, watch, or read the show notes...

28: Autoscaling streaming ingestion to Trino with Pravega

Oct 14, 2021

Concept of the week: Event stream abstractions and Pravega
Demo of the week: Querying Pravega from Trino
PR of the week: Pravega presto-connector PR 49
Question of the week: What is the point of Trino Forum, and what is the relationship to Trino Slack?

Listen, watch, or read the show notes...

27: Trino gits to wade in the data LakeFS

Sep 30, 2021

Concept of the week: LakeFS and Git on Object Storage
Demo of the week: Running Trino on LakeFS
PR of the week: PR 8762 Add query error info to cluster overview page in web UI
Question of the week: Why are deletes so limited in Trino?

Listen, watch, or read the show notes...

26: Trino discovers data catalogs with Amundsen

Sep 16, 2021

Concept of the week: Data discovery and Amundsen
Concept of the week: Amundsen architecture
Concept of the week: Amundsen as a subcomponent to data mesh
PR of the week: Index Trino views
Question of the week: Can I add a UDF without restarting Trino?

Listen, watch, or read the show notes...

25: Trino going through changes

Sep 2, 2021

Concept of the week: Change Data Capture
Concept of the week: Debezium
Concept of the week: Debezium + Trino at Zomato
PR of the week: PR 4140 Implement aggregation pushdown in Pinot
Question of the week: Is there an array function that flattens a row into three rows?

Listen, watch, or read the show notes...

24: Trinetes I: Trino on Kubernetes

Aug 19, 2021

Concept of the week: K8s architecture: Containers, Pods, and kubelets
PR of the week: PR 11 Merge contributor version of k8s charts with the community version
Demo: Running the Trino charts with kubectl

Listen, watch, or read the show notes...

23: Trino looking for patterns

Aug 2, 2021

Concept of the week: Row pattern matching and MATCH_RECOGNIZE
PR of the week: PR 8348 Document row pattern recognition in window
Demo: Showing MATCH_RECOGNIZE functionality by example
Question of the week: How do you tag a list of rows with custom periodic rules?

Listen, watch, or read the show notes...

22: TrinkedIn: LinkedIn gets a Trino promotion

Jul 22, 2021

Concept of the week: Trino usage at LinkedIn
Concept of the week: Trino hardware and operational scale
Concept of the week: Challenges operating at scale
Concept of the week: Open source at LinkedIn
Concept of the week: PrestoSQL to Trino upgrade challenges
Concept of the week: PrestoSQL to Trino upgrade steps
PR of the week: Digging into join queries
Question of the week: How can I query the Hive views from Trino?

Listen, watch, or read the show notes...

21: Trino + dbt = a match made in SQL heaven?

Jul 8, 2021

Question of the week: Can dbt connect to different databases in the same project?
Concept of the week: Trino + dbt = a match made in SQL heaven?
Demo: Querying Trino from a dbt project
PR of the week: PR 8283 Externalised destination table cache expiry duration for BigQuery Connector

Listen, watch, or read the show notes...

20: Trino for the Trinewbie

Jun 23, 2021

Concept of the week: Trino for the Trinewbie
PR of the week: PR 8135 Set default time zone for the current session
Demo: Contributing to Trino
Question of the week: How do I remove nulls from an array in Trino?

Listen, watch, or read the show notes...

19: Data Ingestion to Iceberg and Trino

Jun 10, 2021

Concept of the week: Ingesting into Iceberg with Pulsar and Flink at BlueCat
PR of the week: PR 1905 Add format_number function
Demo: Showing the format_number functionality
Question of the week: How do I search nested objects in Elasticsearch from Trino?

Listen, watch, or read the show notes...

18: Trino enjoying the view

May 20, 2021

Concept of the week: Trino Views, Hive Views and Materialized Views
PR of the week: PR 4832 Add Iceberg support for materialized views
Demo: Showing the different views in Trino
Question of the week: Are JDBC drivers backwards compatible with older Trino versions?

Listen, watch, or read the show notes...

17: Trino connector resurfaces API calls

May 13, 2021

Concept of the week: Resurface and the Resurface connector
PR of the week: PR 4022 Add Soundex function
Demo: Using the soundex function
Question of the week: Question of the week: How to export query results into a file (e.g. CTAS, but into a single file)?

Listen, watch, or read the show notes...

16: Make data fluid with Apache Druid

Apr 29, 2021

Concept of the week: Apache Druid and realtime analytics
PR of the week: PR 3522 Add Druid connector
Demo: Using the Druid Web UI to create an ingestion spec querying via Trino
Question of the week: Does the Druid connector?

Listen, watch, or read the show notes...

15: Iceberg right ahead!

Apr 15, 2021

Concept of the week: Apache Iceberg and the Iceberg spec
PR of the week: PR 7233 Fix queries on tables without snapshot id
Demo: Creating tables with Iceberg and reading the data in Trino
Question of the week: What do I do to restart the test pipeline if it fails on me?

Listen, watch, or read the show notes...

14: Iceberg: March of the Trinos

Apr 1, 2021

Concept of the week: Apache Iceberg and the table format
PR of the week: PR 1067 Add Iceberg connector
Demo: Creating tables with Iceberg and reading the data in Trino
Question of the week: Why does Trino still depend on the Hive metastore if metadata for Iceberg saves to the filesystem?

Listen, watch, or read the show notes...

13: Trino takes a sip of Pinot!

Mar 18, 2021

Concept of the week: Data cubes and Apache Pinot
Interview: Apache Pinot
PR of the week: PR 2028 Add Pinot connector
Question of the week: Why does my passthrough query not work in the Pinot connector?
Demo: Pinot batch insertion and query using Trino Pinot connector

Listen, watch, or read the show notes...

12: Trino gets super visual with Apache Superset!

Mar 4, 2021

Concept of the week: Trino clients, Python, and Apache Superset
PR of the week: Superset PR 13105 feat: first step native support Trino
Demo: Superset querying Trino to create visualization dashboard
Question of the week: How do I use the Trino REST api?

Listen, watch, or read the show notes...

11: Dynamic filtering and dynamic partition pruning

Feb 18, 2021

Concept of the week: Dynamic filtering and Recap
PR of the week: PR 1072 Implement dynamic partition pruning
PR Demo: PR Demo: PR 1072 Implement dynamic partition pruning

Listen, watch, or read the show notes...

10: Naming the bunny!

Feb 4, 2021

Where did the bunny come from?: Link
Bunny names in the running...: Link
And our bunny's name is..: Link
Release 352 sneak peek: Link
Community status update: Link

Listen, watch, or read the show notes...

9: Distributed hash-joins, and how to migrate to Trino

Jan 21, 2021

Question of the week: How do I migrate to Trino from PrestoSQL?
Concept of the week: Distributed hash-join
Quick Discussion: Contributing Documents and Testimonials

Listen, watch, or read the show notes...

8: Trino: A ludicrously fast query engine: past, present, and future

Jan 11, 2021

Martin Traverso Introduction: Link
Dain Sundstrom Introduction: Link
David Phillips Introduction: Link
Eric Hwang Introduction: Link
Past: Presto name, Facebook projects, and open source: Link
Past: Where did the name Trino come from?: Link
Past: Why Martin, Dain, and David left Facebook and created a Presto fork: Link
Past: Why did you choose to continue using Presto instead of rebranding?: Link
Past: How did the contending Presto drive us to rebrand as Trino?: Link
Present: Did you know this project would span decades and when did you know?: Link
Present: What tricks did you use to rename an entire project in the span of a week?: Link
Present: The top-level project nesting changes: Link
Present: Where did the bunny come from?: Link
Future: How do you move to Trino and how to handle breaking changes?: Link
Future: How to explain that you are using Trino and not Presto to your boss.: Link
2021 Trino Roadmap: Link

Listen, watch, or read the show notes...

7: Cost Based Optimizer, Decorrelate subqueries, and does Presto make my RDBMS faster?

Nov 30, 2020

Concept of the week: Cost Based Optimizer
PR of the week: PR 1415 Decorrelate subqueries with Limit or TopN
PR Demo: EXPLAIN Decorrelate subqueries with Limit or TopN
Question of the week: Will running Presto on my relational database make processing faster?

Listen, watch, or read the show notes...

6: Query Planning, Remove duplicate predicates, and Memory settings

Nov 30, 2020

Concept of the week: Query Planning
PR of the week: PR 730 Remove duplicate predicates
PR Demo: EXPLAIN LOGICAL and DISTRIBUTED demo
Question of the week: How should I allocate memory properties?

Listen, watch, or read the show notes...

5: Hive Partitions, sync_partition_metadata, and Query Exceeded Max Columns!

Nov 19, 2020

Concept of the week: Hive Partitioning
PR of the week: PR 223 Add system.sync_partition_metadata procedure to sync Hive table partitions
PR Demo: system.sync_partition_metadata procedure demo
Question of the week: Why am I getting, 'Query exceeded maximum columns.' error?

Listen, watch, or read the show notes...

4: Presto on ACID, row-level INSERT/DELETE, and why JDK11?

Nov 4, 2020

Concept of the week: Presto on ACID
PR of the week: PR 5402 Hive ACID row-level INSERT and DELETE
PR Demo: Hive ACID row-level INSERT and DELETE demo
Question of the week: Why is JDK 11 required to run Presto and how can I revert to JDK8?

Listen, watch, or read the show notes...

3: Running two Presto distributions and Kafka headers as Presto columns

Oct 22, 2020

Interview: Using multiple Presto distributions
PR of the week: PR 4462 Add Kafka headers as columns

Listen, watch, or read the show notes...

2: Kubernetes, arrays on Elasticsearch, and security breaks the UI

Oct 7, 2020

Presto Event: Presto for any company size
Concept of the week: Presto on Kubernetes
PR of the week: PR 2441 Add array support using the _meta mapping in Elasticsearch
Question of the week: Why does my Presto UI say web interface disabled?

Listen, watch, or read the show notes...

1: What is Presto, WITH RECURSIVE, and Hive connector

Sep 24, 2020

Concept of the week: What is Presto?
PR of the week: PR 5163 WITH RECURSIVE
Question of the week: Does the Hive connector depend on the Hive runtime?

Listen, watch, or read the show notes...